Intelligence Analyst Job at micro1 Inc., United States

  • micro1 Inc.
  • United States

Job Description

Role Title: Intelligence Analyst

Role Type: Contractor

Location: Remote

micro1 is engaging Intelligence Analysts to contribute to a customer-facing project focused on evaluating and advancing artificial intelligence capabilities. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required - your domain knowledge is what matters.

Scope of Work
  1. Develop and map analytic cases to defined taxonomies across multiple evaluation areas, ensuring comprehensive coverage of relevant intelligence scenarios.
  2. Author complex test cases designed to evaluate model performance on source handling, analytic rigor, and nuanced uncertainty expression.
  3. Assess and grade AI-generated responses based on criteria such as reasoning, source use, recognition of limitations, and practical utility.
  4. Identify and flag instances where legitimate analytic exploration is over-refused by the model, providing clear documentation and feedback.
  5. Document edge cases and analytic disagreements, supporting continuous improvement of evaluation methodologies.
  6. Collaborate with project leads to refine procedures for source evaluation and confidence-level assignment.
  7. Contribute insights to help calibrate analytic standards and enhance the overall quality of AI system benchmarks.
Preferred Qualifications
  1. Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline, ideally with a civilian-IC background.
  2. Strong proficiency in source evaluation, confidence-level assessment, and established analytic standards.
  3. Experience in teaching, mentoring, or leading analytic reviews, with a record of fostering analytic rigor.
  4. Exceptional written and verbal communication skills, with a focus on clarity and precision.
  5. Ability to identify and articulate nuanced model limitations and over-refusal scenarios.
  6. Familiarity with structured analytic techniques and intelligence tradecraft standards.
  7. Previous participation in AI evaluation or model assessment initiatives is a plus.

Learn More About Our Government & Defense Work

At micro1, we work with government and defense experts to evaluate how advanced AI models perform on real-world tasks.

Our MissionReport benchmark assesses AI-generated military and government reports, highlighting the importance of expert judgment, accuracy, and operational understanding.

Learn more:

Job Tags

For contractors, Remote work

Similar Jobs

Career Launch AI

Management Consultant Job at Career Launch AI

 ...Job Description Job Description Management Consultant (Entry-Level) Career Launch AI Talent Network Location: Multiple Locations (New York, Chicago, Boston, San Francisco, etc.) Type: Full-Time Compensation: Typically $95,000 $125,000+ base + bonus (varies... 

Bluebird Kids Health

Pediatric Medical Assistant Job at Bluebird Kids Health

 ...provides underserved communities with new access to value-based pediatric primary care. We are on a mission to provide exceptional care, so every...  .... We offer comprehensive, evidence-based primary and urgent care services to children and their families, with support around... 

Insight

Patient Access Representative Job at Insight

 ...Patient Access Representative Insight Institute of Neuroscience & Neurosurgery (IINN) aims to advance, challenge, and revolutionize neurosciences and medicine through scientific research and advanced technology, driven by a passion to help others regardless of any... 

R2 Global

Director of eCommerce - $200,000 - Miami/Fort Lauderdale Job at R2 Global

 ...Director of eCommerce $200,000 Miami/Fort Lauderdale: R2 Global is working with a leading, established brand to identify an experienced Director of eCommerce to spearhead the launch and growth of an exciting new Direct-to-Consumer (DTC) platform, built on Shopify... 

Safe Life Home Health Care

Hindi/Urdu Speaking In-Home Caregiver (Live-In) Job at Safe Life Home Health Care

Safe Life Home Health Care in Lombard, IL is hiring a Hindi/Urdu speaking caregiver for full-time, live-in and hourly positions. The caregiver will assist with personal care, daily living activities, meal prep, transportation, and medication reminders, in clients' homes...