ExpertTide

AI training jobs / Other

Intelligence Analyst

Other · posted 23 Oct 2026

Role description

Role Type: Contractor

Location: Remote

The hiring platform is engaging Intelligence Analysts to contribute to a customer-facing project focused on evaluating and advancing artificial intelligence capabilities. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work

  • Develop and map analytic cases to defined taxonomies across multiple evaluation areas, ensuring comprehensive coverage of relevant intelligence scenarios.
  • Author complex test cases designed to evaluate model performance on source handling, analytic rigor, and nuanced uncertainty expression.
  • Assess and grade AI-generated responses based on criteria such as reasoning, source use, recognition of limitations, and practical utility.
  • Identify and flag instances where legitimate analytic exploration is over-refused by the model, providing clear documentation and feedback.
  • Document edge cases and analytic disagreements, supporting continuous improvement of evaluation methodologies.
  • Collaborate with project leads to refine procedures for source evaluation and confidence-level assignment.
  • Contribute insights to help calibrate analytic standards and enhance the overall quality of AI system benchmarks.

Preferred Qualifications

  • Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline, ideally with a civilian-IC background.
  • Strong proficiency in source evaluation, confidence-level assessment, and established analytic standards.
  • Experience in teaching, mentoring, or leading analytic reviews, with a record of fostering analytic rigor.
  • Exceptional written and verbal communication skills, with a focus on clarity and precision.
  • Ability to identify and articulate nuanced model limitations and over-refusal scenarios.
  • Familiarity with structured analytic techniques and intelligence tradecraft standards.
  • Previous participation in AI evaluation or model assessment initiatives is a plus.

Learn More About Our Government & Defense Work

At the hiring platform, we work with government and defense experts to evaluate how advanced AI models perform on real-world tasks.

Our MissionReport benchmark assesses AI-generated military and government reports, highlighting the importance of expert judgment, accuracy, and operational understanding.

Learn more: https://www.The hiring platform.ai/benchmark/mission-report

Skills listed

Analytic rigorSource handlingOver-refusal detectionAll-Source Intelligence Analysis

Role text as published by the hiring platform. Checked 14 Nov 2026.

Similar roles

Special Forces Operator

Other · 10 openings Remote · open to US & UK
$80–170/hr
tactical operations expertisemission planningmilitary tactics and procedures+7

Fighter Pilot

Other · 10 openings Remote · open to US & UK
$80–170/hr
military aviation tacticsmission planningweapons systems expertise+7

Defense Analyst

Other · 10 openings Remote · location not stated
$80–170/hr
military operations analysisdefense researchconflict analysis+7

Heads up

If the hiring platform mentions Vitor Varela, that's me, the person behind ExpertTide.

I found this role for you. Applying is free.

Continue to apply