Scientific Figure Understanding Model Evaluator Job at AuraOne Human Data, Remote

  • AuraOne Human Data
  • Remote

Job Description

Scientific Figure Understanding Model Evaluator is a remote review track for evaluating AI outputs across scientific figure understanding model research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Scientific Figure Understanding Model research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current scientific figure understanding model research review methods, conventions, and prior work for Scientific Figure Understanding Model Evaluator assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in scientific figure understanding model research review or a closely related field for Scientific Figure Understanding Model Evaluator work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce a scientific figure understanding model research review derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Scientific Figure Understanding Model research review
  • Multimodal evaluation
  • Cross-modal reasoning
  • Grounding review
  • Scientific
  • Figure
  • Understanding

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Job Tags

Remote job, Hourly pay, For contractors, 10 hours per week

Similar Jobs

Aequor

Travel Interventional Radiology (IR) - $2,974 per week in Santa Maria, CA Job at Aequor

 ...Mojave Desert, and redwood forests. Technology (Silicon Valley), entertainment (Hollywood), agriculture, and aerospace. Home to the world's oldest and tallest treesbristlecone pines and redwoods. Home to Hollywood film industry and numerous major universities.... 

Tech Observer

Medicaid Proposal Writer Job at Tech Observer

 ...Sr Proposal Writer - Medicaid Behavioral Health and Care Management Great sales are the result of strong purpose, conviction and pride - pride in your ability and your product. Health Care Company offers a portfolio of products that are greatly improving the life of... 

Confidential

Chief Revenue Officer (CRO) Job at Confidential

 ...Chief Revenue Officer (CRO) About the Company Thriving provider of revenue cycle management solutions in the healthcare industry Industry Hospital & Health Care Type Privately Held, Private Equity-backed Founded 2015 Employees 5001-10,000 Categories... 

Greenpoint Optometric Group PLLC

Receptionist Job at Greenpoint Optometric Group PLLC

 ...Job Description Job Description Busy Optometrist Practice located in Greenpoint look to hire a front desk receptionist. Polish speaking a PLUS Must have good phone skills and be able work well with patients. Please call me at(***) ***-****. and sent your resume to... 

ATA Services Inc.

Full Time Post Office Clerk Job at ATA Services Inc.

 ...ATA Services, Inc. is currently seeking to hire a part-time Office Clerk to work on a long-term temporary assignment.Pay Rate: $18.00 per hourStart Date: ImmediateRemote position must live in New MexicoThe Temporary Remote Office Clerk will provide administrative...