AI Operations Specialist
About the role
We are seeking an exceptional AI Operations Specialist to apply advanced STEM expertise to evaluate and improve AI-generated content. Specialists assess technical accuracy, reasoning, relevance, and quality within structured AI operations workflows.
What you'll do
- Evaluate AI-generated content for technical accuracy, reasoning, completeness, and relevance.
- Create or review expert responses, explanations, and reasoning examples.
- Compare, rank, annotate, classify, and validate model outputs using defined criteria.
- Identify scientific, mathematical, technical, logical, or methodological errors.
- Evaluate multimodal content such as text, images, charts, equations, and code.
- Support model safety, red-teaming, and validation activities as required.
- Apply project guidelines consistently and document evaluation rationale when needed.
- Meet established quality, productivity, attendance, and scheduled-hour requirements.
Requirements
- 10+ years of directly relevant professional experience OR Doctorate in a relevant STEM discipline.
- Specialties: Biology, Chemistry, Mathematics, Physics, Statistics, Computer Science, Engineering, and related fields.
- Advanced expertise in the applicable STEM field.
- Strong analytical, critical-thinking, and problem-solving skills.
- Ability to independently evaluate complex technical reasoning and identify substantive errors.
- Strong written communication and attention to detail.
- Ability to work effectively within structured, technology-enabled workflows.
- Preferred Qualifications
- Experience reviewing, teaching, publishing, or developing advanced technical content.
- Experience with AI evaluation, annotation, preference ranking, red teaming, or similar work.
- Familiarity with generative AI and large language models.
About 1840 & Company
1840 & Company is a global organization focused on delivering innovative business solutions that help companies grow, scale, and succeed. Operating in over 150 countries, we support organizations through a range of workforce, operational, and business services designed to drive efficiency and long-term success.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.