Specialized Industries AI Workflow Evaluator
About the role
OpenTrain AI is recruiting a Specialized Industries AI Workflow Evaluator to assess AI outputs and professional-scenario simulations in fields such as government contracting/federal acquisition, commodities and maritime, nonprofit and grants, or education operations, using project rubrics and documented evidence. Part-time, worldwide-remote contractor project (about 20 hrs/week, 1–3 months) on OpenTrain's Philippines-eligible jobs page.
What you'll do
- Evaluate model outputs and apply project rubrics
- Review source materials and model outputs against project guidelines
- Document evidence-based judgments and findings
- Assess whether professional workflows are complete and practical
- Maintain consistency and quality across repeated review tasks
- Provide constructive written recommendations
Requirements
- Substantial professional experience in government contracting/federal acquisition, commodities and maritime, nonprofit and grants, or education operations
- Direct professional experience using generative AI applications (e.g. ChatGPT, Claude, Codex)
- Strong written communication and attention to detail
- Ability to follow detailed project instructions and apply rubrics consistently
- Fluency in English
About OpenTrain AI
OpenTrain is a talent marketplace and the hiring/contracting organization for AI training and data-labeling work, connecting freelance contractors with RLHF, evaluation, red-teaming, and annotation projects for AI companies; OpenTrain states it works with 342,000+ freelancers.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.