AI Research Question Writer And Evaluator
About the role
OpenTrain AI is recruiting an AI Research Question Writer and Evaluator to support research-focused AI training: investigating subjects, writing challenging multi-step research questions, testing them against AI models, and evaluating the models' answers with citations and clear reasoning. Part-time, worldwide-remote contractor project listed on OpenTrain's Philippines-eligible jobs page.
What you'll do
- Conduct independent multi-source research and triangulate sources
- Write original, nuanced questions requiring multi-step reasoning
- Create answer materials supported by citations
- Test questions and content against AI models and evaluate the answers for quality and reasoning
- Refine question difficulty and content based on results, and document research methods clearly
- Apply reviewer feedback and detailed project quality standards consistently
Requirements
- Precise, fluent English writing
- Strong attention to detail and analytical thinking
- Ability to craft multi-step questions requiring synthesis and reasoning
- Independent multi-source research and source-triangulation skills
- Reliability and self-direction in remote project work
- Prior AI training experience is not required
About OpenTrain AI
OpenTrain is a talent marketplace and the hiring/contracting organization for AI training and data-labeling work, connecting freelance contractors with RLHF, evaluation, red-teaming, and annotation projects for AI companies; OpenTrain states it works with 342,000+ freelancers.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.