Web Research Specialist, AI Browsing Benchmarks
About the role
OpenTrain AI is hiring a Web Research Specialist to design difficult, verifiable research questions that test how well frontier AI browsing agents can locate, interpret, and verify information across the open web. This is an 8-week remote contractor assignment at 40 hours per week (20+ hour minimum), with at least 4 hours of daily overlap with Pacific Time. Candidates apply through OpenTrain, which may place successful candidates with the client whose project they support.
What you'll do
- Design natural-language research questions with short, objectively verifiable answers
- Create questions that remain difficult for advanced AI browsing agents with full web access
- Develop clues involving dates, people, places, organizations, works, events, records, and quantities
- Work backward from a verifiable fact to make its location unusually challenging
- Record the obvious searches you ran and the results those searches returned
- Cite exact pages, tables, and sections from primary records
- Maintain structured documentation and precise validation records
Requirements
- Master's degree or more than 3 years of experience
- Demonstrated open-web research ability
- Experience locating primary records in government and institutional databases, archives, registries, and PDF documents
- Precision sourcing with exact page, table, and section citations
- Experience with LLM evaluation, red-teaming, or benchmark construction
- Native or near-native written English
- Familiarity with JSON and structured data delivery formats is helpful
About OpenTrain AI
OpenTrain AI is a talent marketplace and hiring organization that connects freelance AI trainers and data labelers with contracts to build and evaluate AI training and benchmark data; it may place successful candidates with the client whose project they support.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.