Chatbot Quality AI Reviewer
About the role
People with a quality assurance, data annotation or content evaluation background can help train AI by comparing answers from several chatbots and writing a final assessment for each task. It is a 16 week project with a set number of tasks, fully remote contract work, five working days a week including weekends as needed. Click Apply to open the Turing page, sign up there using this link, and Turing handles screening and hiring. AI Alerts may earn a referral fee if you're hired through this link. It costs you nothing and doesn't change how we pick or rank jobs.
What you'll do
- Compare responses from several chatbots against set guidelines to help train AI
- Rate answers for accuracy, relevance, completeness, clarity and fit with the guidelines
- Find errors, inconsistencies, missing information and quality issues
- Write structured feedback and a final assessment for each task
- Document findings clearly and escalate complex or unclear cases
- Work with project and quality teams to settle questions and meet productivity, quality and turnaround targets
Requirements
- Experience in Quality Assurance, data annotation, content evaluation, testing, or a similar role
- Strong analytical, critical thinking and problem solving skills
- Excellent written and verbal communication skills
- High attention to detail and ability to spot subtle errors
- Ability to follow detailed instructions and evaluation guidelines
- Comfortable working with AI tools, chatbots and online platforms
- Ability to work independently and manage multiple tasks
- Nice to have: prior experience with chatbot evaluation, LLM testing, or data quality projects
About Turing
Turing is an AI company based in San Francisco that works with the world's leading AI labs to make their models better at reasoning, coding, languages and more. It also helps businesses build real AI systems, and it works with talent from over 100 countries.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.