LLM Evaluation and AI Data Analyst
About the role
OpenTrain AI is recruiting an LLM Evaluation and AI Data Analyst to support the improvement and fine-tuning of large language models. The role involves examining AI-generated responses, assessing accuracy and consistency, and providing detailed feedback that helps models produce more reliable results.
What you'll do
- Analyze content and AI-generated answers against standards for accuracy, relevance, logic, and consistency
- Conduct online research to investigate topics and validate claims
- Analyze data, trends, distributions, and scenarios to identify meaningful insights
- Create scenarios, questions, examples, and explanations that support language-model training
- Identify incorrect or incomplete responses and explain why an answer is correct or incorrect
- Provide constructive feedback and detailed annotations while maintaining high quality standards
Requirements
- Strong written and reading English
- Analytical and critical-thinking ability
- Research and problem-solving skills
- Basic knowledge of Excel or Google Sheets
- Reliable computer and internet connection; able to work independently remotely
About OpenTrain AI
OpenTrain AI is a talent marketplace connecting AI companies with freelance contributors for AI training, data labeling, and evaluation work.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.