Italian Audio Evaluations Specialist — Freelance AI Trainer Project
About the role
Meridial is sourcing independent Audio Evaluation Specialists for an AI benchmark project assessing advanced agentic audio models. Contractors will design role-play evaluation scenarios simulating real-world customer service interactions, audit conversational AI outputs across standardized metrics, and generate clean evaluation datasets — open to Italian-speaking professionals worldwide.
What you'll do
- Design and execute complex role-play evaluation scenarios simulating realistic customer service interactions across travel, finance, and technical support domains
- Evaluate AI model performance on task completion accuracy, conversational naturalness, and audio comprehension using standardized qualitative and quantitative metrics
- Assess the model's understanding of JSON structures, functions, and structured data within a support context
- Contribute to high-quality audio datasets reflecting real customer expectations for clarity, efficiency, and natural conversational flow
Requirements
- Native or bilingual proficiency in Italian, including fluency across reading, listening, writing, and speaking
- Demonstrable professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation
- Basic computer programming literacy — comfortable understanding of JSON structures, functions, methods, and simple logic
- Detail-oriented approach to structured prompts, complex evaluation rubrics, and technical guidelines
- Access to a high-quality microphone for voice evaluations (required equipment)
About Meridial
Meridial is the expert marketplace powered by Invisible Technologies, connecting elite subject matter experts with AI companies to provide high-quality training data, evaluation, and safety work for large language models.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.