Music Expert AI Reviewer (Prompts and Answers)
About the role
People with a Master's degree or higher and a strong knowledge of music can help train AI by writing hard music questions and checking the answers AI gives for accuracy and reasoning. It is an 8 week project of 40 hours a week with at least 4 hours of overlap with Pacific time, fully remote contract work. Click Apply to open the Turing page, sign up there using this link, and Turing handles screening and hiring. AI Alerts may earn a referral fee if you're hired through this link. It costs you nothing and doesn't change how we pick or rank jobs.
What you'll do
- Write advanced prompts on music theory, genres, composers, artists, production and instruments to test AI models
- Check AI answers for factual accuracy, reasoning quality, completeness and nuance
- Spot made up facts, logical gaps, outdated information and edge cases in AI answers
- Build benchmark datasets and adversarial test cases
- Give evidence based feedback with reliable references
- Work with AI researchers to improve model performance and keep annotation quality and documentation high
Requirements
- Master's degree or higher in any field; degrees in music related fields such as Music Theory, Musicology, Ethnomusicology, Music Education, Music Production, Audio Engineering or Performing Arts are preferred
- Strong knowledge of music, including theory, composition, genres, composers, artists, instruments, music history, production techniques, notation and contemporary trends
- 3 or more years of relevant professional experience, preferably in music education, performance, composition, production, journalism, research, content creation or audio engineering
- Excellent written English, research and analytical skills
- Strong attention to detail and ability to spot factual inconsistencies across diverse musical topics
- Preferred: experience with LLMs, generative AI, prompt engineering or AI evaluation
- Preferred: published research, industry recognition or teaching experience
- Ability to work independently and give objective, evidence backed reviews
About Turing
Turing is an AI company based in San Francisco that works with the world's leading AI labs to make their models better at reasoning, coding, languages and more. It also helps businesses build real AI systems, and it works with talent from over 100 countries.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.