AI Domain Advisor Consultant (Subject Matter Expert)
About the role
Meridial is seeking elite subject matter experts to partner on high-impact AI evaluation and training projects. As a Domain Advisor Consultant, you will architect evaluation rubrics, curate 'golden' benchmark data, and analyze model failures — defining the ground truth for large language models in your professional specialty.
What you'll do
- Architect and review evaluation rubrics to determine whether AI outputs meet professional standards in your domain of expertise
- Create, edit, or certify 'Golden Tasks' — benchmark prompt-and-response pairs that serve as ground truth for model training
- Analyze model failures such as hallucinations and logical fallacies, providing expert breakdowns of why the model failed and how a human expert would approach the problem
- Advise on prompt complexity and difficulty to ensure AI models are tested against sufficiently rigorous, realistic scenarios
Requirements
- Advanced degree (PhD, MD, JD) or equivalent industry-recognized elite status — e.g., Senior Principal Engineer, Published Author, or Award-Winning Creative
- Currently operating as an independent consultant or freelancer with your own professional workflows, workspace, and equipment
- Ability to clearly articulate expert reasoning and professional judgment in writing
- Must be registered to operate as an independent contractor in your country of residence
- Prior experience in AI evaluation is a bonus but not required; domain authority is the primary qualification
About Meridial
Meridial is the expert marketplace powered by Invisible Technologies, connecting elite subject matter experts with AI companies to provide high-quality training data, evaluation, and safety work for large language models.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.