Project Manager, Applied AI

About the role

We are looking for a data-driven Project Manager to lead large-scale multilingual data collection and Large Language Model (LLM) evaluation initiatives. Location: Global: Europe, Asia-Pac, Argentina, Mexico. Rate: $20 per hour.

What you'll do

• Manage the full lifecycle of AI data projects, from scoping and guidelines creation to data delivery and post-mortem analysis.
• Oversee large-scale data pipelines for multilingual data collection (audio, text, image) and LLM evaluation (RLHF, SFT, ranking, and safety testing).
• Rigorously monitor and report on throughput, quality, and productivity KPIs including IAA and gold-set performance.
• Run QA loops, root-cause analysis for quality dips, and corrective training for annotator pools.
• Maintain dashboards to visualize project health and flag bottlenecks in real-time.
• Liaise with Applied AI Technical Ops teams and translate technical requirements into clear guidelines for non-technical annotators.
• Facilitate continuous feedback loops where data insights drive updates to annotation guidelines and model fine-tuning strategies.

Requirements

• 3-5+ years of project management experience, specifically within AI/ML data operations.
• Strong understanding of LLM training processes (Pre-training, SFT, RLHF) and evaluation methodologies (Human-in-the-loop, red teaming).
• Advanced proficiency in Excel/Google Sheets; ability to write SQL queries to extract and analyze performance data.
• Proven track record using Agile, Scrum, or Kanban methodologies to manage complex workflows.
• Exceptional ability to write clear, unambiguous guidelines for multilingual audiences.
• Fluency in a second language is highly desirable.

About Lilt

LILT's mission is to make the world's information available to everyone, no matter the language they speak.

Visit Lilt→

AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.