AI Tuning Specialist

About the role

The AI Tuning Specialist is responsible for improving the performance of AI-enabled solutions by analyzing operational outcomes, identifying optimization opportunities, testing prompt and workflow changes, and validating performance improvements. This role collaborates with cross-functional teams to enhance AI quality, consistency, efficiency, and overall business performance through continuous optimization.

What you'll do

• Analyze AI-generated outputs, operational data, and performance metrics to identify opportunities for optimization and improved business outcomes.
• Design, test, and validate prompt, workflow, and configuration changes to improve AI accuracy, consistency, and operational effectiveness.
• Monitor AI performance following implemented changes to measure results, validate improvements, and identify additional optimization opportunities.
• Document optimization activities, testing methodologies, results, and recommendations to support knowledge sharing and ongoing improvements.
• Collaborate with Quality, Knowledge Management, Governance, Operations, Product, and Technology teams to prioritize optimization initiatives and implement approved improvements.
• Analyze recurring quality issues, exception trends, customer feedback, and operational data to identify opportunities for AI enhancement.
• Support controlled testing, pilot programs, and performance evaluations for new AI capabilities, workflows, and operational improvements.
• Develop reports, dashboards, and performance summaries that communicate optimization results, trends, and recommendations to business stakeholders.
• Maintain documentation related to prompts, testing activities, optimization history, and performance outcomes in accordance with governance standards.
• Identify opportunities to improve optimization methodologies, testing processes, operational workflows, and AI performance through continuous improvement initiatives.
• Adhere to company policies and procedures.
• Meet or exceed performance targets for related KPIs.
• Continuously improve knowledge of products, services, and processes by participating in training programs and continuous learning modules.
• Collaborate with other departments as needed.
• Maintain a positive, empathetic, and professional attitude toward customers and colleagues at all times.

Requirements

• Minimum of three (3) years of experience in business analysis, operations, quality assurance, process improvement, data analysis, AI operations, or a related field.
• Experience analyzing operational data, quality results, or performance metrics to identify trends and improvement opportunities.
• Experience testing, validating, documenting, and implementing processes, workflows, systems, or operational improvements.
• Experience collaborating with cross-functional stakeholders to evaluate business requirements and support continuous improvement initiatives.
• Knowledge of structured testing methodologies, process optimization, workflow analysis, and performance measurement principles.
• Strong analytical and problem-solving skills with the ability to evaluate complex data, identify root causes, and recommend practical solutions.
• Strong written and verbal communication skills with the ability to clearly document findings, testing results, and optimization recommendations.
• Strong organizational and project management skills with the ability to manage multiple initiatives while maintaining attention to detail and documentation accuracy.
• Ability to work independently and collaboratively in a fast-paced environment while adapting to evolving technologies and business priorities.
• Commitment to continuous improvement, operational excellence, data-driven decision-making, and responsible AI optimization.

AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.