Developer and Infrastructure AI Workflow Evaluator
About the role
OpenTrain AI is recruiting a Developer and Infrastructure AI Workflow Evaluator to assess AI-assisted workflows used in software engineering, DevOps, cloud, platform engineering, and infrastructure contexts — evaluating commands, configurations, and technical outputs. Part-time, worldwide-remote contractor project on OpenTrain's Philippines-eligible jobs page.
What you'll do
- Assess AI-generated commands, configurations, and technical outputs
- Evaluate workflows involving GitHub, GitLab, JIRA, AWS, Azure, GCP, Kubernetes, Docker, and Terraform
- Review how AI agents interact with Slack, Google Drive, and Microsoft 365
- Judge accuracy, relevance, usability, and alignment with real-world industry standards
- Document observations and identify technical discrepancies
- Provide detailed written evaluations and recommend improvements
Requirements
- Professional experience in software engineering, DevOps, SRE, cloud, platform engineering, or infrastructure
- Hands-on judgment with AWS, Azure, GCP, Kubernetes, Docker, Terraform, CI/CD, or observability workflows
- Familiarity with GitHub, GitLab, JIRA, or comparable developer platforms
- Clear, detailed written and verbal communication
- Prior AI experience is not required given strong professional domain expertise
About OpenTrain AI
OpenTrain is a talent marketplace and the hiring/contracting organization for AI training and data-labeling work, connecting freelance contractors with RLHF, evaluation, red-teaming, and annotation projects for AI companies; OpenTrain states it works with 342,000+ freelancers.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.