AI training Engineer: author hard coding tasks + hidden test suites for AI agent benchmarks

About the role

AI coding agents. Each task is a realistic feature ticket on an existing web app, with a hidden test suite, a reference solution, and evidence the tests are fair.

What you'll do

• Read an existing React, TypeScript, Bun, and SQLite codebase and design a new feature task
• Write a short unambiguous ticket with numbered acceptance criteria
• Write the reference implementation
• Write a black-box hidden test suite at the HTTP/API level
• Show that the tests assert only what the ticket states

Requirements

• Experienced full-stack engineer
• React and TypeScript
• API testing experience
• Careful, precise work on fair grading

About Upwork client

Client hiring an engineer to author coding tasks and hidden tests that evaluate AI coding agents.

AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.