← All jobs
ML Inference Engineer
About the role
Toptal is hiring ML inference and serving experts to turn real paid work into benchmark tasks that test how AI agents handle expert work in a terminal. Pay is task-based.
What you'll do
- Design expert-level Terminal-Bench tasks that turn real ML inference work into challenges an AI agent must solve end to end.
- Define the files, systems and environments each task runs on, such as model serving with streaming.
- Include a working solution and an automated check that proves the result is correct.
Requirements
- 3+ years doing ML inference or serving work hands-on, or a PhD plus active research in the subfield.
- Did this work in the last 3 years and can name the systems, tools, data and rules used.
- AI lab or LLM infrastructure experience.
- GPU profiling experience.
- Experience writing automated tests.
About Toptal
Toptal is posting a task-based role to build a benchmark of expert ML inference work for AI agents.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.