AI Cost-Optimisation Gateway Engineer

About the role

Build a pilot AI cost-optimisation gateway that sits between client apps and OpenAI, Anthropic, and Google. It masks personal data, caches by tenant, and shows the savings.

What you'll do

• Build a gateway between client apps and OpenAI, Anthropic, and Google.
• Mask personal data with Microsoft Presidio and custom UK detectors.
• Add multi-tenant keys, budgets, tenant-isolated caching, and versioned pricing.
• Track savings, fail closed by default, and produce monthly statements and dashboards.
• Propose a pilot-core option and a full-scope option.

Requirements

• Experienced backend engineer.
• Work in the fixed stack: LiteLLM, Presidio, TypeScript/NestJS, Next.js, PostgreSQL with pgvector, Redis, Docker, and AWS London across two availability zones.
• Include weekly hours, a start date, and a relevant project example in the proposal.

AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.