← All jobs
QA / AI Evaluation & Research Engineer
About the role
Datamatics in Pasig wants someone to establish confidence in AI-enabled solutions through testing, evaluation, and applied research. The role covers LLM, RAG, agent, and chatbot workflows, including safety testing.
What you'll do
- Define test and evaluation strategies for AI and automation use cases, covering task success, correctness, groundedness, safety, consistency, latency, and cost.
- Create test sets, reference answers, rubrics, edge cases, and regression suites with business experts.
- Evaluate LLM, RAG, agent, and conversational workflows and analyze failure patterns.
- Conduct adversarial and safety testing for hallucinations, prompt injection, unsafe outputs, data leakage, and control bypasses.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Data Science, Statistics, or a related discipline, or equivalent practical experience.
- Experience in software QA, test automation, data or AI evaluation, applied research, or quality engineering. Exposure to LLM-enabled products is strongly relevant.
- Practical programming ability, preferably in Python, for test automation, evaluation pipelines, or API experiments.
- Understanding of LLM and RAG systems and quality concerns such as grounding, hallucination, and prompt injection.
About Datamatics
Datamatics is hiring in Pasig for a quality engineer who builds evaluation assets for LLM, agent, chatbot, and automation workflows.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.