Artificial Intelligence Engineer

Management Solutions International (MSI)

📍 Doha, Qatar On-Site ⏳ 16h ago
AI assistant

Job Description

Senior AI Evaluation Engineer – LLMs & Agentic AI

Location: Qatar

Experience: 7+ Years

Education: Master's Degree or Higher in Computer Science, Software Engineering or a related Engineering discipline.

About the Role

We are looking for an experienced Senior AI Evaluation Engineer to lead the evaluation, testing, validation and continuous improvement of advanced AI and Large Language Model (LLM) systems.

This is not a conventional Machine Learning Engineer or Generative AI Developer position focused primarily on building and deploying AI applications.

The successful candidate will specialize in determining whether AI systems are actually performing correctly, reliably and consistently in real-world production environments.

You will design and implement evaluation frameworks, benchmark datasets, automated testing pipelines and statistical validation