Artificial Intelligence Engineer
Management Solutions International (MSI)
Job Description
Senior AI Evaluation Engineer – LLMs & Agentic AI
Location: Qatar
Experience: 7+ Years
Education: Master's Degree or Higher in Computer Science, Software Engineering or a related Engineering discipline.
About the Role
We are looking for an experienced Senior AI Evaluation Engineer to lead the evaluation, testing, validation and continuous improvement of advanced AI and Large Language Model (LLM) systems.
This is not a conventional Machine Learning Engineer or Generative AI Developer position focused primarily on building and deploying AI applications.
The successful candidate will specialize in determining whether AI systems are actually performing correctly, reliably and consistently in real-world production environments.
You will design and implement evaluation frameworks, benchmark datasets, automated testing pipelines and statistical validation