Principal AI Solution Engineer

EPAM Systems

📍 Kazakhstan, Kyrgyzstan, Armenia On-Site ⏳ 1w ago
AI assistant

Job Description

We are seeking a Principal AI Solution Engineer to join an engineering organization building a sovereign, multi-tenant agentic AI platform, along with the applied products on top of it. Everything ships under strict data residency constraints and operates in both Arabic and English. Squads are small — three senior engineers — and decisions are made in the room. You will work across three layers and need to be credible in all of them: applied AI, AI infrastructure, and the backend platform.

Responsibilities

  • Set architecture for systems that span squads; write the decision down and defend it
  • Build and tune GPU-based serving — vLLM, TGI or TensorRT-LLM — for latency, throughput and a cost per token you can justify
  • Own the reference RAG and agent architecture other teams build against
  • Define service boundaries, API contracts, event-driven infrastructure and the SLO work that prevents incidents rather than answering