Lead Azure DevOps Engineer

EPAM Systems

📍 Armenia On-Site ⏳ 18h ago
AI assistant

Job Description

We are seeking a Lead Azure DevOps Engineer to drive the deployment, integration, and operation of AI/LLM gateway technologies within enterprise environments, ensuring secure, scalable, and resilient production systems.

Responsibilities

  • Deploy and manage AI/LLM gateway technologies such as LiteLLM, Citadel, or Azure APIM AI Gateway
  • Integrate models and providers into gateway solutions to support enterprise-scale operations
  • Configure routing, policy enforcement, and token/rate controls across gateway infrastructure
  • Establish observability and resilience mechanisms to maintain production stability
  • Implement LLM routing and broker logic to optimize model performance and reliability
  • Enforce enterprise policies, including PII detection and redaction, to ensure compliance and security
  • Take ownership of gateway implementation projects and deliver functional solutions rapidly
  • Collaborate with