Lead Azure DevOps Engineer
EPAM · Armenia; Georgia; Kazakhstan; Kyrgyzstan; Uzbekistan · posted 2026-09-29
About the job
Location: Armenia; Georgia; Kazakhstan; Kyrgyzstan; Uzbekistan. Work arrangement: hybrid. Level: Lead. Main skill: DevOps
We are seeking a Lead Azure DevOps Engineer to drive the deployment, integration, and operation of AI/LLM gateway technologies within enterprise environments, ensuring secure, scalable, and resilient production systems. Responsibilities Deploy and manage AI/LLM gateway technologies such as LiteLLM, Citadel, or Azure APIM AI Gateway Integrate models and providers into gateway solutions to support enterprise-scale operations Configure routing, policy enforcement, and token/rate controls across gateway infrastructure Establish observability and resilience mechanisms to maintain production stability Implement LLM routing and broker logic to optimize model performance and reliability Enforce enterprise policies, including PII detection and redaction, to ensure compliance and security Take ownership of gateway implementation projects and deliver functional solutions rapidly Collaborate with cross-functional teams to align gateway operations with organizational security standards Monitor and troubleshoot production systems to ensure continuous availability Requirements 5+ years of hands-on engineering experience with AI/LLM gateway technologies, including deployment, integration, and production operations Expertise in Azure API Management, Azure DevOps, and Azure AI Content Safety Proficiency in LiteLLM and other LLM gateway platforms Knowledge of LLM security, PII detection and redaction, and enterprise policy enforcement Understanding of LLM routing, broker logic, and token/rate control mechanisms Skills in observability, resilience engineering, and production system operations Capability to take ownership and deliver functional gateway implementations rapidly English proficiency at B2 level or higher
Joblin rewrites your resume for Lead Azure DevOps Engineer at EPAM using only your real experience, and shows how well you match.
Tailor your resumeAbout the company
1,018 open jobs on its career page, most for software engineers, devops engineers, solutions architects. See all jobs at EPAM
Joblin watches company career pages and emails you new jobs that match what you're looking for.
Try Joblin