Senior AI Engineer

About the role

We are looking for a Senior AI Engineer to design, deploy, and optimize cutting‑edge AI infrastructure that powers large‑scale Generative AI applications. You will work with vector databases, LLM frameworks, and cloud‑native technologies to deliver production‑grade systems across the organization.

Key responsibilities

• Deploy and manage Milvus vector databases, design schemas and tune indexes (HNSW, IVF‑FLAT).
• Build embedding and LLM pipelines using OpenAI API, Hugging Face, or Cohere.
• Manage Kubernetes clusters, Helm charts, and containerized microservices for scalable orchestration.
• Implement Docker multi‑stage builds, image registry management, and containerization best practices.
• Develop production‑level applications in Python and at least one of Go, Java, or C++.
• Integrate object storage solutions such as AWS S3, MinIO, or Google Cloud Storage.
• Support large‑scale Retrieval‑Augmented Generation (RAG) and multi‑agent platforms.
• Optimize GPU scheduling, inference acceleration, and hybrid search performance.
• Collaborate with cross‑functional teams to deliver high‑quality AI solutions.

Required profile

• B.Tech/B.E. in Engineering with 5+ years of relevant experience.
• Strong expertise in Milvus deployment, schema design, and index tuning.
• Hands‑on experience with Kubernetes, Helm, and Docker containerization.
• Proficiency in Python and at least one of Go, Java, or C++.
• Experience integrating AWS S3, MinIO, or Google Cloud Storage.
• Excellent verbal and written communication skills.

Required skills

• Milvus, HNSW, IVF‑FLAT, Qdrant, Pinecone, Weaviate, PGVector, Chroma
• OpenAI API, Hugging Face, Cohere
• Kubernetes, Helm, Docker (multi‑stage builds, registry)
• Python, Go, Java, C++
• AWS S3, MinIO, Google Cloud Storage
• LangChain, LlamaIndex (nice to have)
• CI/CD pipelines, Infrastructure‑as‑Code, cloud‑native deployment (GCP, Azure, AWS)

What we offer

• Innovative projects with global impact across industry leaders.
• Flexible work environment – vibrant office or remote.
• Opportunities to work abroad up to two months per year.
• Relocation options in 55+ countries.
• Leadership development, career advising, soft‑skill and well‑being programs.
• Certification support for GCP, Azure, and AWS.
• Unlimited access to EPAM’s internal learning platform.
• Medical & family care package, referral bonuses, and trust days.