Senior Data Software Engineer – Apache Airflow & Databricks

About the role

EPAM is seeking a Senior Data Software Engineer to design, build, and maintain scalable data pipelines using Apache Airflow and Databricks. You will support machine‑learning workflows, migrate legacy pipelines to modern cloud platforms, and collaborate with a global data engineering team.

Key responsibilities

• Develop new data pipelines and maintain existing ones.
• Migrate legacy pipelines from BDP to Databricks.
• Maintain ML ETL pipelines and adapt ML code as needed.
• Monitor daily pipelines, troubleshoot issues, and ensure reliability.
• Support ML model development, training, and deployment.
• Perform data integration and transformation through ETL processes.
• Contribute to database design, optimization, and data‑quality assurance.
• Document processes and workflows clearly.
• Collaborate using BitBucket, Jira, Confluence, and Teams.

Required profile

• 3+ years of data‑engineering experience.
• Advanced proficiency in Python, Spark, and PySpark.
• Hands‑on experience with Databricks and AWS.
• Background in ML model development, training, and deployment.
• Strong English communication and documentation skills.
• Result‑oriented, proactive problem‑solver.

Required skills

• Python
• Apache Spark
• PySpark
• Databricks
• AWS
• Apache Airflow
• MLflow (nice to have)
• AWS SageMaker (nice to have)
• Pandas (nice to have)

What we offer

• Remote work from anywhere in Kyrgyzstan or from our Bishkek office.
• Opportunities to work abroad up to two months per year.
• Relocation options across 55+ countries.
• Corporate and social events, leadership development, and well‑being programs.
• Certifications (GCP, Azure, AWS) and unlimited access to internal learning resources.
• Free English classes with certified teachers.
• Monetary referral bonuses, medical & family care package, six trust days per year, and fitness discounts.