Senior Data Software Engineer – Apache Airflow & Databricks

About the role

EPAM is seeking a Senior Data Software Engineer to design, build, and maintain scalable data pipelines on modern cloud platforms. You will work with Apache Airflow, Databricks, and AWS to support machine‑learning workflows and help migrate legacy pipelines to a cloud‑native environment.

Key responsibilities

• Develop new data pipelines and maintain existing ones.
• Migrate legacy pipelines from BDP to Databricks.
• Maintain ML ETL pipelines and adapt ML code as needed.
• Monitor daily pipeline performance and resolve incidents.
• Support ML model development, training, and deployment.
• Perform data integration and transformation using ETL processes.
• Contribute to database design, optimization, and data‑quality assurance.
• Document processes and workflows clearly.
• Collaborate with the team using BitBucket, Jira, Confluence, and Teams.

Required profile

• 3+ years of data‑engineering experience.
• Advanced proficiency in Python, Spark, and PySpark.
• Hands‑on experience with Databricks and AWS.
• Background in machine‑learning model development, training, and deployment.
• Strong English communication and documentation skills.
• Result‑oriented, proactive problem‑solver.

Required skills

• Python
• Apache Spark / PySpark
• Databricks
• AWS (including S3, EC2, etc.)
• Apache Airflow
• MLflow or AWS SageMaker (nice to have)
• Pandas (nice to have)
• BitBucket, Jira, Confluence

What we offer

• Remote work from anywhere in Kyrgyzstan (or our Bishkek office).
• Opportunities to work abroad up to two months per year.
• Relocation options across 55+ countries.
• Corporate and social events, leadership development, and certification programs.
• Medical & family care package, referral bonuses, and six trust days per year.
• Access to EPAM’s internal learning platform, free English classes, and fitness discounts.