Senior Data Software Engineer with AWS and Terraform

About the role

We are looking for a Senior Data Software Engineer to join a client‑facing delivery team that is modernising a cloud‑native data platform on AWS. The role focuses on building, optimising and hardening large‑scale ETL/ELT pipelines with PySpark on AWS Glue and delivering high‑quality, validated data into Snowflake for downstream analytics.

Key responsibilities

• Design, build and optimise batch and incremental pipelines using PySpark on AWS Glue.
• Configure Glue jobs, crawlers, workflows, Data Catalog and DQDL rules.
• Model and load curated datasets into Snowflake with staging, transformation and publishing layers.
• Implement automated data‑quality frameworks, schema enforcement and reconciliation processes.
• Integrate pipelines with AWS services such as S3, IAM, Lambda, Athena, CloudWatch, Step Functions and Secrets Manager.
• Instrument observability through logging, metrics, alerting and SLA monitoring.
• Participate in code reviews, CI/CD automation and documentation.
• Engage directly with client stakeholders for requirements, design walkthroughs and status reporting.

Required profile

• Minimum 3 years of production‑level Python development experience.
• Strong expertise in PySpark and the DataFrame API.
• Advanced knowledge of Snowflake data‑warehousing concepts.
• Hands‑on experience with AWS Glue, including job configuration and Data Catalog.
• Background in data‑quality engineering, validation frameworks and reconciliation.
• Proficiency with core AWS services (S3, IAM, Lambda, Athena, CloudWatch).
• English proficiency at B2 level or higher.

Required skills

• Python
• PySpark
• AWS Glue
• Snowflake
• AWS S3
• AWS IAM
• AWS Lambda
• AWS Athena
• AWS CloudWatch
• AWS Step Functions
• AWS Secrets Manager
• Terraform (nice to have)
• CloudFormation (nice to have)
• Great Expectations or similar data‑quality frameworks (nice to have)
• Airflow (nice to have)
• Generative AI / LLM concepts (nice to have)

What we offer

• Opportunity to work on innovative data‑platform projects for global clients.
• Flexible working environment – office or home.
• Possibility to work abroad up to two months per year.
• Relocation options across 55+ countries.
• Corporate and social events.
• Leadership development, career advising and continuous learning support.