Data Software Engineer, Azure Databricks

About the role

We are looking for a Data Software Engineer to build scalable solutions that enable data engineers to build, test, deploy and monitor data pipelines. The role focuses on developing reusable libraries and SDK modules for Databricks, Delta Lake, Azure Data Lake and SAP HANA Data Lake, with the flexibility to work remotely from anywhere in Kazakhstan.

Key responsibilities

• Develop and maintain reusable Python SDK modules for pipeline operations such as compaction, quality checking, schema evolution and table lifecycle management.
• Design framework libraries following software‑engineering best practices to ensure scalability and reliability across 100+ pipelines and multiple data domains.
• Collaborate with data‑engineer consumers to gather feedback, address pain points and iterate on the SDK.
• Contribute to platform architecture discussions, performance‑tuning strategies and data‑quality governance across Lakehouse environments.
• Write high‑quality documentation and enablement materials for framework users.

Required profile

• 3+ years of experience as a Data Engineer with strong expertise in Databricks and Delta Lake.
• Hands‑on experience building reusable libraries, SDKs or internal developer tooling.
• Deep understanding of Data Mesh/Data Product concepts and self‑serve data platforms.
• Proven ability to design, maintain and optimise complex data pipelines on cloud object stores (e.g., ADLS).
• Experience with CI/CD, workflow orchestration (Databricks Jobs) and agile team environments.

Required skills

• Python programming for data‑engineering workloads.
• Databricks platform.
• Delta Lake and Delta tables.
• Azure Data Lake (ADLS) and SAP HANA Data Lake.
• CI/CD pipelines and Databricks Jobs orchestration.

What we offer

• Remote work flexibility with access to offices in Astana, Almaty or Karaganda.
• Opportunities to work abroad for up to two months per year.
• Leadership development, career advising, certifications (GCP, Azure, AWS) and unlimited learning resources.
• Employee Stock Purchase Plan, monetary referral bonuses, medical & family care package, and six trust days per year.
• Housing support program with preferential mortgage access.