Job Description

We are looking for a Senior Data Engineer to help drive the evolution of our Azure-based Data Platform and Lakehouse architecture.

This role is focused on Data Products development. The successful candidate will build pipelines in ADF, DAGs in Airflow and work closely with POs to refine business requirements and transform business needs into reliable Data Products in Databricks.

Key Responsibilites

Hands-on Data Product development

Implement scalable, reliable and reusable data pipelines using Azure Data Factory and Apache Airflow.
Develop data transformations in Azure Databricks (PySpark / SQL) to create/extend data products following the Medallion Architecture layers:
- Bronze (raw ingestion)
- Silver (cleansed & conformed)
- Gold (business-ready data products)
Optimize performance, cost, and reliability of data workloads.
Raise important questions during business maturation