Data Engineer (Databricks)
Luza Tec
Job Description
We are looking for a Data Engineer with solid Databricks experience to design, build and operate data pipelines on a Lakehouse architecture. You will join a data team and work closely with analysts, data scientists and business teams.
The focus is the Databricks platform: ingesting, transforming and serving reliable, governed and well-performing data. Experience with Azure and Microsoft Fabric is a secondary requirement, relevant for integration with the wider data ecosystem.
Responsibilities
Design and implement batch and streaming data pipelines on Databricks, using PySpark and Spark SQL.
Build and maintain a layered Lakehouse architecture (medallion: bronze, silver, gold) on Delta Lake.
Develop declarative pipelines and orchestrate workloads with Lakeflow (Delta Live Tables, Jobs/Workflows).
Implement data governance with Unity Catalog: catalogs, permissions, lineage and auditing.
Model data