Data Engineer (Databricks)

Luza Tec

📍 Portugal On-Site ⏳ 7h ago
AI assistant

Job Description

We are looking for a Data Engineer with solid Databricks experience to design, build and operate data pipelines on a Lakehouse architecture. You will join a data team and work closely with analysts, data scientists and business teams.

The focus is the Databricks platform: ingesting, transforming and serving reliable, governed and well-performing data. Experience with Azure and Microsoft Fabric is a secondary requirement, relevant for integration with the wider data ecosystem.

Responsibilities

  • Design and implement batch and streaming data pipelines on Databricks, using PySpark and Spark SQL.

  • Build and maintain a layered Lakehouse architecture (medallion: bronze, silver, gold) on Delta Lake.

  • Develop declarative pipelines and orchestrate workloads with Lakeflow (Delta Live Tables, Jobs/Workflows).

  • Implement data governance with Unity Catalog: catalogs, permissions, lineage and auditing.

  • Model data