Data platform engineer for regulated environments

Stefanini EMEA

📍 Portugal On-Site ⏳ 6h ago
AI assistant

Job Description

Описание:

This client is building a modular, enterprise-grade data platform powered by Databricks, designed to deliver trusted, governed data through multiple consumption channels, including analytics, APIs, streaming, and knowledge graph solutions. The platform is built on a shared canonical data model and emphasizes scalability, governance, privacy, and a Data as a Product mindset. As a Senior Data Platform Engineer, you will play a key role in designing and evolving the platform across ingestion, governance, data modeling, and data products.

Задачи:

Develop and maintain modular ingestion patterns supporting batch, API-based, and event-driven data sources (e.g., JDBC, SaaS/ERP connectors, Kafka, CDC). Establish reusable ingestion frameworks (metadata driven when possible) that enable rapid and consistent onboarding of new data sources. Build and optimize Databricks-based data pipelines (Spark, Delta Live Tables/Lakeflow) across the medallion architecture