Senior Databricks Specialist / Data Architect
malomatia
AI assistant
Job Description
Hands-on senior Databricks specialist with proven experience in production enterprise environments. We are specifically looking for someone who can independently design, develop, troubleshoot, optimize, and govern Databricks solutions, rather than someone whose experience is limited to basic Databricks development.
- Design and implement enterprise-scale data solutions using Azure Databricks.
- Define and maintain Databricks data architecture and platform standards.
- Design data ingestion and integration pipelines from multiple source systems.
- Develop scalable ETL/ELT pipelines using Databricks and Apache Spark.
- Design and implement Medallion Architecture (Bronze, Silver, Gold) where appropriate.
- Work with Delta Lake and optimize Delta tables and data pipelines.
- Design data models and transformation processes for analytical and operational reporting.
- Integrate Databricks with Microsoft Dynamics 365 / Dataverse and other