Data Engineer with Databricks
ITConnect
AI assistant
Job Description
Join the Risk Technology team to design, develop, and support enterprise data solutions using Databricks, delivering scalable, high-quality data platforms and analytics capabilities.
- Design and build data pipelines using Databricks, PySpark, and SQL.
- Develop and maintain data models, ETL processes, and reporting datasets.
- Optimise data quality, performance, and scalability across the platform.
- Collaborate with business users, analysts, and developers to deliver data-driven solutions.
- Support cloud-based data architecture, CI/CD, and data governance initiatives.
- Mentor junior engineers and promote engineering best practices.
- Strong experience with Databricks and PySpark.
- Advanced SQL and data warehousing expertise.
- Experience with Azure Data Lake, Azure Data Factory, or similar cloud data technologies.
- Knowledge of data modelling, ETL/ELT, and performance optimisation.
- Experience working in