Databricks Data Engineer
Recruit I.T.
AI assistant
Job Description
Recruit I.T. in Auckland seeks a Databricks specialist to lead the delivery and shape the technical direction, with hands-on build and migration experience. The role starts immediately on a 3-month contract with strong potential to extend.
You will work with cross-functional teams to plan migrations, build scalable data pipelines and enforce CI/CD and quality standards while aligning with cloud data platforms such as Lakehouse, Spark and Delta Lake.
Plan and deliver data migrations onto the new platform. Build and optimise scalable data pipelines. Set technical direction and apply sound engineering, CI/CD and code quality standards. Manage relationships and identify, track and mitigate project risks. Experience delivering data migrations onto large cloud platforms. Strong Databricks expertise, including Lakehouse, Spark and Delta Lake. Proficiency in SQL, Python and PySpark for big data processing. Experience with Azure Data Factory, ADLS, Azure DevOps and Power