Job Description

1. Position purpose

Provide second- and third-level support for Cleanaway's Azure batch data integration platform. This covers Azure Data Factory pipelines, Azure Databricks notebooks, self-hosted integration runtimes, pipeline Function Apps and supporting Azure services. Together these move HR, identity, procurement, finance, fuel and operational data between enterprise systems. The engineer resolves pipeline incidents, monitors scheduled processing, administers the platform and delivers enhancements, including completing remaining SSIS-to-ADF migrations through change control.

2. Key accountabilities

Incident management and service restoration

Own assigned ServiceNow incidents through resolution: pipeline and notebook failures, missing or duplicate data, authentication and API failures, and integration-runtime outages.
Diagnose failures using ADF monitoring, Databricks job runs, Spark logs and source and target data. Rerun,