Job Description

Roles and Responsibilities

Build and maintain ingestion pipelines in Python and Prefect, using the team's shared ingestion framework, for REST APIs, files, and databases.
Migrate sources from the legacy Airflow platform to the new platform, validating each one against the legacy data before switchover.
Design and build data models in Snowflake SQL, including conformed entities, dimensions, facts, and data products, following the team's modelling standards and medallion architecture.
Write tests for pipelines and models, and reconcile results against source data.
Deliver work through small, reviewable pull requests, using automated checks in GitHub Actions and peer and AI-assisted code review.
Work daily with AI coding agents: brief them, review their output, and help improve the standards and guardrails they work within.
Apply data governance in all work, including role-based access, protection of