Job Description

BNA Principal Data Engineer. Own BNA pipeline architecture, orchestration and production readiness. Implement and review arbitration, eligibility, suppression, consent, contact-policy and cooldown logic. Own activation datasets/files, manifests, delivery status and SFTP integration. Sequence and approve PRs; enforce end-to-end, regression and production validation. Own production cutover, rerun/recovery, observability, alerting and incident technical response.

Mandatory Skills:

Advanced SQL
Python/Spark
Databricks data engineering
workflow orchestration
dependency management
idempotency
scheduled/triggered jobs
CI/CD
Git/Azure DevOps
PR review
unit/integration testing
environment promotion
production support
DQ controls
alerting
reconciliation
incident diagnosis

Nice to have:

CRM decisioning
customer