Data Engineer (Azure Databricks)
EPAM Systems Inc
AI assistant
Job Description
We are seeking a Data Engineer (Databricks). You’ll build reliable pipelines and analytics-ready datasets on Azure for Power BI reporting and digital analytics use cases. You will take ownership from an external vendor, improve stability and data quality and partner with BI and product teams to keep data trusted and usable.
Responsibilities
- Build and maintain ETL and ELT pipelines in Databricks using Python, PySpark and SQL
- Ingest data from multiple sources including Google Analytics (GA4) using reliable patterns
- Create curated, analytics-ready tables for Microsoft Power BI dashboards and self-serve analysis
- Design reporting-ready models including star schemas, facts, dimensions, grain and keys
- Implement data quality controls including checks for accuracy, completeness, freshness and reconciliation
- Operate pipelines end to end including monitoring, troubleshooting, backfills and performance