Data Engineer (Azure Databricks)

EPAM Systems Inc

📍 Kuala Lumpur, Malaysia On-Site ⏳ 2h ago
AI assistant

Job Description

We are seeking a Data Engineer (Databricks). You’ll build reliable pipelines and analytics-ready datasets on Azure for Power BI reporting and digital analytics use cases. You will take ownership from an external vendor, improve stability and data quality and partner with BI and product teams to keep data trusted and usable.

Responsibilities

  • Build and maintain ETL and ELT pipelines in Databricks using Python, PySpark and SQL
  • Ingest data from multiple sources including Google Analytics (GA4) using reliable patterns
  • Create curated, analytics-ready tables for Microsoft Power BI dashboards and self-serve analysis
  • Design reporting-ready models including star schemas, facts, dimensions, grain and keys
  • Implement data quality controls including checks for accuracy, completeness, freshness and reconciliation
  • Operate pipelines end to end including monitoring, troubleshooting, backfills and performance