Senior Data Software Engineer with Azure Databricks
EPAM Systems
AI assistant
Job Description
We are seeking a Senior Data Software Engineer with Azure Databricks expertise to grow the data ingestion and curation capabilities of the client's Enterprise Data Lake (EDL) on Microsoft Azure and Databricks. The team will bring new data sources onto the lakehouse and curate them through the Medallion layers (Bronze → Silver → Gold), so the business has trusted data for reporting and analytics. The first project is API ingestion from Genesys Cloud (contact centre platform), starting with daily loads and moving to near real-time and streaming in later phases, with more sources to follow. This role will lead a team of data engineers and deliver designs set by the Solution Architect.
Responsibilities
- Lead the engineering team: break designs (HDD/TDD) into tasks, distribute work, track delivery and remove blockers
- Turn designs into working pipelines and find the right technical solutions where a design leaves gaps
- Evolve reusable