Senior Python Engineer with Spark
EPAM Systems
AI assistant
Job Description
We are looking for a talented Senior Python Engineer with Spark to join our team working on financial data and analytics. You'll be a crucial player in a team accountable for data integration and transformation, developing models and managing a vast array of structured financial data.
You'll design and build robust software that efficiently processes data through our medallion architecture. We make use of cutting-edge technology with Databricks on Microsoft Azure.
Responsibilities
- Design and build software for processing data through medallion architecture on Databricks in Microsoft Azure
- Apply software engineering processes and principles to data engineering
- Work across the whole software development lifecycle
- Provide mentorship to junior engineers
Requirements
- At least 3 years of experience in Python software development
- Solid understanding of Apache Spark and its