Senior Data Engineer
EPAM Systems
AI assistant
Job Description
We are looking for a hands-on Senior Data Engineer to build and support scalable data pipelines and cloud-based data solutions. The ideal candidate will have strong experience in Python, PySpark, AWS, Airflow, and DevOps, with a focus on production-quality engineering and automationResponsibilitiesDesign, build, and maintain scalable data pipelines deployed on AWSDevelop robust data processing solutions using Python, Pandas, and PySparkBuild and manage workflows through AWS Managed Workflows for Apache Airflow (MWAA)Develop and optimize data queries using AWS Athena to support efficient data analysisAutomate infrastructure provisioning and deployment processes using Terraform and GitHub ActionsImplement testing, monitoring, troubleshooting, and data-quality controls to ensure pipeline reliabilityParticipate in code reviews and help drive strong engineering best practices across the teamCollaborate with engineering, product, and business teams within an Agile environmentRequirementsA