Senior Data Software Engineer
EPAM Systems
AI assistant
Job Description
We're looking for a practical and skilled Senior Data Software Engineer who possesses strong expertise in Apache Spark and large-scale distributed computing systems. The individual in this position will oversee the complete data infrastructure lifecycle, handling everything from building ingestion solutions to guaranteeing data pipelines remain reliable and scalable over time.
The ideal candidate will work well in team settings, partnering across different departments to convert complicated business needs into effective technical outcomes, all while upholding strict engineering and performance benchmarks.
Responsibilities
- Build and architect dependable data ingestion solutions and pipelines leveraging Cloud Native and Big Data technologies
- Oversee the entire technical stack, covering configuration management, system monitoring, troubleshooting, and performance optimization
- Create and sustain scalable pipelines that enable