Data Engineer – Pyspark | Python | Cloud | Ci/cd – Johannesburg (hybrid)
E-Merge IT Recruitment
AI assistant
Job Description
Data Engineer – Py Spark | Python | Cloud | CI/CD – Johannesburg (Hybrid)
Are you a highly skilled Data Engineer with strong production experience in Python, SQL, and Py Spark?
Join a growing technology team and help build scalable data infrastructure, robust data pipelines, and API-driven integrations. We’re looking for an engineer with strong software engineering fundamentals who can develop, deploy, and maintain reliable data solutions in production.
What You’ll Do:- Design, develop, test, and maintain scalable ETL pipelines using Python, Py Spark, and SQL.
- Build and manage API-based data ingestion workflows and real-time integrations.
- Develop and optimize production-grade data pipelines for performance, reliability, and scalability.
- Build and deploy data workloads across AWS, GCP, or Azure.
- Use Docker and Kubernetes for containerized data processing and deployment.
- Implement CI/CD workflows, automated testing, Git,