Data Engineer – Pyspark | Python | Cloud | Ci/cd – Johannesburg (hybrid)

E-Merge IT Recruitment

📍 Johannesburg, South Africa Hybrid ⏳ 3d ago
AI assistant

Job Description

Data Engineer – Py Spark | Python | Cloud | CI/CD – Johannesburg (Hybrid)

Are you a highly skilled Data Engineer with strong production experience in Python, SQL, and Py Spark?

Join a growing technology team and help build scalable data infrastructure, robust data pipelines, and API-driven integrations. We’re looking for an engineer with strong software engineering fundamentals who can develop, deploy, and maintain reliable data solutions in production.

What You’ll Do:
  • Design, develop, test, and maintain scalable ETL pipelines using Python, Py Spark, and SQL.
  • Build and manage API-based data ingestion workflows and real-time integrations.
  • Develop and optimize production-grade data pipelines for performance, reliability, and scalability.
  • Build and deploy data workloads across AWS, GCP, or Azure.
  • Use Docker and Kubernetes for containerized data processing and deployment.
  • Implement CI/CD workflows, automated testing, Git,