Data Engineering Lead: PySpark & Big Data Pipelines
Focal Consulting
AI assistant
Job Description
Focal Consulting in Kuala Lumpur is seeking a Lead Data Engineer to architect scalable PySpark pipelines and guide a team of data engineers. You will design and optimize large-scale batch and streaming workflows, emphasizing reliability and performance.
You will also shape data lake architectures (raw/staged/curated) and collaborate with analysts and ML engineers to deliver production-grade analytics datasets in a fast-paced environment.