Microsoft Fabric & PySpark Data Engineer
The HR Ally
AI assistant
Job Description
Microsoft Fabric & PySpark Data Engineer
Location: Melbourne
Employment Type: Contract
About the Role
We are seeking an experienced Data Engineer with strong hands‑on expertise in Microsoft Fabric, PySpark and Data Lake solutions. The ideal candidate should have deep technical knowledge and practical experience in designing, developing and implementing scalable data engineering solutions.
Key Responsibilities
- Design, develop and maintain data pipelines using Microsoft Fabric.
- Build and optimise ETL/ELT workflows and data integration solutions.
- Develop PySpark scripts for large-scale data processing and transformation.
- Work with Data Lake, Lakehouse architecture and related data engineering components.
- Perform data transformation, cleansing, validation and optimisation.
- Troubleshoot performance issues and ensure data quality and reliability.
- Leverage AI-assisted