Microsoft Fabric & PySpark Data Engineer

The HR Ally

📍 Melbourne, Australia On-Site ⏳ 4h ago
AI assistant

Job Description

Microsoft Fabric & PySpark Data Engineer

Location: Melbourne
Employment Type: Contract

About the Role

We are seeking an experienced Data Engineer with strong hands‑on expertise in Microsoft Fabric, PySpark and Data Lake solutions. The ideal candidate should have deep technical knowledge and practical experience in designing, developing and implementing scalable data engineering solutions.

Key Responsibilities

  • Design, develop and maintain data pipelines using Microsoft Fabric.
  • Build and optimise ETL/ELT workflows and data integration solutions.
  • Develop PySpark scripts for large-scale data processing and transformation.
  • Work with Data Lake, Lakehouse architecture and related data engineering components.
  • Perform data transformation, cleansing, validation and optimisation.
  • Troubleshoot performance issues and ensure data quality and reliability.
  • Leverage AI-assisted