Azure data engineer

Spait Infotech

📍 Victoria, Australia, Australia On-Site ⏳ 5h ago
AI assistant

Job Description

  • Work with Azure Databricks for data processing and transformation.
  • Write and optimize SQL queries.
  • Work with Azure Data Lake Storage for storing and managing data.
  • Build ETL/ELT workflows for data integration.
  • Perform data cleaning, transformation, and validation.
  • Monitor and troubleshoot data pipelines.
  • Work with business analysts and development teams.
  • Ensure data quality, security, and reliability.

Required Technical Skills

  • Good knowledge of Microsoft Azure.
  • Hands-on experience with Azure Data Factory (ADF).
  • Knowledge of Azure Databricks and PySpark.
  • Strong SQL and database knowledge.
  • Experience with Python programming.
  • Understanding of ETL and ELT concepts.
  • Knowledge of Azure Data Lake Storage (ADLS).
  • Basic understanding of data warehousing concepts.
  • Knowledge of Git and CI/CD is an added advantage.
  • Good analytical and