Data Engineer (Middle/Senior)
Amaris Consulting | Part of Mantu
AI assistant
Job Description
ABOUT THE JOB
- Contribute to the migration of data workflows from Google BigQuery to Databricks.
- Develop, maintain, and optimise data pipelines using Python and PySpark.
- Write and optimise advanced SQL queries to process and analyse large volumes of e-commerce data.
- Perform data extraction, transformation, processing, and validation across multiple data sources.
- Clean and structure high-volume datasets to ensure accuracy, consistency, and usability.
- Support the design and implementation of reliable data-processing workflows in Databricks.
- Develop and maintain Microsoft Power BI dashboards and reports based on processed data.
- Investigate data-quality issues, troubleshoot pipeline errors, and improve query and processing performance.
- Document data workflows, transformation logic, and