Senior Data Engineer
Malomatia
AI assistant
Job Description
Responsible for building, managing, and optimizing data pipelines and ensuring data flow from source to destination. This role requires expertise in data architecture, data lakehouse, data warehousing, and data integration. You will work closely with data architects, data analysts, business system owners to deliver high-quality data ingestion solutions that meet business needs.
Responsibilities
- Design, develop, and maintain scalable data pipelines for extracting, transforming, and loading (ETL) data from various sources.
- Automate data workflows to ensure data is consistently and reliably processed.
- Design and implement scalable and secure data solutions using Azure analytics services, Azure SQL Database and/or Databricks.
- Develop and maintain data storage solutions, including data warehouses, data lakes, and databases, ensuring optimal performance and cost efficiency.
- Implement and maintain data quality checks to ensure data