Data Engineer

Techcarrot

📍 Dubai, United Arab Emirates On-Site ⏳ 15h ago
AI assistant

Job Description

  • Assessing complex new data sources with a variety of SAP and non-SAP source system and quickly turning these into business insights ready data sets. Develop and support the implementation and integration of these new data sources into our Azure Data platform.
  • Perform detailed analysis of structured, semi-structured and unstructured data sources for quality, completeness and business value.
  • Required to design, document, develop, implement and test rapid prototypes that demonstrate the value of the data and present them to diverse audiences.
  • Required to participate in early state design and feature definition activities.
  • Responsible for designing, developing, and implementing robust and scalable data pipelines using the Microsoft Azure data platform and the Azure Databricks ecosystem.
  • Responsible for creating reusable and scalable data pipelines
  • Act as a team-player while collaborating with team members across multiple engineering