Data Engineer
Techcarrot
AI assistant
Job Description
- Assessing complex new data sources with a variety of SAP and non-SAP source system and quickly turning these into business insights ready data sets. Develop and support the implementation and integration of these new data sources into our Azure Data platform.
- Perform detailed analysis of structured, semi-structured and unstructured data sources for quality, completeness and business value.
- Required to design, document, develop, implement and test rapid prototypes that demonstrate the value of the data and present them to diverse audiences.
- Required to participate in early state design and feature definition activities.
- Responsible for designing, developing, and implementing robust and scalable data pipelines using the Microsoft Azure data platform and the Azure Databricks ecosystem.
- Responsible for creating reusable and scalable data pipelines
- Act as a team-player while collaborating with team members across multiple engineering