Data Engineer
User Experience Researchers Pte.Ltd
AI assistant
Job Description
Key Responsibilities:
- Design, develop and maintain data pipelines for data ingestion, integration, transformation, storage and processing across cloud and enterprise data platforms.
- Integrate data from multiple sources, including databases, APIs, files, streaming sources, IoT and OT systems.
- Develop and maintain data processing workflows to support enterprise data requirements and downstream analytics use cases.
- Implement data validation, quality checks, monitoring and error-handling mechanisms to ensure data accuracy and reliability.
- Work with SQL, Python or equivalent programming languages, ETL frameworks and data orchestration tools to develop and maintain data engineering solutions.
- Support the development and maintenance of data lakes, data warehouses and data models.
- Apply version control and relevant data engineering practices to ensure maintainable and reliable data solutions.
- Support data