Data Engineer – AWS Data Platform
DICETEK LLC
AI assistant
Job Description
Job Location Abu Dhabi (Work From Office)
Job Type Contract
Job Description
Years of Experience *Required Skills *- Strong hands-on experience delivering enterprise-scale data engineering solutions on AWS.
- Strong development experience with:
- Python / PySpark
- SQL
- AWS Glue
- AWS S3
- Strong experience designing and developing ETL/ELT and data ingestion pipelines.
- Experience working with:
- AWS Glue and Glue Catalog
- Amazon Redshift
- Amazon Athena
- AWS Lake Formation
- Apache Iceberg or similar open table formats
- Good understanding of:
- Data lake / lakehouse architecture
- Data warehousing
- Dimensional and analytical data modelling
- Data partitioning and optimisation
- Metadata management and data lineage
- Strong understanding of data quality, reconciliation and validation techniques.
- Experience integrating data