Senior Data Engineer - (GCP & Lakehouse Architecture) - On Site - Octopus by RTG

robusta

📍 Riyadh, Saudi Arabia On-Site ⏳ 12h ago
AI assistant

Job Description

Key Responsibilities

  • Lakehouse Architecture & Development: Design, deploy, and maintain a scalable GCP-based Lakehouse ecosystem leveraging Apache Iceberg for transactional consistency, time-travel, and efficient storage management.
  • Pipeline Engineering: Architect, build, and optimize high-throughput ETL/ELT data pipelines using Python and Apache Airflow for orchestrating complex dependency workflows.
  • Big Data Processing: Implement large-scale distributed data processing workloads and transformation pipelines using Apache Spark.
  • Data Warehousing & Analytics: Leverage BigQuery for high-performance analytical queries, cost optimization, partition/cluster management, and serving structured data to downstream consumers.
  • Transformation & Quality: Write clean, modular, and testable transformation code using dbt (Data Build Tool), embedding automated data testing, documentation,and lineage tracking.
  • Data Modeling: