Data Engineer
NETCONOMY
AI assistant
Job Description
Deine Rolle im Team
As a Data Engineer , you'll play a key role in building modern, scalable, and high-performance data solutions on Google Cloud Platform (GCP) . You'll be part of our growing Data & AI team, designing and implementing data architectures that help clients unlock the full potential of their data.
Your job's key responsibilities are:
- Building efficient and scalable ETL/ELT processes to ingest, transform, and load data from various structured and unstructured sources (databases, APIs, streaming platforms) into BigQuery and Cloud Storage
- Implementing data ingestion and real-time processing using Dataflow (Apache Beam) and Pub/Sub for batch and streaming workflows
- Developing SQL transformation workflows with Dataform , including version control, testing, and automated scheduling with built-in quality assertions
- Creating efficient, cost-optimized BigQuery queries with proper partitioning, clustering, and