Senior Data Engineer Apache Hadoop, Apache Spark, SQL, Kafka Gdańsk

Diverse CG Sp. z o.o. Sp.k.

📍 Poland On-Site ⏳ 1d ago
AI assistant

Job Description

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Responsibilities

  • Develop and maintain data pipelines supporting regulatory reporting for the initiative
  • Design and implement distributed data processing solutions using Hadoop and Spark
  • Translate complex business requirements into efficient and executable SQL transformations
  • Build and maintain SQL‑based data transformations for regulatory data processing
  • Manage and monitor workflow orchestration using Oozie and Airflow
  • Work with event‑driven architectures, including Kafka
  • Provide L3 support for production systems, including incident analysis and