Senior Data Engineer (GenAI / LLM) AI, GenAI, LLM, SQL, Kafka Warsaw, Gdańsk, Gdynia
Diverse CG Sp. z o.o. Sp.k.
AI assistant
Job Description
Responsibilities
- Design and implement LLM‑and agent‑assisted workflows to improve developer productivity and reliability of data pipeline delivery
- Build and enhance AI‑driven automation for engineering processes, including: pull request automation, quality gates and assistive development tooling
- Implement AI‑supported schema review and governance gates within the canonical message lifecycle
- Drive AI‑powered test automation, including automated E2E test generation and quality validation
- Develop and maintain data packaging pipelines transforming source data into canonical message formats aligned with Data Packaging Framework and Availability Layer patterns
- Build and manage SQL‑based data transformations and configuration‑driven pipelines
- Support the canonical message lifecycle, including:schema validation, versioning, compatibility checks and publishing workflows
- Contribute to framework releases,