Data Engineer (Kafka)

Veerteq Solutions Inc.

📍 México, Mexico On-Site ⏳ 3h ago
AI assistant

Job Description

Role: Data Engineer (Kafka) Location: Mexico(Remote) Experience: 8+ years Job Description We are seeking a Lead Kafka Integration Engineer to design, develop, and support enterprise-scale data integration solutions leveraging Kafka, Databricks, and SQL Server-based MDM platforms.
The role will be responsible for architecting scalable and resilient real-time data ingestion pipelines, implementing Kafka consumer services, and delivering data through Databricks Bronze, Silver, and Gold layers.

Design and implement end-to-end data ingestion and processing solutions from Kafka into Databricks Medallion Architecture (Bronze/Silver/Gold) and SQL Server-based MDM platforms, ensuring scalability, resiliency, and high-performance data delivery.

Architect, develop, and support enterprise-grade Kafka consumer services including consumer groups, offset management, schema validation, retry mechanisms, dead-letter queues (DLQ), monitoring, ing, security, and automated recovery