Senior Data Engineer
Datum Labs
AI assistant
Job Description
Datum Labs is seeking a Senior Data Engineer to design and manage large-scale data systems. You will architect robust pipelines, enable real-time and batch processing, and support analytics and AI workflows to empower decision-making.
You will work with cross-functional teams, implement scalable data platforms on cloud services, and lead data governance and quality initiatives while mentoring junior engineers.
Architect and maintain high-performance ETL/ELT pipelines using Kafka, Spark, Airflow, or similar tools. Design scalable, secure data platforms on AWS or GCP. Implement real-time data ingestion using Kafka and process massive datasets efficiently. Manage SQL/NoSQL databases for analytics and operational use cases. Develop and maintain optimized data models to support BI, AI, and ML applications. Partner with analysts, engineers, and stakeholders to define data requirements. Enforce rigorous data governance, lineage tracking, and quality checks. Lead and guide