Data Engineer - Junior
INNOVATIQ SOLUTIONS PTE. LTD.
AI assistant
Job Description
Mandatory
- 2-4 years of data engineering or backend development experience
- Familiarity with Agile delivery
- Working knowledge of SQL and Java or Scala
- Basic experience developing batch or streaming pipelines using Apache Spark, Apache Flink or Apache Kafka
- Familiarity with containerised deployment, Kubernetes and S3-compatible object storage
- Experience implementing mappings, transformations, validation checks and scheduled workflows, and supporting pipeline monitoring and defect resolution under guidance
Preferred
- Familiarity with the SAFe framework
- Familiarity with Apache Kafka, Apache Spark, Apache Flink or comparable processing technologies, and
- MinIO or equivalent S3-compatible object storage
- Familiarity with relational databases, Git, CI/CD, Docker and automated testing
Equivalent Technologies
- Apache Spark or equivalent data-processing frameworks; Apache