Data Engineer - PySpark

Clover Infotech

📍 Dubai, Chennai, United Arab Emirates On-Site ⏳ 11h ago
AI assistant

Job Description

Job Requirements:

- 5+ years of experience in Data Engineering.

- Strong hands-on expertise in PySpark, SQL, and MS SQL Server.

- Experience with Shell Scripting and experience with Informatica BDM or similar ETL/Data Integration tools.

- Hands-on experience with GitHub, DevOps/CI-CD, and version control practices.

- Experience with Apache Oozie.

Key Responsibilities:

- Build and optimize data models, data warehouses, and data lakes.

- Develop data processing workflows using PySpark and SQL.

- Data migration, ensure data quality, governance, security, and performance optimization.

- Collaborate with business and technology teams to deliver data-driven solutions.