Senior Python & PySpark Data Engineer

N Consulting Global

📍 Cracow, Małopolskie, Poland On-Site ⏳ 2h ago
AI assistant

Job Description

We are looking for an experienced Senior Python & PySpark Data Engineer to join our team and work on data engineering, ETL development and large-scale data processing initiatives.

The ideal candidate will have strong hands-on experience in Python, PySpark, Databricks and Apache Spark, along with a solid understanding of enterprise data platforms and ETL processes.

Key Skills & Experience Required:

  • 10+ years of overall IT experience.
  • Strong hands-on development experience with Python and PySpark.
  • Extensive experience with Databricks and Apache Spark.
  • Good experience in designing and developing ETL processes and data pipelines.
  • Strong knowledge of Oracle databases and SQL.
  • Experience with Unix/Linux environments and Shell scripting.
  • Hands-on experience with AutoSys scheduling.
  • Previous development experience with Java or C#.
  • Strong analytical,