Senior Data Engineer

Xforia Global Talent & Technology Solutions

📍 Halifax, Canada On-Site ⏳ 12h ago
AI assistant

Job Description

  • Strong experience in Python Scripting and PySpark for data processing
  • Proficiency in SQL, dealing with big data processing
  • Experience in AWS cloud platform and its data services (S3, Redshift, Lambda, EMR, Airflow, Glue)
  • Expertise in BASH/Shell scripting
  • Strong understanding of healthcare insurance domain and experience leading data engineering teams
  • Experience in Agile environments.
  • Excellent problem-solving skills and attention to detail.
  • Effective communication and collaboration skills.

Responsibilities:

  • Leads development of data pipelines and architectures that handle large-scale data sets.
  • Designs, constructs, and tests data architecture aligned with business requirements.
  • Provides technical leadership for data projects, ensuring best practices and high-qualitydata solutions.
  • Collaborates with product, finance, and other business units to ensure data pipelines meet