Databricks Data Engineer
IT CONNECT Sp. z o.o. Sp. k.
AI assistant
Job Description
Nasze wymagania:
- Experience in data engineering, with hands-on Databricks expertise.
- Strong experience in Python for automation and data transformation.
- Experience working with at least one major cloud platform (AWS, Azure, or GCP).
- Strong communication skills and strong English language skills.
- Solid understanding of SQL with experience in query optimization and data modeling.
- Familiarity with DevOps methodologies, CI/CD pipelines, and Infrastructure as Code (Terraform, Bicep).
- Experience with real-time data streaming technologies such as Kafka or Spark Streaming.
- Knowledge of cloud storage solutions like Data Lake, Snowflake, or Synapse.
- Hands-on experience with PySpark for distributed data processing.
- Relevant certifications such as Databricks Certified Data Engineer Associate or cloud-based data certifications.
O projekcie:
Projekt obejmuje projektowanie i wdrażanie