Senior Data Engineer
Y-Axis
AI assistant
Job Description
The role of Senior Data Engineer involves extensive experience in data engineering, particularly in data migration, testing, validation, and reconciliation. The ideal candidate will possess a strong foundation in data engineering concepts and skills required for effective operation in relevant environments.
Main Responsibilities
Key responsibilities include:
- Define and document the requirements for the current pricing data mart as part of the application transformation.
- Ensure data is successfully fed back into the pricing data marts during and after the migration.
- Ingest data files into the Pricing Datamart.
- Validate incoming data upon delivery for completeness, accuracy, and conformance.
- Identify, investigate, and resolve data quality issues.
- Clean and transform raw source data to meet Pricing Datamart standards.
- Write, maintain, and optimize SQL and Python scripts to support