Data engineer

BetterEngineer

📍 Ciudad de México, Mexico On-Site ⏳ 19h ago
AI assistant

Job Description

Pipelines a US team can trust, with tools such as Airflow, dbt, or Spark.

You build pipelines a US team can schedule and trust. A pipeline feeds a report or a product feature. It fails a check when the data is wrong, instead of quietly shipping a bad number.

What you do on the team

  • Build a pipeline that feeds a report or a product feature
  • Make it fail a check when the data is wrong
  • Schedule it so the team does not run it by hand
  • Use AI tools to draft a model or a SQL check, then compare the output to the source before it is scheduled
  • Match Airflow, dbt, or Spark to the stack the team already uses
  • Talk through a bad number with the team before the pipeline stays on

The stack

  • SQL
  • The warehouse the team uses
  • Airflow, dbt, or Spark, matching the stack
  • Tests or freshness checksThe scheduler
  • The report or feature that reads the