Data engineer
BetterEngineer
AI assistant
Job Description
Pipelines a US team can trust, with tools such as Airflow, dbt, or Spark.
You build pipelines a US team can schedule and trust. A pipeline feeds a report or a product feature. It fails a check when the data is wrong, instead of quietly shipping a bad number.
What you do on the team
- Build a pipeline that feeds a report or a product feature
- Make it fail a check when the data is wrong
- Schedule it so the team does not run it by hand
- Use AI tools to draft a model or a SQL check, then compare the output to the source before it is scheduled
- Match Airflow, dbt, or Spark to the stack the team already uses
- Talk through a bad number with the team before the pipeline stays on
The stack
- SQL
- The warehouse the team uses
- Airflow, dbt, or Spark, matching the stack
- Tests or freshness checksThe scheduler
- The report or feature that reads the