Job Description

We're hiring experienced software engineers in Argentina, Brazil, Chile, Colombia and Peru for a remote contract evaluating AI coding models for frontier AI labs.

What you'll do

Set up real open-source repositories (Git, Docker) and get them running
Triage real GitHub issues and check test coverage and quality
Run and modify code to see how well AI models fix bugs
Help pick repositories and issues that are hard for AI

You need

3+ years of professional software engineering
Strong Python, JavaScript/TypeScript, Java, Go, Rust, C# or C++
Comfort with Git, Docker and running real projects locally
Good written English
Full time (40 hours a week), with 4 hours overlapping US Pacific time
To live in Argentina, Brazil, Chile, Colombia or Peru

Pay and