Software Engineer in Test - Python Automation

Programmers.io

📍 Austin, United States of America On-Site ⏳ 1d ago
AI assistant

Job Description

Role: SDET - Python Automation

Location: Austin, TX - Onsite

Role: Fulltime


Job Description:

  • Python ML side testing mainly.
  • Eval pipelines (faithfulness, hallucination, task completion)
  • LLM-as-a-Judge / rubric scoring
  • Adversarial / safety testing (injection, jailbreak, PII)
  • Trace / log / telemetry triage
  • Synthetic data / persona generation
  • Python
  • LLM / agentic system exposure
  • AI-assisted engineering (Claude Code, MCP)
  • CI/CD gating
  • QA automation depth