Software Engineer in Test - Python Automation
Programmers.io
AI assistant
Job Description
Role: SDET - Python Automation
Location: Austin, TX - Onsite
Role: Fulltime
Job Description:
- Python ML side testing mainly.
- Eval pipelines (faithfulness, hallucination, task completion)
- LLM-as-a-Judge / rubric scoring
- Adversarial / safety testing (injection, jailbreak, PII)
- Trace / log / telemetry triage
- Synthetic data / persona generation
- Python
- LLM / agentic system exposure
- AI-assisted engineering (Claude Code, MCP)
- CI/CD gating
- QA automation depth