SDET / Automation Testing with Python and Java
Programmers.io
AI assistant
Job Description
Position: SDET / Automation Testing with Python and Java
Location: Austin, TX
Employment Type: Full-Time
Key Requirements:
- Strong Python automation testing experience
- Testing AI/ML and LLM-based systems
- Evaluation pipelines: faithfulness, hallucination detection, task completion
- LLM-as-a-Judge and rubric-based scoring
- Adversarial/safety testing (prompt injection, jailbreaks, PII validation)
- Log, trace, and telemetry analysis
- Synthetic data and persona generation
- Exposure to LLMs, Agentic AI systems, Claude Code, MCP
- CI/CD quality gates and QA automation expertise