SDET / Automation Testing with Python and Java

Programmers.io

📍 Austin, United States of America On-Site ⏳ 4h ago
AI assistant

Job Description

Position: SDET / Automation Testing with Python and Java

Location: Austin, TX

Employment Type: Full-Time


Key Requirements:

  • Strong Python automation testing experience
  • Testing AI/ML and LLM-based systems
  • Evaluation pipelines: faithfulness, hallucination detection, task completion
  • LLM-as-a-Judge and rubric-based scoring
  • Adversarial/safety testing (prompt injection, jailbreaks, PII validation)
  • Log, trace, and telemetry analysis
  • Synthetic data and persona generation
  • Exposure to LLMs, Agentic AI systems, Claude Code, MCP
  • CI/CD quality gates and QA automation expertise