Member of Technical Staff (Site Reliability Engineer, Crawler)

Perplexity AI

📍 Belgrade, London, United Kingdom of Great Britain and Northern Ireland On-Site ⏳ 1d ago
AI assistant

Job Description

  • Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity’s Crawler team, you’ll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes
  • Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets
  • Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback
  • Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation
  • Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners
  • Participate in the team’s on-call rotation, lead incident response, and turn blameless postmortems into