Staff Software Engineer, Inference Routing

PolarGrid

📍 Ottawa, Canada On-Site ⏳ 4h ago
AI assistant

Job Description

Compensation: $220k – $265k CAD • 0.3% – 0.5%

About PolarGrid

PolarGrid is an early-stage Canadian company that runs managed AI inference. Customers bring their own models, and we run them as fast, reliable production endpoints on GPU servers across many sites. We are a small team of about five engineers.

The role

You will own the routing layer: the service that decides which GPU serves each request. You will build it, run it in production and set its technical direction.

This is a hands-on staff role. Most of your time goes to designing and writing the router and the placement logic behind it. You will work closely with the engineers who run our network and our GPU sites, and you will help hire the engineers who join you.

The work

Every request has to land on a GPU that is healthy, has room and is close enough to be fast. The hard part is that capacity and health