Staff Software Engineer, Inference Routing
PolarGrid
Job Description
Compensation: $220k – $265k CAD • 0.3% – 0.5%
About PolarGrid
PolarGrid is an early-stage Canadian company that runs managed AI inference. Customers bring their own models, and we run them as fast, reliable production endpoints on GPU servers across many sites. We are a small team of about five engineers.
The role
You will own the routing layer: the service that decides which GPU serves each request. You will build it, run it in production and set its technical direction.
This is a hands-on staff role. Most of your time goes to designing and writing the router and the placement logic behind it. You will work closely with the engineers who run our network and our GPU sites, and you will help hire the engineers who join you.
The work
Every request has to land on a GPU that is healthy, has room and is close enough to be fast. The hard part is that capacity and health