Software Engineer
Cheaper Inference
Job Description
What should happen when an AI provider hits a rate limit? How do you switch providers without breaking the developer’s workflow? These are the kinds of problems you’ll work on at Cheaper Inference.
We’re hiring a hands-on software engineer to help lead development of OmniRoute, our open-source AI gateway. OmniRoute gives developers one API endpoint for multiple AI providers and lets them route requests based on cost, availability, and performance. You’ll write code, help shape technical decisions, and own improvements from design through release.
OmniRoute website: https://www.omniroute.online/
GitHub: https://github.com/cheaper-inference/OmniRoute
What you’ll do
• Build and maintain AI provider integrations and improve request routing, automatic fallback, and streaming reliability.
• Lead features from design through release, weighing technical trade-offs and following