GitHub Repository

Stop being locked into one LLM provider. UnifyRoute is a self-hosted gateway that routes, fails over, and manages quotas across OpenAI, Anthropic, and more with a drop-in OpenAI-compatible API.

12 starsPython

UnifyRoute – Self-hosted OpenAI-compatible LLM gateway with failover

Name: UnifyRoute – Self-hosted OpenAI-compatible LLM gateway with failover
Availability: InStock
Author: unifyroute

by unifyroute·Mar 9, 2026·1 point·1 comment

Visit Project View on HN

AI Analysis

●●SolidSolve My ProblemSlick

Drop-in OpenAI API gateway with failover—LiteLLM does this but this has a dashboard.

Strengths

•Tier-based routing with automatic fallback when providers hit rate limits or quotas
•Web dashboard for managing providers, credentials, and usage visibility
•Apache 2.0 license with comprehensive docs including Windows setup guides

Weaknesses

•LLM gateway category is crowded—LiteLLM, Helicone, and Portkey already exist
•No evidence of novel architecture beyond standard proxy-with-failover pattern

Post Description

Hey HN,

I built UnifyRoute because I kept running into the same problem: rate limits, quota exhaustion, and provider outages were breaking my LLM-powered apps at the worst times.

UnifyRoute is a self-hosted gateway that sits in front of your LLM providers (OpenAI, Anthropic, etc.) and handles routing, failover, and quota management automatically — with a fully OpenAI-compatible API, so you don't change a single line of your existing code.

What it does: - Drop-in OpenAI-compatible API (/chat/completions, /models, etc.) - Tier-based routing: define which providers to try and in what order - Automatic failover when a provider fails or hits quota - Web dashboard to manage providers, credentials, and usage - Self-hosted — your API keys never leave your infrastructure - Works with any tool that supports OpenAI's API (LangChain, LlamaIndex, etc.)

Quick start (Docker): git clone https://github.com/unifyroute/UnifyRoute.git cd UnifyRoute && cp sample.env .env ./unifyroute setup && ./unifyroute start # Dashboard at http://localhost:6565

It's open source under Apache 2.0.

Happy to answer questions about the architecture or design decisions.

https://github.com/unifyroute/UnifyRoute