Infrastructure●●Solid
UnifyRoute – Self-hosted OpenAI-compatible LLM gateway with failover
Drop-in OpenAI API gateway with failover—LiteLLM does this but this has a dashboard.
Solve My ProblemSlick
unifyroute
113mo ago
Back to browse
GitHub Repository
1 starsGo
Wyolet Relay – high throughput, open source LLM router
by aaliboyev·Jun 19, 2026·3 points·0 comments
AI Analysis
●●SolidShip ItSolve My Problem
Self-hosted LLM gateway pooling keys across providers for failover and cost tracking.
Strengths
- •OpenAI and Anthropic compatibility means zero code changes for existing applications.
- •Disposable relay keys cap leak damage without exposing real provider credentials.
- •Standalone Docker image spins up API, UI, and database instantly.
Weaknesses
- •Crowded category with LiteLLM, Helicone, and Portkey already solving this.
- •No clear differentiation beyond being self-hosted and open-source.
Category
Target Audience
Backend developers managing multiple LLM providers
Similar To
LiteLLM · Helicone · Portkey
Similar Projects
Infrastructure●●Solid
LunarGate – a self-hosted OpenAI-compatible LLM gateway
Go gateway with circuit breakers, but auth isn't production-ready yet.
Ship ItNiche Gem
jmartenka
302mo ago
Infrastructure●Mid
Open-next-router (ONR) – An Nginx-inspired, config-driven LLM router
Nginx-style config for LLM routing. Early-stage, needs demos and actual deployment stories.
Bold Bet
song2025
103mo ago
AI/ML●●Solid
Kronaxis Router – Don't pay frontier prices when a local LLM is enough
LLM cost routing with LoRA awareness when LiteLLM already handles basic proxying.
Big BrainSolve My Problem
JasonDuke
202mo ago
Infrastructure●●Solid
LLM-Gateway – Zero-Trust LLM Gateway
Zero-trust networking via zrok beats LiteLLM when your GPUs sit behind NAT.
Big BrainSolve My Problem
michaelquigley
712mo ago
AI/ML●●Solid
Routiium – self-hosted LLM gateway with a tool-result guard
Guards tool outputs against injection attacks, unlike LiteLLM or Helicone.
Solve My ProblemBig Brain
deadpixel
201mo ago