Wyolet Relay – high throughput, open source LLM router
Self-hosted LLM gateway pooling keys across providers for failover and cost tracking.
A lightweight, DSL-driven LLM gateway for routing, patching provider quirks, and normalizing APIs across channels
Nginx-style config for LLM routing. Early-stage, needs demos and actual deployment stories.
Backend engineers building multi-model applications who want to avoid vendor lock-in
LiteLLM · Helicone · Unify.ai
Inspired by Nginx’s atomic configuration philosophy, ONR allows developers to integrate and switch between various LLM channels through simple config files rather than writing boilerplate code. The goal is to move away from "hard-coded integrations" and toward a modular, high-performance routing layer.
I'm aiming to build the "Nginx for the LLM era." It’s still in the early stages, and I’d love to get feedback from the community or collaborate with anyone interested in the future of open LLM infrastructure.
Self-hosted LLM gateway pooling keys across providers for failover and cost tracking.
Annotation mapper for NGINX→Traefik migration. Solves the real blocker that ingress2gateway ignores.
Zero-trust networking via zrok beats LiteLLM when your GPUs sit behind NAT.
Visual RSC boundary outlines for Next.js when React DevTools don't show this.
Smart LLM routing cuts costs, but competing against established OpenRouter and vLLM ecosystems.
Pure Go, zero dependencies router for vLLM and sglang — clean solution to a real infra pain.