Back to browse
Lightport – open-source AI gateway

Lightport – open-source AI gateway

by statements·Apr 28, 2026·1 point·0 comments

AI Analysis

●●SolidNiche GemShip It

Open-source proxy making 77+ LLM providers OpenAI-compatible without the enterprise bloat.

Strengths
  • Integration tests for 77+ providers ensures reliability across diverse APIs.
  • Explicitly excludes caching and retries to maintain a focused, lightweight codebase.
  • Powers Glama in production, proving real-world stability beyond a hobby project.
Weaknesses
  • LiteLLM already dominates this space with more features and broader community adoption.
  • Lacks built-in retries or caching, requiring additional infrastructure for production resilience.
Target Audience

Backend developers building multi-provider AI applications

Similar To

LiteLLM · Portkey

Post Description

Hey HN!

I am the founder of Glama.

We are making Lightport open-source – it's the AI gateway that's been powering Glama.

GitHub: https://github.com/glama-ai/lightport

Live: https://glama.ai/ai/gateway

Why?

We're going all-in on the MCP ecosystem – it's what we're best at. Open-sourcing the gateway is both a thank-you to the community that helped us grow and a way to keep us focused.

The short backstory:

Lightport began as a fork of Portkey. We needed a way to make various LLM providers OpenAI-compatible, and Portkey provided a solid foundation. But it also came with many higher-level features (guardrails, billing, etc.) that we didn't think belonged at this layer – and that made it hard to iterate on provider compatibility. So we slimmed it down, fixed bugs, added integration tests for 80+ providers, and shaped it into one thing: a reliable, lightweight layer that makes any LLM provider OpenAI-compatible.

What's next:

More modules will follow – guardrails, billing, retries, telemetry – each open-sourced as standalone middleware. We'll continue to maintain Lightport in the open, with a focus on OpenAI compatibility across LLM providers.

For Glama users:

The Glama AI gateway will continue to function as a privacy-first gateway, but we will support only a curated set of providers (OpenAI, Anthropic, Google, Grok, Groq, DeepSeek, Alibaba, Moonshot, and a few others). For everything else, OpenRouter is a great alternative.

Try it, break it, build with it. I can't wait to see what you make.

Similar Projects

AI/ML●●Solid

Nenya – A lightweight, highly secure AI API Gateway/Proxy written in Go

Secret redaction and mlock security for AI gateways when LiteLLM already exists.

Big BrainSlick
garou
209d ago
Developer Tools●●Solid

LLM Gateway for OpenAI/Anthropic Written in Golang

Runs as a single binary with embedded SQLite and zero-config start, acting as a transparent, provider-agnostic proxy that logs model, tokens, latency, cost and API key hashes while leaving full body capture opt-in. It also proxies streaming responses in real time and exposes stable JSON analytics endpoints — a practical, instrumentable way to get reproducible, audit-ready traces for real LLM traffic, though long-term value depends on how it handles provider edge-cases and SDK compatibility.

Solve My ProblemNiche GemSlick
oatmale
424mo ago