AI/ML●Mid
Docker AI Stack – Deploy 8 self-hosted AI services with one command
Yet another one-command AI stack when Ollama and Jan already exist.
Ship It
hwdsl2
101mo ago
Back to browse
GitHub Repository
Deploy a complete, self-hosted AI stack on your own server with one command. Includes Ollama (LLM), AnythingLLM (chat UI), LiteLLM (AI gateway), Whisper (STT), Kokoro (TTS), Embeddings (RAG), and MCP Gateway. Most services run locally; LiteLLM optionally routes to external providers. Multi-arch: amd64, arm64. NVIDIA GPU (CUDA) acceleration.
84 starsShell
Docker AI Stack, self-hosted LLM/STT/TTS/MCP in one compose file
by hwdsl2·May 6, 2026·1 point·0 comments
AI Analysis
●●SolidShip ItCozy
One-command local AI stack bundling Ollama, Whisper, and MCP Gateway.
Strengths
- •Zero-config setup generates API keys automatically for secure local deployment.
- •Lightweight mode drops RAM requirements to 2.5GB for smaller server instances.
- •Includes MCP Gateway out of the box for immediate agent tool integration.
Weaknesses
- •Just orchestrates existing containers without novel architecture or engineering.
- •Heavy reliance on external providers via LiteLLM undermines the 'local' claim.
Category
Target Audience
Developers self-hosting local AI infrastructure
Similar To
Docker Ollama · Open WebUI · AnythingLLM
Similar Projects
AI/ML●Mid
Private Corporate AI – self-hosted LLM and RAG, no cloud
Another self-hosted RAG stack competing with Ollama, AnythingLLM, and Dify.
Niche Gem
neckgoes
312mo ago
Infrastructure●●Solid
Sencho – a self hosted Docker Compose UI with multi-node fleet support
Outbound-only Pilot Agent beats Portainer for NAT traversal without exposing Docker socket.
Solve My ProblemBig Brain
ansocode
2010d ago
Developer Tools●●Solid
Run Claude Code autonomously inside your Docker Compose stack (OSS)
Auto-detects docker-compose.yml so agents can test against real database dependencies.
Solve My ProblemSlick
sayil
802mo ago
AI/ML●Mid
WordPress for Voice Agents – Unpod.ai
Voice agent orchestration with no-code studio, but orchestrates off-the-shelf APIs like everyone else.
Ship It
parvbhullar
11103mo ago
AI/ML●●Solid
Ava – AI Voice Agent for Traditional Phone Systems(Python+Asterisk/ARI)
Adds AI voice to legacy Asterisk systems without ripping out existing telephony.
Niche GemBig Brain
hkjarral
713mo ago