AI/ML●●Solid
Docker AI Stack, self-hosted LLM/STT/TTS/MCP in one compose file
One-command local AI stack bundling Ollama, Whisper, and MCP Gateway.
Ship ItCozy
hwdsl2
101mo ago
Back to browse
GitHub Repository
Deploy a complete, self-hosted AI stack on your own server with one command. Includes Ollama (LLM), AnythingLLM (chat UI), LiteLLM (AI gateway), Whisper (STT), Kokoro (TTS), Embeddings (RAG), and MCP Gateway. Most services run locally; LiteLLM optionally routes to external providers. Multi-arch: amd64, arm64. NVIDIA GPU (CUDA) acceleration.
82 starsShell
Docker AI Stack – Deploy 8 self-hosted AI services with one command
by hwdsl2·May 13, 2026·1 point·0 comments
AI Analysis
●MidShip It
Yet another one-command AI stack when Ollama and Jan already exist.
Strengths
- •Zero-config auto-configuration generates API keys on first start
- •Complete stack covers LLM, STT, TTS, embeddings, and MCP in one compose
- •Lightweight stack option runs on ~2.5 GB RAM for lower-end servers
Weaknesses
- •Orchestration of existing tools without novel architecture or approach
- •One-command AI stack is crowded—Ollama, Jan, AnythingLLM already do this
Category
Target Audience
Developers wanting local AI infrastructure
Similar To
Ollama · Jan.ai · AnythingLLM
Similar Projects
AI/ML●Mid
Private Corporate AI – self-hosted LLM and RAG, no cloud
Another self-hosted RAG stack competing with Ollama, AnythingLLM, and Dify.
Niche Gem
neckgoes
312mo ago
Open Source●●Solid
DD Photos – static photo albums, now with Docker and 1-command deploy
Static photo gallery with Docker mode removes Go and Node dependency hell.
CozySolve My Problem
dougdonohoe
401mo ago
AI/ML●Mid
Local AI stack (Docker, Ollama) that lets you build apps without Python
Low-code AI platform wrapped in Docker, but Open WebUI already does local AI simpler.
Ship It
aeberhart
103mo ago
Developer Tools●●Solid
Djevops – Deploy Django Easily
Django deployment without Docker, but Heroku and PaaS alternatives already exist.
Solve My ProblemShip It
mherrmann
303mo ago
Developer Tools●●Solid
GitHub Action to deploy to Portainer over Tailscale (no open ports)
Ephemeral Tailscale OAuth + Portainer API eliminates port exposure for home server CD.
Solve My ProblemDark Horse
sankalpnarula
103mo ago