AI/ML●●●Banger
Wordchipper – Rust BPE tokenizer, 9x faster than tiktoken
Nine times faster than tiktoken-rs with swappable lexer backends for benchmarking.
WizardryBig Brain
antimora
202mo ago
Back to browse
GitHub Repository
An inference architecture that makes LLMs stateful. Patent pending (US 64/050,345).
13 stars
Stateful Inference with 99% Token Savings
by wasnaga·Apr 30, 2026·2 points·0 comments
AI Analysis
●●●BangerBig BrainBold Bet
Injects raw KV tensors directly into model cache to skip 90% of token recomputation.
Strengths
- •Bypasses linear cost scaling by storing intermediate states on cheap NVMe instead of HBM.
- •Claims functional equivalence to full-context processing without RAG or prompt compression.
- •Architecture targets the specific bottleneck of attention layer recomputation in long sessions.
Weaknesses
- •Patent pending status creates immediate friction for open-source adoption and community trust.
- •Implementation likely tightly coupled to specific model architectures and weight formats.
Category
Target Audience
LLM infrastructure engineers and AI startup CTOs
Similar To
vLLM · TGI · KV Cache optimizations
Similar Projects
AI/ML●●●Banger
An agent that remembers across sessions (no chat history)
Cuts long-context costs by 90% by swapping disk IO for expensive GPU recomputation.
Big BrainWizardry
wasnaga
101mo ago
Developer Tools●●●Banger
I solved Claude Code's prompt injection problem, saved tokens doing it
Drops token usage 97% and blocks injection — smart sanitization beats raw WebFetch, drop-in replacement.
Solve My ProblemWizardryBig Brain
timstark
113mo ago
Productivity●●●Banger
ThreadKeeper – Save and restore Windows working context with Ollama
Ctrl+Shift+S snapshots your whole context, LLM summarizes it, one-click restore.
Solve My ProblemShip It
tatsube
203mo ago
Education●●Solid
The Anatomy of an LLM
Interactive LLM explainer covering tokenization through KV cache across 15 chapters.
Rabbit HoleCozy
redcodenl
4222d ago
AI/ML●●Solid
Token Saving Tinyscreenshot Skill
4x token savings on screenshots with readable text at 800px grey.
Solve My ProblemBig Brain
franze
211mo ago