Dendrite – O(1) KV cache forking for tree-structured LLM inference
O(1) fork latency makes tree search 1000x faster than vLLM for agentic workloads.
Architectural exploration of Persistent Reasoning as a first-class system primitive. This repository defines axioms, invariants, forbidden operations, recovery modes and minimal executable prototypes for long-lived AI systems where reasoning persists beyond inference, models and prompts.
Append-only lineage prevents LLM outputs from collapsing structure—but unclear if it ships or works.
AI safety researchers, LLM system architects, formal verification specialists
Constitutional AI · Chain-of-Thought prompting · Formal verification of neural networks
Example: (2 + 3) * 4 → 20
This removes structural decomposition and makes downstream reasoning dependent on a scalar result.
I built a minimal prototype that enforces admissibility before persistence using a write barrier. The write barrier separates model output from persistent state.
Core mechanisms: * Append-only lineage (no in-place mutation) * Explicit proposal → invariant check → commit cycle * Whitelisted structural transforms * Deterministic invariant checks before commit
If a transform attempts to collapse structure (e.g., replacing a decomposed expression with a scalar), the proposal is rejected and never enters the lineage.
Important distinction: Invalid states may still be representable as data, but they are uncommittable under the governed commit path.
This does not modify the model. It constrains persistence architecturally around model outputs.
Arithmetic is used purely as a stress-test domain to isolate one narrow claim: Certain structural collapses can be made impossible to persist.
Limitations: * Domain-specific invariants * Not a symbolic solver * Does not improve model accuracy * In-memory prototype storage
GitHub: https://github.com/PersistentVlad/persistent-reasoning-archi...
O(1) fork latency makes tree search 1000x faster than vLLM for agentic workloads.
Interesting conceptual take, but the repo has 2 commits and zero working code.
Promises deterministic state machine logic, but it's just a structured system prompt competing with DSPy.
Tackles persona collapse with architecture, but lacks proof-of-concept or working implementation.
Six-stage pipeline with Joern CPG and LLM reasoning beats simple pattern matching.
Another custom markup syntax competing with Markdown, Org-mode, and S-expression variants.