Composable middleware for LLM inference Optimization Passes
Tower-style middleware stacking for inference guardrails beats bolted-on if-statements.
Functional request -> response processing framework
Compile-time pipeline maps for Rust, but author says don't ship it yet.
Rust developers building complex request processing or agentic workflows
Tower · Axum middleware · Bonobo
Tower-style middleware stacking for inference guardrails beats bolted-on if-statements.
FFmpeg-shaped pipeline orchestration for LLMs with built-in JSON validation and repair.
Lazy deserialization means plugins only pay for nodes they actually visit.
Backpressured pipeline with 60-80% dedup savings beats chatty multi-agent frameworks.
Step-through PPU debugging with cycle-accurate pixel pipeline visualization for emulator devs.
Native binaries for CI scripts beat Python startup time without Rust verbosity.