HN Showcase
Back to browse
GitHub Repository

A multi-provider LLM framework for Rust.

10 starsRust

Chat-rs, yet another LLM provider

by eggermarc·Apr 15, 2026·1 point·0 comments
Visit ProjectView on HN

AI Analysis

●MidShip It

Yet another LLM SDK when async-openai and llm-chain already exist.

Strengths
  • •Type-state builder pattern enforces valid configs at compile time.
  • •Human-in-the-loop pauses for sensitive tool calls before execution.
  • •Model router with fallback strategies across multiple providers.
Weaknesses
  • •Crowded category with established Rust LLM libraries already solving this.
  • •No clear differentiation beyond what Vercel AI SDK already offers for JS.
Target Audience

Rust developers building AI applications

Similar To

Vercel AI SDK · llm-chain · async-openai

Post Description

Hello everyone! I'm happy to announce chat-rs, another LLM inference provider written in rust with streaming capabilities, tool calling, and intuitive ergonomics. I was heavily inspired by vercel's ai-sdk react framework and I wanted to have a semi opinionated rust alternative. Aside from the basics, we support full on model routers, human-in-the-loop for stop and pause, and thanks to tools-rs (posted yesterday) your agents will be able to call python tools.

Similar Projects