Microgpt is a GPT you can visualize in the browser

by b44·Feb 15, 2026·282 points·24 comments

Visit Project View on HN

AI Analysis

●●SolidEye CandyBig Brain

Visualize a 4K-param GPT learning in real-time with clickable layer explanations.

Strengths

•Interactive attention head visualization makes abstract concepts tangible
•Built-in FAQ answers common transformer questions directly in UI
•Lightweight runnable model lets users experiment with hyperparameters instantly

Weaknesses

•Niche audience—terminal developers interested in visual ML education only
•Inspired by Karpathy's microgpt but doesn't substantially improve on educational value

Post Description

very much inspired by karpathy's microgpt of the same name. it's (by default) a 4000 param GPT/LLM/NN that learns to generate names. this is sorta an educational tool in that you can visualize the activations as they pass through the network, and click on things to get an explanation of them.

Similar Projects

Education●●Solid

LLM-Visualized – Interactive 3D and 2D Visualization of GPT-2

Three.js renders real GPT-2 attention patterns you can actually explore interactively.

Eye CandyRabbit Hole

saahithj

1223mo ago

AI/ML●●Solid

Microgpt-ts – Full GPT in 500 lines of TypeScript, zero dependencies

Karpathy's minigpt ported to TS, readable code instead of brevity Olympics.

WizardryBig BrainShip It

sdubois

323mo ago

Education●●Solid

Interactive visualizer for Karpathy's 243-line microGPT

Type a name and you can literally watch characters turn into IDs, 16‑dim embeddings get added with positional encodings, and causal attention matrices animate per head — all matched numerically to Karpathy's 244‑line microGPT. The implementation is pure TypeScript (no ML libs) and includes a helpful scrollable sidebar with the reference math, which makes this an excellent, low‑friction learning tool — more pedagogical deep dive than research innovation.

Rabbit HoleNiche GemEye Candy

Sayyed23

114mo ago

Education●●Solid