EvalLens – Open-source tool to evaluate structured LLM outputs
Schema conformance checks beat generic text evals for JSON-heavy LLM pipelines.

It parses JSON structures and highlights value changes, type mismatches, and missing properties in a live side-by-side editor while keeping everything client-side — neat for poking at API responses or diffs of exports. The UI gives instant feedback and clear color-coded categories, but it's solving a well-trodden problem and lacks higher-end features like JSON Schema-aware diffs, patch/merge tooling, or CLI/automation hooks.
Backend/frontend developers, QA engineers, API engineers, DevOps
Semantic Diffing: Ignores whitespace and attribute order.
100% Client-Side: Your data never leaves your browser.
Schema conformance checks beat generic text evals for JSON-heavy LLM pipelines.
93% accuracy document extraction, but remove.bg-style competition already exists.
AST-based contracts beat raw code for AI, but codebase analyzers are increasingly crowded.
JSONPath `vars` operator handles array queries when standard JsonLogic only does scalar lookups.
Equity tax calculator for non-finance people, competes directly with Carta and spreadsheets.
SQL-like queries against beliefs beat vector search's 10% precision with claimed 100% accuracy.