GitHub Repository

Blazingly fast data comparison tool for Python, powered by Rust. Compare massive CSV/Parquet datasets instantly.

6 starsPython

Koala Diff – High-performance local data comparison (Rust and Polars)

Name: Koala Diff – High-performance local data comparison (Rust and Polars)
Availability: InStock
Author: godalida

by godalida·Feb 13, 2026·5 points·1 comment

Visit Project View on HN

AI Analysis

●●SolidWizardrySolve My Problem

Zero-copy streaming comparison for 100GB+ datasets, 3x faster than Polars on RAM.

Strengths

•Rust+Polars foundation with native XXHash64 streaming avoids cluster overhead.
•Specialized tool for diff-as-a-service: row-level tracking of added/removed/modified with variance metrics.
•Professional HTML reports with delta attribution reduce stakeholder friction.

Weaknesses

•Data comparison is a solved category (Polars, dbt, commercial tools handle this).
•Only 4 stars after release suggests limited real-world adoption or visibility.

Similar Projects

Developer Tools●●Solid

Diffly – A Python package to compare polars dataframes

DataFrame diffing for Polars with ASCII output when pandas comparisons fall short.

Solve My ProblemSlick

ekarais

302mo ago

Developer Tools●●●Banger

Cargo-affect – Plan affected Rust workspace tests from a Git diff

Smart reverse-dependency tracking beats naive path-matching in large Rust workspaces.

Big BrainSolve My Problem

lightsofapollo

101mo ago

Developer Tools●●Solid

A diff tool that understands JSON

It parses JSON structures and highlights value changes, type mismatches, and missing properties in a live side-by-side editor while keeping everything client-side — neat for poking at API responses or diffs of exports. The UI gives instant feedback and clear color-coded categories, but it's solving a well-trodden problem and lacks higher-end features like JSON Schema-aware diffs, patch/merge tooling, or CLI/automation hooks.

Solve My ProblemSlick

subhash_k

104mo ago

Developer Tools●Mid