Data Projects

Data tools and analytics from Show HN — visualization, ETL pipelines, databases, and data science utilities.

Sort:

591 projects

GitHub

An experiment to query Xarray datasets with SQL

126Python

Data

●●●●Gem

I implemented a neural network in SQL

Running neural networks in SQL on climate data proves the relational array model works.

WizardryZero to One

alxmrs

1212016d ago

Data

●●●●Gem

I analyzed 227M Medicaid billing records to flag potential fraud

Public fraud detection across 227M Medicaid claims—1,860 flagged providers, zero false positives yet.

Zero to OneSolve My ProblemBig Brain

kianoconnor

305mo ago

Data

●●●●Gem

I analyzed 1.3M federal cases for racial sentencing bias

1.3M case analysis proves systemic sentencing bias with rigorous controls; visceral real-time cost counter.

Big BrainSolve My ProblemZero to One

justiceindex

215mo ago

GitHub

Autonomous discovery of dynamic laws and world structure in Elementary Cellular Automata. Atlas of 20 worlds, 7 cycle laws, fragility spectrum. Preprint: https://doi.org/10.5281/zenodo.20516375

0Python

Data

●●●●Gem

ZUSE – 69x causal compression of a period-15 CA oscillator

69x causal compression on period-15 CA oscillators with deterministic law discovery.

WizardryBig BrainNiche Gem

conchaestrada

201mo ago

GitHub

High-Performance GPU Cuckoo Filter

39Cuda

Data

●●●●Gem

Cuckoo-GPU – A 350x faster Bloom filter alternative for GPUs

350x faster GPU Bloom filter with academic paper backing the performance claims.

WizardryBig BrainDark Horse

tdortman

114mo ago

Data

●●●Banger

I made Google Trends for Hacker News by indexing 18 years of comments

Google Trends for Hacker News lets you settle editor wars with 18 years of data.

Rabbit HoleCrowd Pleaser

ytkimirti

8221561mo ago

Data

●●●Banger

I simulated closing the Strait of Hormuz on real oil trade data

Fluid-stochastic network clearing on real UN trade data makes geopolitical shocks feel terrifyingly concrete.

WizardryNiche Gem

eliotho

2441286d ago

Data

●●●Banger

Govbase – Follow a bill from source text to news bias to social posts

Bills + AI summaries + bias-rated news + politician posts all in one.

Solve My ProblemZero to One

foxfoxx

219894mo ago

Data

●●●Banger

I am building a map of people who lived in the Roman Empire

AI-extracted names from 150k Roman inscriptions mapped across the empire.

Niche GemBig BrainRabbit Hole

metiscus

210521mo ago

GitHub

PostgreSQL extension for BM25 relevance-ranked full-text search. Postgres OSS licensed.

3,865C

Data

●●●Banger

How This Graybeard Built the Fastest and Freest Postgres BM25 Search

Native Postgres BM25 with ORDER BY content <@> 'query' operator syntax.

Big BrainSolve My Problem

tjgreen

203564mo ago

Data

●●●Banger

What was the world listening to? Music charts, 20 countries (1940–2025)

Explore 230 global music charts from 1940–2025 with a Back to the Future UI.

Rabbit HoleEye CandyZero to One

matteocantiello

114514mo ago

GitHub

ACORN-1 pre-filtered HNSW search for DuckDB

64C++

Data

●●●Banger

DuckDB community extension for prefiltered HNSW using ACORN-1

ACORN-1 pushes WHERE filters into HNSW traversal, fixing pgvector's post-filter limitation.

Big BrainDark HorseSolve My Problem

cigrainger

9054mo ago

Text Post

Reading a paper means opening a PDF, then hunting separately for the code, the citations, whether it replicated, and what genes/drugs it touches. I spent a few months trying to fix that. Two parts: 1.

Data

●●●Banger

I mapped 8.5M research papers into an interactive atlas

8.5M papers in a WebGL map with MCP server access for AI agents.

Rabbit HoleWizardryBig Brain

leonickson

852820d ago

Data

●●●Banger

Large Scale Article Extract of Newspapers 1730s-1960s

Finally, a history archive that lets you search by meaning instead of just keywords.

Rabbit HoleBig Brain

brettnbutter

57202mo ago

Data

●●●Banger

Ex Situ – open-source spatial index of displaced cultural artifacts

Visualizes colonial extraction arcs no other tool maps this explicitly.

Big BrainNiche GemZero to One

hbyel

51418d ago

Data

●●●Banger

Trifle – Open-source analytics that stores answers, not events

Aggregates nested counters into time buckets at write time, skipping event storage entirely.

Big BrainDark Horse

iluzone

49177d ago

Data

●●●Banger

Ismcpdead.com – Live dashboard tracking MCP adoption and sentiment

Real-time MCP sentiment tracker when everyone's debating if the protocol is dead or thriving.

Niche GemShip It

sagirodin

39233mo ago

Data

●●●Banger

Explore 6048 YC companies as an interactive galaxy

Stunning 3D galaxy view makes exploring YC's entire portfolio actually fun.

Eye CandyRabbit Hole

jnakano89

362010d ago

Data

●●●Banger

What 180k words look like as a temporal knowledge graph (Oz series)

Tracks a promise made in chapter 8 through 92 chapters of narrative drift.

Rabbit HoleWizardryNiche Gem

ald0r

22113d ago

Data

●●●Banger

GeoTraceroute – Traceroutes on a 3D globe and submarine cables

Infers invisible submarine cable paths using A* pathfinding between ocean-crossing hops.

WizardryRabbit Hole

Himred

2113mo ago

Data

●●●Banger

A search engine for deleted YouTube videos (1.5B+ indexed since 2005)

Recovers metadata for deleted videos across 1.5B indexed entries since 2005.

Dark HorseRabbit Hole

archivarix

14122mo ago

GitHub

SirixDB is an an embeddable, bitemporal, append-only database system and event store, storing immutable lightweight snapshots. It keeps the full history of each resource. Every commit stores a space-efficient snapshot through structural sharing. It is log-structured and never overwrites data. SirixDB uses a novel page-level versioning approach.

1,210Java

Data

●●●Banger

SirixDB 1.0 Beta – Git-Like Versioning, Diffs, Time-Travel Queries

Structural sharing below page level beats ZFS block copying and event replay.

Big BrainWizardry

lichtenberger

13614d ago

Data

●●●Banger

Stratum – SQL that branches and beats DuckDB on 35/46 1T benchmarks

Git-like branching for columnar data with DuckDB-beating benchmarks from pure JVM.

Big BrainWizardry

whilo

1234mo ago

Data

●●●Banger

Wikigraph – an interactive visualization of all of English Wikipedia

GPU-accelerated layout renders 7M articles with shortest-path finding between any two.

Rabbit HoleWizardryEye Candy

tfpgh

1221mo ago

Data

●●●Banger

DeepTable – an API that converts messy Excel files into structured data

Agent-guided compilation handles merged cells and multi-level headers LLMs choke on.

Solve My ProblemBig Brain

francisrafal

804mo ago

GitHub

A simple, fast and versatile Datalog database

1,462Clojure

Data

●●●Banger

Datalevin – a simple, fast, and versatile Datalog database

Datalog engine that finally beats SQL on graph queries without the Datomic tax.

Big BrainNiche Gem

huahaiy

808d ago

Data

●●●Banger

What's AI's go-to, public or private healthcare?

30,000 AI responses revealing systematic bias patterns across 100 models.

Dark HorseRabbit Hole

bnfcl

836d ago

Data

●●●Banger

I indexed the academic papers buried in the DOJ Epstein Files

207 papers buried in government records, now searchable with full context extraction.

Zero to OneBig BrainNiche Gem

am-seo

705mo ago

GitHub

Distributed DataFrames for Elixir powered by DuckDB

94Elixir

Data

●●●Banger

Distributed DuckDB on the Beam

Distributes DuckDB queries across BEAM nodes when Polars maintenance became unsustainable.

Big BrainNiche Gem

cigrainger

703mo ago

Data

●●●Banger

Infini-News – 1.36B news articles from Common Crawl, queryable in ms

1.36B articles queryable in milliseconds solves a decade of researcher scraping pain.

Big BrainZero to OneSolve My Problem

ruggsea

7128d ago

GitHub

ADBC Client for DuckDB

41C++

Data

●●●Banger

Connect DuckDB to any database that has an ADBC driver

Zero-copy Arrow queries from DuckDB to Snowflake without ODBC row-column conversion overhead.

Big BrainWizardry

sarch

7221d ago

GitHub

Open-source streaming SQL engine written in Rust using Apache Arrow and DataFusion. Supports continuous queries, temporal stream joins, tumbling/session windows, and CDC/Kafka connectors. Lightweight, embeddable, and sub-microsecond latency

42Rust

Data

●●●Banger

LaminarDB – Streaming SQL database in Rust, zero-alloc hot path

Sub-microsecond streaming SQL via zero-alloc hot path; genuine advancement over SQLite+DataFusion.

WizardryNiche GemSolve My Problem

sujitn

615mo ago

Data

●●●Banger

DAGraph – local-first reactive graph from arithmetic to OLAP SQL

Reactive SQL graph in the browser beats Tableau for local prototyping.

Zero to OneCozySolve My Problem

notfirstpost

612mo ago

Data

●●●Banger

GapQuery – find app-market gaps from 35,600 apps and their reviews

Turning 184,000 reviews into 'build vs skip' verdicts inside Claude Code is genuinely clever.

Big BrainDark Horse

northify

606d ago

Data

●●●Banger

I poked at the golden ratio in SQL and solved an open math problem

Proving an open math conjecture using nothing but SQL cross-apply queries is wild.

Big BrainWizardry

kittoes

605d ago

Data

●●●Banger

Visualizing How Books Reference Each Other Across 3k Years

3,000 years of literary citation networks visualized with WebGPU; LLM pipeline resolves messy bibliographic data.

WizardryRabbit HoleEye Candy

farcaster

535mo ago

Data

●●●Banger

We benchmarked 18 LLMs on OCR (7K+ calls) – cheaper models win

7,560 runs proving cheaper models beat expensive ones on production OCR tasks.

Big BrainSolve My Problem

TimoKerr

513mo ago

Data

●●●Banger

Flop Map – a 3D globe of every known AI compute cluster

Stunning 3D globe tracking 725 AI clusters and 80M H100 equivalents globally.

Eye CandyRabbit Hole

kitwebster

532mo ago

Data

●●●Banger

Skymap – a 3D galaxy catalog explorer in the browser via WebGPU

WebGPU renders millions of galaxies in-browser with real-time density correction filters.

Rabbit HoleEye CandyWizardry

thereallex

592mo ago

Data

●●●Banger

OrcaSheets, local first analytics engine to process billions of rows

Runs billions of rows locally on your machine, bypassing cloud warehouse costs entirely.

Big BrainSolve My Problem

ydgandhi

542mo ago

Data

●●●Banger

The Quiet Map – Earth's quietest place, measured by seismometers

Turning 98 live seismic feeds into a global 'quietest place' tracker is a genuinely clever data mashup.

Rabbit HoleDark HorseCozy

theceka

5118d ago

Data

●●●Banger

How far do I have to go to run into 100k people?

Petal visualization of population density is an instantly graspable data viz win.

Rabbit HoleEye CandyBig Brain

ImJasonH

515d ago

Data

●●●Banger

Searchable aggregator of 24M London council spending transactions

24M spending rows searchable instantly; missing data but fills a real transparency gap.

Dark HorseSolve My Problem

ashfn

455mo ago

Data

●●●Banger

Open load forecasts that beat US grid operators on 6 of 7 RTOs

Beats utility forecasts on 6 of 7 RTOs using only public EIA data and open models.

Big BrainDark HorseZero to One

tylergibbs1

403mo ago

GitHub

Probabilistic Spreadsheets

1TypeScript

Data

●●●Banger

Spreadsheets Cells with Uncertainty Distributions

Monte Carlo sampling inside a spreadsheet beats collapsing uncertainty into single scalars.

Big BrainNiche Gem

tobiadefami

402mo ago

GitHub

Column-oriented analytics for SQLite, designed for fast local analytical queries with benchmarked speedups of up to 130,000x over standard SQLite scans on selected workloads.

Data

●●●Banger