HN Showcase
Back to browse
GitHub Repository

Automatically decompose nested JSON in your data warehouse into normalized dbt models. Supports BigQuery, Snowflake, and Databricks

4 starsPython

Forge-Core released on GitHub, Parse JSON in your data warehouse

by brady_bastian·Apr 22, 2026·1 point·0 comments
Visit ProjectView on HN

AI Analysis

●●SolidSolve My ProblemShip It

Beats manual SQL macros at flattening nested JSON for dbt pipelines.

Strengths
  • •BFS discovery engine automates schema inference without requiring any manual column mapping.
  • •Generates Mermaid ER diagrams automatically from every single discovered nested JSON structure.
  • •Supports four major warehouses with production-ready dbt model generation out of box.
Weaknesses
  • •Redshift support is still in beta, limiting immediate adoption for some teams.
  • •Competes with built-in warehouse functions like Snowflake's native FLATTEN command directly.
Category
Data
Target Audience

Analytics engineers and data teams using dbt with BigQuery or Snowflake

Similar To

dbt-utils · Fivetran · Airbyte

Post Description

Automatically decompose nested JSON in your data warehouse into normalized dbt models.

Forge Core is a deterministic BFS engine that reads a single JSON column (or multi-column table), discovers all nested structures, and generates:

dbt SQL models — one per nested object/array Rollup view — reassembles the full document from normalized tables schema.yml — structural column inventory JSON Schema — standard draft-07 schema of the discovered structure Mermaid ER diagram — table relationship visualization

Similar Projects

Developer Tools●●Solid

Checkup – Repository Release Tracker (always latest.zip)

Consistent curl-friendly endpoints for latest assets and a cached +json API are the concrete win here — you can script downloads without wrestling with provider-specific quirks. The modular provider architecture (GitHub, GitLab, Forgejo, cgit) and configurable cache show it was designed for lightweight self-hosting, and the AUR package + examples get you running quickly. It’s useful and pragmatic, but it needs private-repo auth/rate-limit handling and some usage/monitoring features to feel essential.

Niche GemSolve My ProblemShip It
modinfo
103mo ago