Back to browse
GitHub Repository
2 starsGo

Open-source GPU cost analysis tool

by maksimov·Apr 28, 2026·1 point·0 comments

AI Analysis

●●SolidSolve My ProblemShip It

Detects idle L40S nodes and oversized SageMaker endpoints to cut AWS GPU spend.

Strengths
  • Identifies specific waste patterns like idle nodes running 13+ days with zero pods.
  • Compares scan results over time to track cost reduction progress automatically.
  • Runs locally with standard AWS credentials, requiring no SaaS signup or API keys.
Weaknesses
  • Currently limited to AWS, missing Azure and GCP where GPU waste is equally prevalent.
  • Relies on CloudWatch metrics which may have latency in reporting real-time utilization.
Category
Target Audience

ML engineers and FinOps teams managing cloud GPU infrastructure

Similar To

CloudHealth · Vantage · Kubecost

Post Description

Hi HN, This was one of those “scratch my own itch” type of things. I wanted to build my own small CLI tool to scan GPU capacity in our AWS accounts. Today it can do EC2, SageMaker, EKS and K8s clusters. It’s able to tell you how much is potentially wasted and recommend how to improve. Easy to install:`go install` and run. No signups, no API keys. The tool is written in Go, deliberately designed to support other clouds and GPU providers. I would love people to try it and return with feedback. Contributors are most welcome, especially those who can help with discovery and metrics for other clouds. Many thanks.

Similar Projects

Infrastructure●●Solid

CleanCloud – 20 rules to find what's costing you money in AWS and Azure

This is the kind of tool you run in CI to block cost regressions: read-only scans, per-finding evidence and LOW/MEDIUM/HIGH confidence levels, plus an exit code you can fail builds on (--fail-on-confidence HIGH). The project deliberately avoids phone-home telemetry and destructive actions, which makes it attractive for regulated environments, though it’s narrowly focused (AWS + Azure only, 20 conservative rules) rather than aiming to be a full-cost-management suite.

Niche GemSolve My Problem
sureshcsdp
114mo ago