Back to browse
The user agents crawling HN today

The user agents crawling HN today

by Bender·May 20, 2026·5 points·5 comments

AI Analysis

●●SolidNiche GemDark Horse

Live feed of crawler user agents hitting HN right now.

Strengths
  • Updates in real-time showing actual traffic patterns rather than static monthly reports.
  • Identifies specific AI scrapers like 'intel-collector' and 'GCombinator' by name.
  • Raw text format makes it easy to pipe directly into firewall blocklists.
Weaknesses
  • Lacks historical context or trend analysis beyond the current snapshot.
  • No filtering options to separate benign bots from aggressive scrapers.
Category
Target Audience

Security researchers and HN admins

Similar To

Robots.txt · Cloudflare Bot Fight Mode

Similar Projects