Free foreverRuns entirely on your machine

Crawl any website.
Let your AI run it.

Bluesnake is a fast website crawler — the full-site crawl SEO teams rely on, made modern. Drive it from the desktop app, a single command, or right inside the AI tools you already use. Whether a person or an agent is at the wheel, it's the same crawl, the same data.

No setup, no Java Your data never leaves your machine Free, forever
bluesnake northvale.co/

Crawls

5
Filter crawls…
Compare+ New Crawl
Continue where you left off
meridian-outdoors.com/Paused at 612 / 4,120 URLs · 2026-06-08 16:40 · nothing was lost
Discard Resume crawl
All crawls
StatusSite / ProjectURLsFindings
Completed
northvale.co/ Spider
northvale.co · 2026-06-09
1,284
143852
Completed
northvale.co/ Spider
northvale.co · 2026-05-26
1,261
194449
Interrupted
meridian-outdoors.com/ Spider
client: meridian-outdoors.com · 2026-06-08
612of 4,120
6118
Resume
Completed
northvale.co/sitemap.xml List
northvale.co · 2026-05-12
312
2914
Completed
trailhead.example/ Spider
client: trailhead.example · 2026-04-30
18,402
4188130
Crawls auto-save continuously to ~/.bluesnake — there is no Save button, and closing the app never loses a crawl.

The desktop app — the human view of the same engine your scripts and agents drive.

One engine

Run it however you work.

People, terminals, and AI agents all reach for the same crawler — and read back the exact same results.

01

In the desktop app

A calm window for browsing crawls, resuming runs, and comparing them side by side. Click, don't type.

for people who like a GUI
02

From one command

A single, portable program — no runtime, no install ceremony. Schedule it, repeat it, fold it into your workflow.

$ bluesnake crawl …
03

Inside your AI agent

Ask an AI tool to crawl a site and it just can — Bluesnake speaks plain text and clean data, the things agents understand.

Claude Code · Codex · Cowork
Built for AI agents

The first crawler your AI can actually drive.

Older crawlers bury their settings in a locked binary file only the app can open. Bluesnake keeps everything in plain text and runs from a single command — so the AI tools you already work in can set up a crawl, run it, and read the results without you lifting a finger.

C Claude CodeG ChatGPT CodexW Claude Cowork
No plugins, no glue codeIf your agent can run a command, it can run Bluesnake. Nothing to wire up.
Plain-text settings, not a locked fileYour agent reads and edits a crawl's setup the same way it edits any text.
Results come back as clean dataJSON an agent can reason over — not a screenshot it has to squint at.
AI agent session · bluesnake
crawl.yamlplain text · editable
# a crawl's settings — readable by you and your AI
start:          https://northvale.co
mode:           spider
render_js:      true
respect_robots: true
export:         [json, csv]
Why switch

Everything you know about crawling. None of the baggage.

If you've used a desktop SEO spider, Bluesnake feels instantly familiar — it just stops making you fight the tool.

Bluesnake
The classic crawler
Run it from
App, command line, or your AI agent
The desktop app, and only that
AI agents can drive it
Claude Code, Codex & Cowork
Not built for it
Its settings file
Plain text — readable & editable
A locked binary blob
Getting started
One file, nothing else to install
Java runtime + memory tuning
If it stops mid-crawl
Resume exactly where it stopped
Save by hand, or start over
Price
Free, forever
Paid licence

A general comparison with closed desktop crawlers. Not affiliated with or endorsed by any other product.

What it does

A thorough crawl, every time.

Point it at a site or a list of URLs. Bluesnake follows the links, records what it finds, and hands you the data to work with.

Whole-site or list mode

Spider an entire site from one URL, or audit a fixed list — including straight from an XML sitemap.

Links, titles & status codes

Every page's title, redirects, and 200 / 404 / 3xx status — plus the link map of how it all connects.

Renders JavaScript

Headless Chrome under the hood, so JS-heavy sites and single-page apps get crawled properly.

Obeys robots.txt

Respects the rules of every site you crawl, with a built-in tester to debug them live.

Exports & sitemaps

Send results to CSV, JSON, JSONL or XLSX — or turn any crawl into a clean XML sitemap.

Compare two crawls

Diff a fresh crawl against an earlier one to see exactly what was added, removed, or changed.

Coming soonBuilt-in SEO checks & scoring — graded issues and priorities, layered on the same crawl engine.
Get started

Your next crawl is one click — or one command — away.

Free, forever. Grab the desktop app, or drop the binary into your terminal in seconds.

Detecting your OS…
All files & checksums.deb · tarballs · SHA256SUMS