Lets your assistant reason through a problem in numbered steps, revising and branching as it goes.
Crawlie
seanspronta · MCP server
Crawlie is a technical SEO and GEO crawler that runs from the command line and as an MCP server. Your agent can crawl a whole site, audit a single page or a list of URLs, ask why a finding matters, list the audit rules and retrieve earlier reports. From the command line you can print results or write an HTML report. Prebuilt binaries cover macOS, Linux on x64 and Windows on x64, with other platforms built from source, and the project is open-source under the MIT licence.
Written by ooruby from the README of crawlie 0.5.3.
Not claimed by its maker. Is this yours? Prove it and answer the findings
Why it's useful
Your agent can audit a live site for technical SEO and GEO problems and explain why each finding matters.
What you could do with it
- Ask your agent to crawl your site and report the technical SEO problems it finds.
- Audit a single pricing page and ask your agent to explain why a finding matters.
- Write a crawl of your site to an HTML report you can open in a browser.
Written from its documentation: what it says it can do, not what our checks found.
Maintenance
Not measuredNo release date is on record for this package yet. The nightly publisher check records one as it reaches each npm package, about once every ten nights.
Release activity only: it says nothing about quality or safety, and a finished small package can be fine without releases. How it is measured
- Command execution is bounded
- inventory
- node child_process (bin/crawlie-mcp.js:3)
- synchronous shell execution (bin/crawlie-mcp.js:13)
- node child_process (bin/crawlie.js:3)
- synchronous shell execution (bin/crawlie.js:13)
- An inventory of where the code starts another program, not a verdict on this row: whether each one runs a fixed program or whatever it is handed takes a reading by hand.
- Licence and provenance
- finding
- no LICENCE file at the root (.)
- Data handling disclosed
- finding
- no statement of what it reads, writes or sends (README.md)
Published because it was found. A finding is information about where the limits are, not a verdict that the software is unsafe.
What this does not cover
- Everything. Treat it as you would software from anywhere else.
Receipt history: every signed receipt for every version of this listing, and what changed between them.
In its maker's words
Fast, free, open-source technical SEO + GEO crawler — CLI and MCP server. By Spronta.
Compare with
Compare all 4How far this has been checked
Static scanned
- What it establishes
- Its published package, or for a hosted server its source repository at a recorded commit, was read file by file, without running it, by every check in our current scan.
- What it does not
- How it behaves when it runs, or anything the scan does not read yet: several rubric checks, the repository's history, and compiled code in folders named dist or build. For a hosted server, that the endpoint runs the code that was read. The ooruby Index sets out exactly what was read.
- Exactly what was read
- Version 0.5.3, the file with digest sha512-IeMgHZOtpQhidqFG17cBbLosvDjPuk7bWOMX9XYtINgARn+0r94tvXbhadiG51XrkWcqKgM9WCFhJ6kqxVrwdw==, as the registry publishes it. A published version cannot be replaced, so this names the same bytes for anyone who checks.
- Authentication
- Runs locally. No hosted endpoint is listed for this package. You run it on your own machine, so there is no endpoint of ours to authenticate against.
Adding it
Paste this into your client's MCP configuration.
{
"mcpServers": {
"crawlie": {
"command": "npx",
"args": [
"-y",
"-p",
"crawlie@0.5.3",
"crawlie"
]
}
}
}Or run it directly.
npx -y -p crawlie@0.5.3 crawliePinned to 0.5.3, which is the version the findings above were found in. Drop the version to take whatever is newest, and the report on this page stops describing what you installed.
Where this came from
- Registry
- npm
- Package
- crawlie
- Version read
- 0.5.3
- Resolved
- 2026-10-10
No build provenance published. The repository above is the one the publisher declared, and nothing links it to the package you would install. That is not a mark against this listing, since most packages are published this way, but it is a check nobody can run.
The badge, if this is your listing
It renders the current rung (static scanned) and links back here, where what that does and does not establish is one click away. It updates itself as the evidence deepens.
[](https://ooruby.com/market/crawlie)About this listing
- Kind
- MCP server
- Category
- Research
- Pricing
- Free
- Sandbox
- No
- Hosted
- No
- Updated
- 2026-10-06
Similar MCP servers
All MCP serversLets your agent search the web and recent news through DuckDuckGo, filtered by region and time.
Lets your agent search the web, extract page content, map a website's structure and crawl sites.
Verification records what our published tests found on a specific version at a specific date. It is not a warranty, and it does not certify that software is free of defects.