This published overview needs review. Verified catalogue facts changed; review dependent conclusions.
SiteOne Crawler
SiteOne Crawler is a website analyzer, cloner and converter aimed at developers, SEO specialists and site owners who want audit insights, optimization opportunities or offline copies.
- Verified facts
- 6
- Offers
- 1
- Sources
- 1
- Pricing
- Free offer
Overview
What SiteOne Crawler covers
The README describes SiteOne Crawler as a website analyzer, cloner and converter for developers, SEO specialists and website owners. It crawls a whole site, reports status codes, response times, sizes and titles, and flags 404s, redirects, SEO and security issues. It produces HTML, JSON and text reports, a quality score across five categories that includes SEO, a CI quality gate, sitemap files, offline clones and markdown exports.
Read the full editorial overview
Licence and running it
The README states the MIT licence. It is delivered as a single native binary for Windows, macOS and Linux, through package managers such as Homebrew and apt, or built from source with Rust. It offers an interactive wizard, a command line and a separately hosted desktop GUI. An optional AI assistant needs a model provider you configure. The README does not discuss pricing.
Maintenance and what is not established
This capture follows release v2.5.1, published on 27 June 2026. The default branch has since been changed, last on 27 September 2026, so the current README may differ. The repository is not archived. Nothing was installed or tested for this profile, and SEO is one of several analyzers rather than the only focus.
Sources
SiteOne Crawler: siteone-crawler-project · Evidence: documentation · Not checked
Plans & prices
Prices as listed by SiteOne Crawler, before any tax or fee the pricing page does not state.
Scroll the table sideways for every column.
| Plan | Rate period not stated | Coverage limits | Sites |
|---|---|---|---|
| Plan: Self-hosted | FreeTax: Confirm at checkoutUpfront: not established ConditionsDated publisher project README captured on 9 November 2026 (release v2.5.1, commit 12b4916); supplier description, not a deployment or independent test. Applies to the MIT-licensed crawler you download and run on your own machine or CI runner. Infrastructure, accounts and third-party services, including an LLM provider key if you turn on the optional AI assistant, have separate costs and terms. | By default a crawl keeps at most 10,000 visited URLs, 10,000 skipped URLs and a waiting queue of 9,000 URLs; all three limits can be changed.ConditionsDated publisher project README captured on 9 November 2026 (release v2.5.1, commit 12b4916); supplier description, not a deployment or independent test. Defaults of the command-line options --max-queue-length, --max-visited-urls and --max-skipped-urls; the README does not state a hard maximum. Not tested on a large site. | A crawl can start from a plain-text list of URLs that may span several hosts; links found from those URLs stay limited to the base domain.ConditionsDated publisher project README captured on 9 November 2026 (release v2.5.1, commit 12b4916); supplier description, not a deployment or independent test. Description of the --url-list option; listed URLs are fetched directly, so robots.txt and the include/ignore regular expressions do not apply to them. No crawl was run. |
Documented facts
Each fact comes from official documentation and shows when it was verified.
Who it is for
SiteOne Crawler is a website analyzer, cloner and converter aimed at developers, SEO specialists and site owners who want audit insights, optimization opportunities or offline copies.
Coverage limits
On Linux the primary SiteOne Crawler binary requires glibc 2.39 or newer, while a statically linked musl build runs on any Linux distribution but is slower.
Sites
Other domains, such as language versions on separate domains, can be crawled when you list them with --allowed-domain-for-crawling; with --single-foreign-page only the linked page and its assets are crawled from those foreign domains.
Dated publisher project README captured on 9 November 2026 (release v2.5.1, commit 12b4916); supplier description, not a deployment or independent test. Description of two command-line options; the README does not state a limit on the number of allowed domains. No crawl was run.
Applies to the facts above: Dated publisher project README captured on 7 November 2026; supplier description, not a deployment or independent test. Infrastructure, accounts, third-party services and managed offerings have separate costs and terms.
Not confirmed in our sources
We have not confirmed these terms for SiteOne Crawler in the linked documentation. That does not mean SiteOne Crawler lacks them; confirm them before you rely on them.
- Engines
- Projects
Sources & methodology
Facts come from the linked documentation. Documentation checks are not hands-on tests, and readable sources can have incomplete coverage.
Discovered an undocumented discrepancy or pricing shift? Submit a correction request.
Submit correctionSiteOne Crawler alternatives
Other SEO tools to weigh. Different billing units do not establish a cost winner, so compare plans side by side.
Yoast SEO
SEO
A WordPress plugin for search optimization.
PricingFree plan availablePrice terms
Free plan · paid prices not verified
Rank Math
SEO
A WordPress SEO plugin.
PricingFree plan availablePrice terms
Free plan · paid prices not verified
Slim SEO
SEO
Slim SEO describes a WordPress plugin that generates metadata, sitemaps and schema.
Documented price59.00/yr (currency not stated)Price terms
Documented price: 59.00/yr (currency not stated) · Plan: Slim SEO Pro Personal · billed annually · commitment not established
SiteOne Crawler comparisons
Compare two products in the same category using their documented terms and sources.
- SiteOne Crawler vs bisibility
- SiteOne Crawler vs Coywolf SEO
- SiteOne Crawler vs CrawlObserver
- SiteOne Crawler vs crawlseo
- SiteOne Crawler vs FreeCrawl SEO Tool
- SiteOne Crawler vs LibreCrawl
- SiteOne Crawler vs LW SEO
- SiteOne Crawler vs OpenSEO
- SiteOne Crawler vs Open SEO Crawler
- SiteOne Crawler vs Rank Math
- SiteOne Crawler vs RankMeFast
- SiteOne Crawler vs SearchMirror
- SiteOne Crawler vs SEOnaut
- SiteOne Crawler vs SEOPress
- SiteOne Crawler vs SerpBear
- SiteOne Crawler vs Slim SEO
- SiteOne Crawler vs SmartCrawl SEO
- SiteOne Crawler vs The SEO Framework
- SiteOne Crawler vs Yoast SEO