Evidence checked Nov 11, 2026

This published overview needs review. Verified catalogue facts changed; review dependent conclusions.

Verified Nov 11, 2026 via SiteOne Crawler: siteone-crawler-projectSEO

SiteOne Crawler

SiteOne Crawler is a website analyzer, cloner and converter aimed at developers, SEO specialists and site owners who want audit insights, optimization opportunities or offline copies.

Verified facts
6
Offers
1
Sources
1
Pricing
Free offer

Overview

What SiteOne Crawler covers

The README describes SiteOne Crawler as a website analyzer, cloner and converter for developers, SEO specialists and website owners. It crawls a whole site, reports status codes, response times, sizes and titles, and flags 404s, redirects, SEO and security issues. It produces HTML, JSON and text reports, a quality score across five categories that includes SEO, a CI quality gate, sitemap files, offline clones and markdown exports.

Read the full editorial overview

Licence and running it

The README states the MIT licence. It is delivered as a single native binary for Windows, macOS and Linux, through package managers such as Homebrew and apt, or built from source with Rust. It offers an interactive wizard, a command line and a separately hosted desktop GUI. An optional AI assistant needs a model provider you configure. The README does not discuss pricing.

Maintenance and what is not established

This capture follows release v2.5.1, published on 27 June 2026. The default branch has since been changed, last on 27 September 2026, so the current README may differ. The repository is not archived. Nothing was installed or tested for this profile, and SEO is one of several analyzers rather than the only focus.

Sources

SiteOne Crawler: siteone-crawler-project · Evidence: documentation · Not checked

Plans & prices

Prices as listed by SiteOne Crawler, before any tax or fee the pricing page does not state.

Scroll the table sideways for every column.

PlanRate period not statedCoverage limitsSites
Plan: Self-hosted
FreeTax: Confirm at checkoutUpfront: not established
ConditionsDated publisher project README captured on 9 November 2026 (release v2.5.1, commit 12b4916); supplier description, not a deployment or independent test. Applies to the MIT-licensed crawler you download and run on your own machine or CI runner. Infrastructure, accounts and third-party services, including an LLM provider key if you turn on the optional AI assistant, have separate costs and terms.
Unknown fees: Infrastructure and third-party servicesVerified Nov 19, 2026
By default a crawl keeps at most 10,000 visited URLs, 10,000 skipped URLs and a waiting queue of 9,000 URLs; all three limits can be changed.
ConditionsDated publisher project README captured on 9 November 2026 (release v2.5.1, commit 12b4916); supplier description, not a deployment or independent test. Defaults of the command-line options --max-queue-length, --max-visited-urls and --max-skipped-urls; the README does not state a hard maximum. Not tested on a large site.
Verified Nov 10, 2026
A crawl can start from a plain-text list of URLs that may span several hosts; links found from those URLs stay limited to the base domain.
ConditionsDated publisher project README captured on 9 November 2026 (release v2.5.1, commit 12b4916); supplier description, not a deployment or independent test. Description of the --url-list option; listed URLs are fetched directly, so robots.txt and the include/ignore regular expressions do not apply to them. No crawl was run.
Verified Nov 11, 2026

SiteOne Crawler: siteone-crawler-project

Documented facts

Each fact comes from official documentation and shows when it was verified.

  • Who it is for

    SiteOne Crawler is a website analyzer, cloner and converter aimed at developers, SEO specialists and site owners who want audit insights, optimization opportunities or offline copies.

    Verified Nov 7, 2026 · SiteOne Crawler: siteone-crawler-project

  • Coverage limits

    On Linux the primary SiteOne Crawler binary requires glibc 2.39 or newer, while a statically linked musl build runs on any Linux distribution but is slower.

    Verified Nov 7, 2026 · SiteOne Crawler: siteone-crawler-project

  • Sites

    Other domains, such as language versions on separate domains, can be crawled when you list them with --allowed-domain-for-crawling; with --single-foreign-page only the linked page and its assets are crawled from those foreign domains.

    Dated publisher project README captured on 9 November 2026 (release v2.5.1, commit 12b4916); supplier description, not a deployment or independent test. Description of two command-line options; the README does not state a limit on the number of allowed domains. No crawl was run.

    Verified Nov 10, 2026 · SiteOne Crawler: siteone-crawler-project

Applies to the facts above: Dated publisher project README captured on 7 November 2026; supplier description, not a deployment or independent test. Infrastructure, accounts, third-party services and managed offerings have separate costs and terms.

Not confirmed in our sources

We have not confirmed these terms for SiteOne Crawler in the linked documentation. That does not mean SiteOne Crawler lacks them; confirm them before you rely on them.

  • Engines
  • Projects

Sources & methodology

Facts come from the linked documentation. Documentation checks are not hands-on tests, and readable sources can have incomplete coverage.

Retrieved Nov 11, 2026

Discovered an undocumented discrepancy or pricing shift? Submit a correction request.

Submit correction

SiteOne Crawler alternatives

Other SEO tools to weigh. Different billing units do not establish a cost winner, so compare plans side by side.

SiteOne Crawler comparisons

Compare two products in the same category using their documented terms and sources.