SEO · guide

Screaming Frog: the crawler for technical SEO audits

Screaming Frog SEO Spider is a crawler that runs on your computer. It crawls a site page by page like Googlebot and shows every URL, status code, meta tag, redirect and internal link in a table.

Type
Desktop crawler
Price
Free up to 500 URLs, annual licence
Platform
Windows, macOS, Linux
Made by
Screaming Frog (UK)

What is Screaming Frog?

Every technical SEO audit starts with a crawl. Screaming Frog finds broken links, redirect chains, duplicate titles, pages blocked from the index and canonical errors in minutes.

With JavaScript rendering and the GA4 and Search Console API integrations you can join crawl data with traffic: you see which broken page really loses traffic, and priorities become clear.

What Screaming Frog makes possible

  1. Broken links and 404s

    Every faulty URL in one list.

  2. Redirect audit

    301s, 302s and chains.

  3. Meta and headings

    Empty, long and duplicate titles and descriptions.

  4. Canonicals and indexing

    Conflicts between noindex, canonical and robots.

  5. JavaScript rendering

    Seeing single-page apps as Google does.

  6. Custom extraction

    Extracting any element from a page.

What Screaming Frog works with

  • Google Search Console

    Your site's visibility in Google Search, indexing and queries.

    Open the guide
  • Google Analytics 4

    Event-based web and app analytics. Funnels, conversions and audiences.

    Open the guide
  • Semrush

    An SEO and advertising platform for keywords, competitors and site audits.

    Open the guide
  • Ahrefs

    An SEO platform with a backlink database, keyword and competitor analysis.

    Open the guide
  • WordPress

    The most widely used CMS. Blogs, corporate sites and e-commerce.

    Open the guide

My experience

Projects where I used Screaming Frog:

  • [Project: brand, what I built, result %]
  • [Project: brand, what I built, result %]
See the cases

Screaming Frog resources

  • SEO audit checklist

  • Show revenue, not rankings, in your SEO report

  • Google Search Console guide

  • Service

    SEO audit

    Technical, on-page and content audit with a 90-day plan.

    from about 800 AZN

Questions about Screaming Frog

Is Screaming Frog free?

It is free up to 500 URLs. Large sites and extra features need an annual licence.

How do I crawl a large site?

With database storage mode and enough RAM you can crawl hundreds of thousands of URLs.

Does a crawl slow the site down?

You can set a speed limit. On a live site I crawl in the evening and at a limited rate.

Other tool guides