Screaming Frog: the crawler for technical SEO audits
Screaming Frog SEO Spider is a crawler that runs on your computer. It crawls a site page by page like Googlebot and shows every URL, status code, meta tag, redirect and internal link in a table.
- Type
- Desktop crawler
- Price
- Free up to 500 URLs, annual licence
- Platform
- Windows, macOS, Linux
- Made by
- Screaming Frog (UK)
What is Screaming Frog?
Every technical SEO audit starts with a crawl. Screaming Frog finds broken links, redirect chains, duplicate titles, pages blocked from the index and canonical errors in minutes.
With JavaScript rendering and the GA4 and Search Console API integrations you can join crawl data with traffic: you see which broken page really loses traffic, and priorities become clear.
What Screaming Frog makes possible
Broken links and 404s
Every faulty URL in one list.
Redirect audit
301s, 302s and chains.
Meta and headings
Empty, long and duplicate titles and descriptions.
Canonicals and indexing
Conflicts between noindex, canonical and robots.
JavaScript rendering
Seeing single-page apps as Google does.
Custom extraction
Extracting any element from a page.
What Screaming Frog works with
- Open the guide
Google Search Console
Your site's visibility in Google Search, indexing and queries.
- Open the guide
Google Analytics 4
Event-based web and app analytics. Funnels, conversions and audiences.
- Open the guide
Semrush
An SEO and advertising platform for keywords, competitors and site audits.
- Open the guide
Ahrefs
An SEO platform with a backlink database, keyword and competitor analysis.
- Open the guide
WordPress
The most widely used CMS. Blogs, corporate sites and e-commerce.
My experience
Projects where I used Screaming Frog:
- [Project: brand, what I built, result %]
- [Project: brand, what I built, result %]
Screaming Frog resources
SEO audit
Technical, on-page and content audit with a 90-day plan.
from about 800 AZN
Questions about Screaming Frog
Is Screaming Frog free?
It is free up to 500 URLs. Large sites and extra features need an annual licence.
How do I crawl a large site?
With database storage mode and enough RAM you can crawl hundreds of thousands of URLs.
Does a crawl slow the site down?
You can set a speed limit. On a live site I crawl in the evening and at a limited rate.