The free Screaming Frog crawler, and the 500-URL line

The short answer

The free Screaming Frog SEO Spider is a full desktop crawler limited to 500 URLs per crawl, not a stripped-down trial. For a site of a few hundred pages that is the whole job, and it costs nothing.

The vendor states the offer and the upgrade in one sentence on its own page: "Download & crawl 500 URLs for free, or buy a licence for €245 Per Year to remove the limit."

Screaming Frog runs no affiliate programme of any kind, so this post earns Searchbench nothing whatever you do next. That is worth stating at the top rather than the bottom.

What a crawler is for, if you have never used one

A crawler starts at your homepage, follows every link it finds, and records what came back from each address. It is the only tool that sees your site the way a search engine's robot does rather than the way your browser does.

What it surfaces, in the order it usually matters:

• pages returning errors or redirecting through chains of other pages
• links pointing at addresses that no longer exist
• missing, duplicated or over-long titles and meta descriptions
• pages with no internal links pointing at them, which search engines may never reach
• canonical tags pointing somewhere unexpected
• images with no alternative text

None of that requires a subscription for a small site, and almost all of it is invisible from inside a content management system, which shows you the pages you meant to publish rather than the addresses that actually exist.

What the free tier includes

The comparison on Screaming Frog's own page is unusually blunt. The free and paid columns list substantially the same capabilities, and the row that differs is the limit: "Crawl Limit - 500 URLs" against "Crawl Limit - Unlimited*". That asterisk carries its own honesty — "The maximum number of URLs you can crawl is dependent on allocated memory and storage", which is to say the paid ceiling is your computer, not a licence key.

That makes the free tier unusual in this category. Most free tiers in SEO software are a sample of the data with the useful part withheld. This one is the product with a counter on it.

Where it stops, precisely

At 500 URLs in a single crawl. Not 500 pages on the site — 500 addresses the crawler reaches, which includes images, stylesheets, scripts and redirects unless you configure it otherwise. A site with 200 pages and a lot of media can hit the cap sooner than its page count suggests.

At crawl configuration. The page lists configuration, saving crawls and the advanced features as things the licence unlocks. In practice that means you cannot narrow a large crawl down to just the section you care about, which is exactly what you would want to do when you are near the limit.

At being a desktop application. It runs on your machine, on demand. There is no schedule, no stored history, no dashboard, and nothing to send a client or a colleague. If you want a crawl that runs itself every week and keeps a record, you want a hosted site-audit tool instead — the audit modules inside the SEO suites do that job, and SE Ranking is the one this site links, with the audit allowance rather than the headline price being the thing to compare.

About that price, and that currency

The licence figure on the page read here was €245 Per Year — euros, not dollars. Screaming Frog serves a currency switcher and quotes different regional price lists, so the number shown to you may not be the number quoted above, and it is not the same product at a converted rate either.

This matters more than it sounds, and it is a general rule worth carrying into every pricing page in this category: a vendor serving you €245 and a vendor serving somebody else $245 are not quoting the same amount, and an article that silently converts one into the other is telling you something nobody published. Nothing on this site converts a currency.

When the free tier is genuinely not enough

Three situations, and only three:

1. The site is past the cap and the important pages are being cut off. If your crawl stops at 500 and everything you are worried about is in the last 2,000 pages, you are not getting an answer.
2. You need the crawl to repeat itself. Monitoring is a different activity from auditing. A one-off crawl finds today's faults; a scheduled one tells you when a deployment broke something.
3. Somebody else needs the output. A client or a manager wants a document, and a desktop application's export is not that.

If none of those applies, the free tier is not a compromise — it is the correct tool, and a subscription would be money spent on scheduling you do not need.

What a crawl will not tell you

Whether any of it matters. A crawler produces a list of technical facts about your site, and a large site will always produce hundreds of them. Most are harmless.

It also tells you nothing about search results. It does not know whether a page is indexed, what it ranks for, or whether anyone looked at it — those questions belong to Google Search Console, which is free and is the first thing to set up. A crawler and a webmaster account answer two of the six jobs SEO tools exist to do, and confusing them is how people end up fixing 400 alt-text warnings on a page nothing links to.

The instinct to act on every row in a crawl report is the most expensive habit this tool creates. Fix what a person would notice. Leave the rest.

How to get a useful crawl on the first try

Point it at the homepage, let it finish, then read the results in this order:

1. Response codes. Anything that is not a 200 or a deliberate redirect. Broken internal links first, because you control both ends of those.
2. Page titles. Missing ones, duplicated ones, and ones that got truncated. This is the highest-value column in the whole report for a small site.
3. Meta descriptions. Same three checks. Duplicates usually mean a template is not filling a field.
4. Canonicals. Look for pages declaring a canonical address that is not themselves and is not what you intended.
5. Everything else. Later, or never.

Doing those four properly on a small site takes an afternoon and finds more than the first month of most subscriptions.

Next, if your site runs on WordPress, the other free-versus-paid decision worth understanding is what the four main SEO plugins cost in year two — a category where one vendor's advertised price doubles at renewal and says so in small type.