Skip to content
Albright Labs

Free Audit · Crawlability

Why is Google not indexing your pages?

Before a search engine can rank a page it has to reach it, read it, and decide it is the real version. Most indexing problems are a failure at one of those three, and none of them show up in your content. This audit finds them.

  • What your robots.txt actually allows and blocks
  • Pages no internal link points to, which crawlers may never find
  • Redirect chains and canonical chains
  • URL structure, and whether your sitemap is discoverable

Run your free audit

Two fields. We send your crawlability report by email.

Free, no account required. We use your email only to send your report and follow up about your results.

What this is

Presence is the SEO audit. Behavior is this one.

There is deliberate overlap between this and our SEO audit, so it is worth being clear about the split. The SEO audit tells you whether a robots.txt and a sitemap exist, and whether your pages declare a canonical. It is checking that the parts are there.

This audit reads what those files actually say, and whether your own internal links let a crawler reach every page you publish. A site can pass every presence check and still have a robots rule blocking a whole section, a canonical pointing at the wrong page, or two hundred pages nothing links to. Those are the failures that keep good content out of the index, and they are invisible until you go looking.

One honest limit: orphan pages are a property of the crawl as much as the site. We follow links from your homepage, so if we stop at our page limit, pages beyond that boundary can look unreachable when they are not. Your report says when that happened, and the score already allows for it.

How it works

From URL to report.

01

Enter your URL

Your site address and your email. That is the whole form.

02

We follow your links

We crawl outward from your homepage the way a search engine does, and read your robots.txt and sitemap.

03

Get your report

A score per check, plus every orphan page, redirect and URL problem we found.

Common questions

Crawlability FAQs

The SEO audit checks that the parts exist: a robots.txt, a sitemap, a canonical on the page. This one reads what they say and whether your links actually let a crawler reach everything. A site can pass every presence check and still have a robots rule hiding a whole section.

A page nothing on your site links to. It may be in your sitemap and it may load perfectly, but a crawler following links will never arrive at it, and neither will a visitor browsing your site. They usually appear after a redesign, when a page survives but the thing that linked to it does not.

Then check whether the report says the crawl hit its page limit. We follow links outward from your homepage, so a page beyond where we stopped can look unreachable when it is not. The score already softens the penalty when that happens, and the report tells you.

Every hop costs time for a visitor and a little authority in search. One redirect is fine and normal. Three or four in a row usually means several site migrations layered on top of each other, and it is worth flattening while anyone still remembers why they exist.

Up to twenty, the widest of our focused audits. Orphan detection needs the link graph rather than individual pages, so a wider crawl gives a more honest answer here than it would for, say, a mobile test.

No. It finds the mechanical reasons a crawler cannot reach or trust a page, which are the ones you can fix. Whether Google chooses to index a page it can reach is a judgment about quality and duplication that no tool can promise you.

Crawlability Audit

Want your pages actually found?

Most of what this finds comes from a migration nobody finished. We do the finishing, and the SEO work that follows it.

Talk to us

A senior engineer reads it and replies within one business day.