Pages missing from my report
Pages go missing from a Rubric report for four main reasons: the crawl hit the 500-page Free limit, the page is not linked internally and not in your sitemap so Rubric never found it, the file is a non-HTML machine file that Rubric does not score as a page, or the page is set to noindex.
- →The Free plan audits up to 500 pages per crawl; a larger site is capped at 500, and Pro lifts that cap.
- →Rubric finds pages by following internal links and reading your sitemap; orphan pages are not found.
- →Machine files (.xml, .json, sitemaps, llms.txt) are not scored as pages, and noindex pages are skipped.
How does Rubric decide which pages to include?
Rubric discovers pages by crawling: it starts at your URL, follows the internal links it finds, and reads your XML sitemap. A page it can reach and that is meant to be indexed becomes a scored page in the report. A page that is none of those, unreachable, a machine file, or told not to be indexed, is left out. So a missing page usually means one of a few specific things, below.
Did the crawl hit the 500-page limit?
On the Free plan Rubric audits up to 500 pages in a single crawl. If a free crawl hits that ceiling on a site with more than 500 pages, the remaining pages are not in the report, and this is the most common reason a large site looks incomplete. Pro lifts the 500-page cap, so a Pro crawl covers a larger site in one pass, bounded in practice by the time ceiling. A hard safety ceiling still applies to every crawl, on either plan, as a guard against runaway jobs, so extremely large sites may be crawled in parts.
Is the page linked, or in your sitemap?
Rubric finds pages by following internal links and by reading your XML sitemap. A page that nothing links to and that is not in the sitemap is an orphan page, and Rubric has no way to discover it. To get an orphan page audited:
Internal links are a Known signal in their own right, so linking an orphan page in helps its citability as well as getting it into the report.
Which pages does Rubric skip on purpose?
Some pages and files are left out by design, not by accident:
| Skipped | Why |
|---|---|
| Machine and non-HTML files (.xml, .csv, .json, .kml, sitemaps, llms.txt, agents.md) | These are not web pages, so they are not scored as pages |
| noindex pages | A page told not to be indexed will not be cited, so it is skipped |
| Pages disallowed in robots.txt | Well-behaved crawlers, including Rubric, do not fetch disallowed paths |
| Private or internal hosts | Rubric refuses to crawl non-public hosts by design |
If an important page is set to noindex or disallowed but should be citable, that is worth fixing regardless: an engine cannot quote a page it is told to ignore.
A page is there but scored low, not missing
If a page appears in the report but scores below 70, it is not missing, it is below the line. That is a scoring result, not a crawl problem. Sort your pages worst-first to find these; the related article on finding your weakest pages covers how. Missing means Rubric never scored the page at all; below the line means it scored it and the page needs work.