What crawlers see: SEO and AI crawler checker

Description

Check any page for JavaScript SEO: words crawlers miss, noindex, canonical, robots.txt, and AI bots like GPTBot that are blocked. Click the icon, or press Alt+Shift+C, to see what a search or AI crawler gets from the page you are on. Most AI crawlers do not run JavaScript. Googlebot runs it later, on a queue. If a site builds its text in the browser, crawlers can get an empty page while you see a full one. This extension fetches the page again the way a crawler does, without cookies and without running scripts, and puts the two side by side. For the page in the open tab it shows: 1. Words a crawler reads without JavaScript, next to the words a visitor sees 2. Nine checks: text, noindex in the page or the X-Robots-Tag header, robots.txt rules for Googlebot, title, meta description, canonical, H1, followable links and iframes 3. Which AI companies the site's robots.txt blocks across 21 crawlers, split into AI search (ChatGPT search, Claude, Perplexity) and training (GPTBot, ClaudeBot, CCBot) 4. The page as it would appear in search results, and the raw text a crawler reads Copy the whole report as Markdown to paste into a ticket or a client audit. The panel reopens on the tab you used last. Everything runs in your browser. The extension sends nothing to Pagerender or anyone else, needs no account, and only reads a page when you open it. To check every page in a sitemap, the panel gives you one command for the free Pagerender CLI. Built by Pagerender, which serves crawlable HTML to 47 search and AI crawlers. https://pagerender.io

Details & SEO