Media
3 items
Description
Can AI crawlers read this site? Check robots.txt, llms.txt, structured data and its place in the recomention AI rankings. See in one click whether AI search and answer engines can read a website. Open any site, click the icon, press "Check this site". What it checks, with the evidence it saw: • robots.txt rules for the major AI crawlers, with the exact rule that allows or blocks each one • llms.txt • the sitemap • structured data (JSON-LD) on the home page • page title and meta description • noindex • how much text is in the HTML before JavaScript runs It also shows where the site sits in the public recomention AI rankings, if it's in a category's top five. Signed in to recomention? Your reports for the site you're on appear in the popup. Developers can use an API key instead. Honest about its limits: it checks from your browser, not as a crawler, and anything it can't fetch says "could not fetch", never "missing". A crawler being allowed is a precondition, not a recommendation. To find out whether AI engines actually recommend a product, the full report asks them. Private by design: it reads a site only when you press the button, never tells us which site you're on, and has no analytics. Pressing the button costs nothing and sends nothing to any AI provider.