Crawler
RulerIQBot
RulerIQBot is the fetcher behind the RulerIQ grader. It reads a public website when someone asks RulerIQ to grade that domain. It is not a general-purpose crawler.
How to recognise it
User-Agent: RulerIQBot/0.1 (+https://ruleriq.com/bot)
What it requests
- Only the domain a RulerIQ user submitted, and only when they submit it. It does not follow links to other sites.
- A small, fixed set of URLs on that domain: the homepage,
/robots.txt,/llms.txt,/sitemap.xml,/sitemap-index.xml,/sitemap-0.xmland/pricing. It does not crawl the rest of your site. - Plain GET requests over HTTPS to public addresses, up to 3 redirects, with a 2 MB response limit and a short timeout.
/robots.txtis fetched first; the other pages follow, gated by its rules. We cache results, so repeat checks of the same domain within a week are served from cache.
robots.txt
RulerIQBot honors your robots.txt. It always fetches /robots.txt first, then applies your rules for RulerIQBot (or the general * rules) before requesting any other page on your domain. Disallowed pages are skipped; if your rules block the whole site, the check reports that it is blocked instead of fetching. It also reads llms.txt so the grader can report whether AI engines are allowed to read your site. If you would rather it did not request your domain at all, tell us and we will stop.
Opt out or report a problem
Email abuse@ruleriq.com with your domain. See also Security.