ButteredScoreBot
When someone runs a free Butter Score audit on a website, ButteredScoreBot fetches that site's homepage and four public files. Here's exactly what it does, and how to opt out.
On this page
-
What it fetches
No more than five requests per audit, one at a time: /robots.txt first, the page that was entered, one sitemap, /llms.txt and one made-up page address to check that your site returns a proper "not found" response. Redirects count toward the five. That's it.
-
When it runs
Only when a person asks our free audit tool to check a specific website. Results are cached for 24 hours, and no site is audited more than 10 times a day, no matter who asks.
-
What it never does
It never logs in, submits forms, probes admin or private paths, scans ports or tests for vulnerabilities.
-
Speed test
The speed score comes from Google PageSpeed Insights, which loads the page from Google's own servers.
-
How to opt out
Add a ButteredScoreBot group to your robots.txt, as shown below, and the audit will skip your site.
ButteredScoreBot is the small, polite fetcher behind the free Butter Score website audit from Buttered Business. It runs only when a person asks us to audit a specific website, and it reads just enough to score that site’s SEO, technical health, mobile and lead-capture basics, and AI search readiness.
How to recognize it
Every request it makes carries this user agent string:
ButteredScoreBot/1.0 (+https://butteredbusiness.com/butter-score-bot/)When it visits
- Only when someone enters a website address in our free audit tool. It doesn’t crawl the web, follow links from page to page or come back on a schedule.
- Results are cached for 24 hours, so repeat requests for the same address within a day are answered from our cache instead of your server.
- No single website is audited more than 10 times a day, no matter who asks.
What it requests
Each audit makes no more than five requests to your site, one at a time:
/robots.txt, read first so your rules are respected.- The page that was entered, usually your home page, following up to three redirects.
- Your XML sitemap, if it can find one: the sitemap listed in your robots.txt, or a standard location such as
/sitemap.xml. /llms.txt, if you have one.- One made-up address, such as
/bb-404-check-1a2b3c4d, to confirm your site returns a proper “page not found” response.
Redirects and sitemap lookups count toward that five-request limit, so if your page redirects, the audit skips the last items on the list instead of making extra requests. Each request times out after 10 seconds. It reads at most 3 MB of your page and 500 KB of each other file. It never fills out forms, logs in, sends cookies, runs your JavaScript or downloads images and videos.
About the speed test
When an audit includes a speed score, that test is run by Google PageSpeed Insights from Google’s own servers, using Google’s tools and user agent. It isn’t ButteredScoreBot, so rules you write for ButteredScoreBot don’t apply to it.
How to block it
ButteredScoreBot reads your robots.txt before anything else and follows the rules written for it. To opt your whole site out of audits, add this to your robots.txt:
User-agent: ButteredScoreBot
Disallow: /With that rule in place, the audit stops before it requests any of your pages.
What we do with what it reads
We use what ButteredScoreBot reads only to calculate the audit: scores, pass-or-fail checks and recommendations for the person who requested it. We don’t publish your content, build a search index from it or use it to train AI models.
Questions or concerns
If ButteredScoreBot is causing a problem for your site, email [email protected] or contact us and include your domain. We’ll look into it right away.
Questions about ButteredScoreBot: [email protected]