Skip to content
LaunchGraded
Crawler

About LaunchGradedBot.

The crawler behind every LaunchGraded scan. It only runs when someone submits a URL, and it identifies itself.

What it does

When someone submits a URL, LaunchGradedBot loads that one page in a headless browser the way a first-time visitor would, reads its HTML and metadata, fetches your robots.txt, and makes one request to a random path to check you return a real 404. Google's PageSpeed Insights runs Lighthouse separately with its own crawler.

It never logs in, submits forms, follows links across your site, or reads anything behind authentication. It downloads at most 10 MB per page and gives up after a fixed time.

How it identifies itself

Every request carries this User-Agent:

Mozilla/5.0 (compatible; LaunchGradedBot/1.0; +https://launchgraded.com/bot)

Blocking it

LaunchGradedBot respects robots.txt. To stop it scanning your site, add:

User-agent: LaunchGradedBot
Disallow: /

A scan of a site that disallows us stops immediately and tells the person who requested it that the site owner has opted out.

Allowing it

If your robots.txt blocks all crawlers by default but you want to be scored, add an explicit allow:

User-agent: LaunchGradedBot
Allow: /
Seeing traffic from LaunchGradedBot you didn't ask for? Anyone can score any public URL, so someone may have scanned your site. If it's misbehaving, tell us and include the timestamp.