PremierCodeBot

The web crawler operated by Premier Code, Inc.

PremierCodeBot visits small business websites to produce a technical quality report — page speed, mobile layout, SEO basics, broken links, security headers, and accessibility. We use those reports when we talk to a business about rebuilding or maintaining their site, and we give the report to the business owner when they ask for it.

The bot reads publicly available pages only. It does not submit forms, create accounts, attempt logins, make purchases, or try to reach anything behind a password.

How to identify it

Every request carries this exact user agent:

PremierCodeBot/1.0 (+https://premiercodeinc.com/bot.html)

Every request is also cryptographically signed, so you can verify it is ours no matter what address it came from. We implement Web Bot Auth: each request carries Signature, Signature-Input and Signature-Agent headers, signed with an Ed25519 key whose public half is published at /.well-known/http-message-signatures-directory.

A request claiming to be PremierCodeBot without a signature that verifies against that key is not us, and you should feel free to block it.

Traffic currently originates from 167.99.50.162 and 161.35.189.152, but treat the signature as authoritative rather than the addresses — these are cloud instances and can change.

How it behaves

  • It obeys robots.txt. We request /robots.txt before anything else and do not fetch paths it disallows for our user agent or for *. A site that disallows us is not evaluated at all.
  • It obeys Crawl-delay. If your robots.txt declares one, we wait that long between requests and stop requesting pages in parallel.
  • It is small. A single evaluation reads at most 20 pages of a site, at most 5 at a time, and then stops. We do not continuously re-crawl.
  • It backs off. On an HTTP 429 we honor Retry-After, fall back to one request at a time, and abandon the evaluation rather than keep pushing.
  • It takes no for an answer. If a site refuses our request, we record the refusal and move on. We do not retry under a different identity, rotate addresses, or disguise the crawler as a browser.

What we do with the content

Page content is used to produce the quality report for that one site and is not retained. What we store is the report itself: scores, detected platform and hosting, and a list of findings. We do not keep a copy of your pages.

We do not use crawled content to train or fine-tune machine learning models, we do not sell it, and we do not republish it. A report summarizing a site is shown only to our own staff and to that site's owner.

How to block it

Add this to your robots.txt and we will stop:

User-agent: PremierCodeBot
Disallow: /

You can also email us and we will add your domain to a permanent exclusion list, no questions asked. Blocking the bot has no effect on anything else we do, and we will not contact you about your website afterwards.

Who operates it

Premier Code, Inc. has built, hosted, and maintained websites for small businesses since 2010.

Questions, complaints, or removal requests: bot@premiercodeinc.com. We answer removal requests within two business days.