VettleyBot
VettleyBot is the automated tool that checks business websites for Vettley signal reports.
What it does
- Loads a business's homepage once per check, plus robots.txt.
- Checks the security certificate and whether the page is set up for phones.
- Looks up the domain's public registration date.
It identifies itself with the user agent VettleyBot/1.0 (+https://www.vettley.com/bot/). It does not fill in forms, log in or crawl beyond the homepage.
How to opt out
VettleyBot respects robots.txt. To ask it not to visit your site, add this to your robots.txt file:
User-agent: VettleyBot Disallow: /
Signals we can't check are left out of the score rather than counted against you. To have a report removed instead, send a removal request.