About our checker
If you saw FutureFirmSiteChecker in your server logs, someone asked FutureFirm Website Check to check your website. Each scan is started by a person who confirmed their email address.
What it does
It reads robots.txt, your sitemap and up to 50 public pages, at no more than one request per second, with a 15 second timeout. It loads pages in a headless browser to compare them with the raw HTML. It never logs in, submits forms or changes anything.
To test whether firewalls treat AI crawlers differently, it also requests your homepage and three other pages using the user agents of OpenAI's and Anthropic's crawlers and a normal browser. Those requests come from our servers, not from OpenAI or Anthropic.
Opting out
Because a person starts each scan, our checker does not follow robots.txt rules meant for other crawlers. To stop all scans of your domain, email hello@futurefirm.example and we will add it to our blocklist.