About CrawlmaticsBot
CrawlmaticsBot is the crawler behind Crawlmatics, a website performance, SEO and monitoring platform. It only visits a website when someone in a Crawlmatics account starts a scan of it.
How it identifies itself
User agent: CrawlmaticsBot/1.0 (+https://crawlmatics.com/bot.html). With the browser check on, pages are also loaded in headless Chrome with (browser check) added to the user agent.
How it behaves
It respects robots.txt by default (rules for CrawlmaticsBot or *), including Crawl-delay. Requests are rate-limited (2 per second by default), it slows down and backs off when a site answers 429 or a firewall blocks it, and it stops a scan early if blocking continues. It only requests public addresses and does not submit forms or log in.
Blocking or allowing it
To block it, add this to your robots.txt:
User-agent: CrawlmaticsBotDisallow: /
To allow it through a firewall (for example AWS WAF bot control) so your own scans work, allow the user agent above, placed before bot-control and rate-based rules.