Crawler
About SEOHeroBot
SEOHeroBot is the crawler of SEOHero (seohero.app), operated by Fourwrd V.O.F. It identifies itself with the user-agent string below and fetches pages to check them for search-engine optimisation.
SEOHeroBot/1.0 (+https://seohero.app/bot)
What it does
For the websites of our customers, on their request, the bot runs an SEO audit: it fetches the homepage, up to ten internal pages linked from the homepage or listed in the sitemap, robots.txt and sitemap.xml, and checks up to forty internal links for error codes. Audits run once a week per website and when the customer starts one. For a competitor comparison or a sales check, the bot only fetches the homepage, robots.txt and sitemap.xml of a site.
How it behaves
The bot reads your robots.txt and respects Disallow rules for the user-agent SEOHeroBot (or *) for every page beyond a customer's own homepage; a Disallow: / stops the scan of any site that is not our customer's own. It fetches at most three pages at a time, waits at most ten seconds per page, sends no cookies, submits no forms and stores the HTML only as long as needed for the analysis.
Blocking the bot
Add the following lines to your robots.txt to keep SEOHeroBot away from your site, or from specific paths:
User-agent: SEOHeroBot Disallow: /
Do you not want your site to be fetched at all, not even at the request of one of our customers? E-mail us and we will exclude the domain.
Contact
Questions or complaints about the crawler: contact@fourwrd.nl, Fourwrd V.O.F., De Nieuwe Erven 3, 5431 NV Cuijk, the Netherlands.