Who is the SEOScanner bot in my logs?
SEOScanner is the crawler behind the Just In Time AI AI-SEO / AEO scan. If you found this page from your access logs, you saw this User-Agent:
Mozilla/5.0 (compatible; SEOScanner/1.0; +https://www.jitai.co/scanner)What it fetches
SEOScanner is request-driven, not a continuous web crawler. It runs when someone submits a site for a scan on our AI-SEO scan page. It fetches the submitted URL and a bounded set of pages linked from it, reads the HTML the way an AI answer engine would, and stops. It does not re-crawl on a schedule and it does not submit forms or attempt authentication.
Why it visited your site
Either someone at your organization requested a scan of your site, or your site was fetched as part of a scan someone else requested -- for example a comparison against a competitor. The scan reads only publicly available pages.
How to ask us to stop scanning your site
Email [email protected] with the domain you want excluded and we will add it to our exclusion list. Include the hostname exactly as it appears in your logs. You can also block the User-Agent above at your edge or WAF; SEOScanner does not disguise itself or rotate its User-Agent.
Run a scan yourself
The same scan is available for your own site at /ai-seo. It reports how ChatGPT, Claude, Perplexity, and Gemini can read your pages today.
FAQ
What is SEOScanner?
SEOScanner is the crawler behind the Just In Time AI AI-SEO and AEO scan. It is request-driven, not a continuous background crawler, so it only runs when a site is submitted for a scan.
Why did the SEOScanner bot visit my site?
Either someone at your organization requested a scan of your site, or your site was fetched as part of a scan someone else requested, such as a competitor comparison. It only reads publicly available pages.
How do I stop SEOScanner from scanning my site?
Email [email protected] with the domain you want excluded and it will be added to the exclusion list. You can also block the published User-Agent at your edge or WAF; it does not rotate or disguise itself.
What does SEOScanner fetch when it scans a site?
It fetches the submitted URL and a bounded set of linked pages, reads the HTML the way an AI answer engine would, and stops. It does not re-crawl on a schedule and never submits forms or attempts authentication.
Canonical URL for this page: https://www.jitai.co/scanner