SR
This page is currently in the test phase. All the content you see here is for demonstration purposes only.
Remark R3

The domain is blocked by robots.txt

The requested domain denies us access via robots.txt.

When checking the domain, it was determined that our access is denied via the robots.txt file.

Description

Various regulations must be observed when creating new reports. This includes rejecting reports for domains that deny us access via the robots.txt file.

How to fix

If you believe that access is being denied incorrectly, please check the following settings:

  • The /robots.txt file should not contain any deny-rules for User-agent: SetupReportAnalyzerBot.
  • The target URL of the report should not contain an X-Robots-Tag header that denies us access.