Jan 23
17

Google Will Ignore Robots.txt Rules If It Serves A 4xx Status Code

Here is another PSA from Gary Illyes of Google. In short, if you serve a 4xx status code with your robots.txt file, then Google will ignore the rules you have specified in that file.

See more here:
Google Will Ignore Robots.txt Rules If It Serves A 4xx Status Code

This entry was posted on 2023/01/17 at 12:41 pm. You can follow any responses to this entry through the RSS 2.0 feed. Responses are currently closed, but you can trackback from your own site.

Posted in SEO by admin No Comments Yet

Comments are closed.