Aug 21
16
Gary Illyes from Google posted on Reddit that he is looking for examples of where GoogleBot might not be behaving. Specifically he wants examples of “cases where refresh crawls are going nuts.” I assume this means where Googlebot is recrawling pages in a very aggressive manner.
Here is the original post:
Google Looking For Examples Of GoogleBot Refresh Crawl Surges