Dec 20
8
Google’s John Mueller said on Twitter that if he had to simplify crawling priority, how Google prioritizes how it crawls the web, it would not do so by the size of a site. Instead, he would prioritizes how it crawls the web based on “the additional unique & important value provided by the pages.”
Excerpt from:
Google Crawl Priority: Additional Unique & Important Value Of Page