Aug 12
16
When you block GoogleBot, Google’s web crawler, the page that is blocked can still show up in the Google search results because of links pointing to the page. When that happens, the search listing looks awkward, because Google isn’t able to crawl the page. In this case, Google will make…
Read more here:
Google Search Descriptions Now Say If GoogleBot Is Blocked