May 17
25
There are many ways to control how Google crawls your web site but one of them is not the noindex tag. Google will still crawl your web site and web pages with the noindex tag on them.
Original post:
Google: No Index Is A Directive, It Doesn’t Control Crawling