Jul 19
1
Google’s webmaster channel is on a series of posts every hour around the Robots Exclusion Protocol – in short, an hour ago, Google announced that after 25 years of being a de-facto standard, Google has worked with Martijn Koster, webmasters, and other search engines to make the Robots Exclusion Protocol an official standard.
Read the original post:
Google Works To Make Robots Exclusion Protocol A Real Standard