Oct 24
8
Google added eight or so words between brackets to clarify that fields that aren’t explicitly listed in the robots.txt documentation aren’t supported. Why did they do this? Because sometimes Google gets questions about it.
Original post:
Google Clarified Support For Robots.txt Fields With Tiny Change