Dec 16
28
Google’s John Mueller said in a Google Webmaster Help thread that it makes most sense to keep the default setting found within your content management system for your robots.txt access control…
Visit link:
Google: Keep The Default CMS Robots.txt Setting