Nov 23
16
Google announced a new robots.txt report within Google Search Console and at the same time said it will sunset the old robots.txt tester tool. The new tool shows which robots.txt files Google found for the top 20 hosts on your site, the last time they were crawled, and any warnings or errors encountered.
Follow this link:
New Google Search Console Robots.txt Report Replaced Robots.txt Tester Tool