Google Robots.txt Parser Updated In GitHub

Google has updated its open source robots.txt parser code on GitHub the other day. Gary Illyes from Google pushed the update yesterday morning to the repository there.

Originally posted here:
Google Robots.txt Parser Updated In GitHub

Comments are closed.