MG Marketing » blocking spiders http://mg-mk.com/en Online Marketing Agency Thu, 09 Apr 2026 22:10:34 +0000 http://wordpress.org/?v=2.9.1 en hourly 1 Google Orders Terminator Robots Not To Kill Founders Brin & Page http://mg-mk.com/en/google-orders-terminator-robots-not-to-kill-founders-brin-page/ http://mg-mk.com/en/google-orders-terminator-robots-not-to-kill-founders-brin-page/#comments Thu, 03 Jul 2014 17:09:22 +0000 admin http://mg-mk.com/en/google-orders-terminator-robots-not-to-kill-founders-brin-page/ How do you stop the unstoppable killer Terminators if you’re not Sarah Connor? Google does it with a simple text file. People have noted today that Google has a special “robot.txt” file that pokes fun at stopping the Terminators.

Continued here:
Google Orders Terminator Robots Not To Kill Founders Brin & Page

]]> http://mg-mk.com/en/google-orders-terminator-robots-not-to-kill-founders-brin-page/feed/ 0