MG Marketing » robots.txt http://mg-mk.com/en Online Marketing Agency Fri, 10 Apr 2026 10:52:01 +0000 http://wordpress.org/?v=2.9.1 en hourly 1 X-Robots-Tag: A Simple Alternate For Robots .txt and Meta Tag by @0070chandan http://mg-mk.com/en/x-robots-tag-a-simple-alternate-for-robots-txt-and-meta-tag-by-0070chandan/ http://mg-mk.com/en/x-robots-tag-a-simple-alternate-for-robots-txt-and-meta-tag-by-0070chandan/#comments Tue, 08 Oct 2013 15:00:39 +0000 admin http://mg-mk.com/en/x-robots-tag-a-simple-alternate-for-robots-txt-and-meta-tag-by-0070chandan/ Before moving towards X-Robots-Tag, let’s have a small discussion on Robots. As webmasters, we already know about this term. It allows you to hide pages, folders, sub-domains or any content from a search engine spider.

Visit link:
X-Robots-Tag: A Simple Alternate For Robots .txt and Meta Tag by @0070chandan

]]> http://mg-mk.com/en/x-robots-tag-a-simple-alternate-for-robots-txt-and-meta-tag-by-0070chandan/feed/ 0 Snowden Petition Blocked From Google? Like All Petitions, It Won’t Be When It Gets Enough Signatures http://mg-mk.com/en/snowden-petition-blocked-from-google-like-all-petitions-it-won%e2%80%99t-be-when-it-gets-enough-signatures/ http://mg-mk.com/en/snowden-petition-blocked-from-google-like-all-petitions-it-won%e2%80%99t-be-when-it-gets-enough-signatures/#comments Fri, 28 Jun 2013 13:43:43 +0000 admin http://mg-mk.com/en/snowden-petition-blocked-from-google-like-all-petitions-it-won%e2%80%99t-be-when-it-gets-enough-signatures/ Search for “edward snowden petition” to find the petition filed through the White House’s Petition site, and you’ll see something odd. The petition has no description, because the White House won’t let Google crawl the page. But it’s not a move against Snowden,..

Read more:
Snowden Petition Blocked From Google? Like All Petitions, It Won’t Be When It Gets Enough Signatures

]]> http://mg-mk.com/en/snowden-petition-blocked-from-google-like-all-petitions-it-won%e2%80%99t-be-when-it-gets-enough-signatures/feed/ 0 Removing URLs From The Index In Bulk http://mg-mk.com/en/removing-urls-from-the-index-in-bulk/ http://mg-mk.com/en/removing-urls-from-the-index-in-bulk/#comments Tue, 28 May 2013 13:45:44 +0000 admin http://mg-mk.com/en/removing-urls-from-the-index-in-bulk/ Need to remove URLs from the index? For a small number of URLs, this can be a relatively straightforward process — when you are dealing with thousands or tens of thousands, it can be a lot more complex, especially if you feel a great deal of urgency about the matter. This is what I am Please visit Search Engine Land for the full article.

View post:
Removing URLs From The Index In Bulk

]]> http://mg-mk.com/en/removing-urls-from-the-index-in-bulk/feed/ 0