Accurate, Focused Research on Law, Technology and Knowledge Discovery Since 2002

Publishers Can Now Opt Out of Google News Search Indexing

Google News Blog: “There are more than 25,000 publishers from around the world in Google News today. [With] the new Google News web crawler publishers [can]…keep their content out of Google News and still remain in Google Search…if a publisher wants to opt out of Google News, they don’t even have to contact us – they can put instructions just for user-agent Googlebot-News in the same robots.txt file they have today. In addition, once this change is fully in place, it will allow publishers to do more than just allow/disallow access to Google News. They’ll also be able to apply the full range of REP directives just to Google News. Want to block images from Google News, but not from Web Search? Go ahead. Want to include snippets in Google News, but not in Web Search? Feel free…All this will soon be possible with the same standard protocol that is Robots Exclusion Protocol (or REP).”

Sorry, comments are closed for this post.