Remove part of website

Remove part of your website from Google Index

Option 1: Robots.txt
Remove all pages under a particular directory (for example, lems)

User-agent: Googlebot
Disallow: /lems

Remove all files of a specific file type (for example, .gif)

User-agent: Googlebot
Disallow: /*.gif$

To remove dynamically generated pages, you’d use this robots.txt entry

User-agent: Googlebot
Disallow: /*?

Option 2: Meta tags

Another standard, which can be more convenient for page-by-page use, involves adding a META tag to an HTML page to tell robots not to index the page. This standard is described at http://www.robotstxt.org/wc/exclusion.html#meta

Prevent all robots from indexing a page on your site

<meta name=”robots” content=”noindex, nofollow” />

Allow other robots to index the page on your site, preventing only Google’s robots from indexing the page

<meta name=”googlebot” content=”noindex, nofollow” />

Allow robots to index the page on your site but instruct them not to follow outgoing links

<meta name=”robots” content=”nofollow” />

Tags: Remove+part+of+website, Google+Removal, Remove+from+Google, SEO, SEO101