Page 2 of 2 If your site has a robots.txt file, you may be blocking Google from crawling some of the pages you want to be included in Google search results. Sitemaps provides a robots.txt tool where you can enter a list of URLs to see if your robots.txt file is blocking them from being crawled. Click on "robots.txt analysis" under the Tools section of the Diagnostics tab to start using this tool. You can also test changes to your robots.txt file by typing in the new changes and then testing them against the Googlebot. We recommend you do this before changing your file because you can check for errors in the file and experiment with changes to see how they would impact the crawl of your site. If your site has disappeared from the search results, you may have been penalized for violating the Google quality guidelines. Once you have corrected the problems on your site, you can request re-inclusion from your Sitemaps account. Simply sign in to the Webmaster Tools page (https://www.google.com/webmasters/sitemaps) and click "Submit a reinclusion request" under the Tools section. Fill out the form and click "Submit reinclusion" to complete your request. This form is also available on the Summary page for sites that show violations. Remember, if your site hasn't violated the webmaster guidelines, there's no need to submit a reinclusion request. The reinclusion request form is only available to Sitemaps users. Although, you can send an email to Google user support requesting reinclusion, a request from a registered, identifiable Sitemaps user is generally given more priority. Google Sitemaps is an evolving product with frequently added features. Stay up to date by visiting the Sitemaps blog (http://www.sitemaps.blogspot.com/) and post questions answered on the Google Sitemaps discussion group (http://groups.google.com/group/google-sitemaps). |
