How To Submit A Sitemap Too All Search Engines Using Robots.txt

By Author: John Tang
Total Articles: 512
Comment this article

I discovered this about a week ago and it frankly surprised me. Apparently the Robots.txt file has a new agreed upon protocol for implementing sitemaps

To simply add a sitemap to your robots.txt file simple open it in a text editor and input the following example:

SITEMAP: http://www.(yourURL).com/(yoursitemap).xml

That's it. By adding this code to your Robots.txt you have allowed all major search engines, Google, Yahoo, MSN, and Ask.com, and minor ones, the ability to see your sitemap and properly index your website according to your choices.

The biggest benefit is that it not only submits to Google, but Yahoo, MSN, and Ask.com all see the sitemap. You will also make your sitemap available to developing search engines/spiders that read sitemaps and gives you a huge advantage in niches search engines and website that you many not even know exist. And who knows, one day a little unknown search engine may overtake Google's dominance and you will have your sitemap already submitted to it.

A Great tool to Generate Sitemaps can be fond at auditmypc.com.
Click here -> http://www.auditmypc.com/free-sitemap-generator.asp.

The ...
... tool allows you to generate xml sitemaps, html sitemaps, raw file, and filter out images and directories, and more. It's a perfect tool to generating a sitemap online for any sites websites.

For further sitemap protocols visit http://www.sitemaps.org/.

The Robots.txt is a very useful file that helps spiders/robots navigate your website, and has the power to forbids them from accessing certain sensitive information.

For further details on robots.txt visit http://www.robotstxt.org/