to best aid robots to crawl and index your site, guide them with a robots.txt file at the root of your public folder…

robots.txt

Sitemap: http://www.mywebsite.com/toplevelexample.xml

a top level sitemap guide robots to dance through strategic channels of the website into catagorical sub-sitemaps…

within toplevelexample.xml

you will reference like so:

<sitemapindex>
< sitemap>
<loc>http://www.mywebsite.com/sitemap_subcat01.xml</loc>
<lastmod>2008-09-05T08:06:28-04:00</lastmod>
</sitemap>
<sitemapindex>

within  http://www.mywebsite.com/sitemap_subcat01.xml

you list meat content for robots to feed on like so:

<urlset>
<url>
<loc>http://subcat01.mywebsite.com/cat01/keywordtitle</loc>
<lastmod>2002-08-00T12:01:00-04:00</lastmod>
</url>

Digg it | Save to del.icio.us | Netscape | Reddit | Stumble It!

- - - - - S P O N S O R I N G     A D V E R T I S M E N T - - - - -

This entry was posted on Thursday, September 5th, 2002 at 7:38 am and is filed under SEM. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.