RSS and Atom Feed Support
The Site Search Crawler support RSS and Atom feeds.
RSS/Atom feeds give good hints about where to find the most recently updated pages.
If your website provides an RSS or Atom feed, our crawler will download it to find new links on your site to index first.
This is particularly useful when Site Search is doing an incremental update of your website.
For example, your website has an RSS feed at
The auto-discovery code would look like this:
<html> <head> <title>Your Site Title</title> <link rel="alternate" type="application/rss+xml" title="RSS feed" href="http://www.yoursite.com/index.rss"> </head> <body> ... </body> </html>
If your website has an Atom feed, you would use the
application/atom+xml type for the
<link rel="alternate" type="application/atom+xml" title="Atom feed" href="http://www.yoursite.com/index.atom">