RSS and Atom Feed Support
RSS and Atom are standards for content syndication. In short, they provide a machine-readable way of describing updated content on a website. Many blogging platforms and content management systems support either RSS or Atom (or both) to help readers state up-to-date with their content.
The Swiftype crawler support RSS and Atom feeds. If your website provides an RSS or Atom feed, our crawler will download it to find new links on your site to index first. This is particularly useful when Swiftype is doing an incremental update of your website, as it gives us a good hint about where to find the most recently updated pages.
To tell the Swiftype crawler about your RSS or Atom feed, use auto-discovery in the
<head> section of your template.
For example, if your website has an RSS feed at
http://www.yoursite.com/index.rss the auto-discovery code would look like this:
<html> <head> <title>Your Site Title</title> <link rel="alternate" type="application/rss+xml" title="RSS feed" href="http://www.yoursite.com/index.rss"> </head> <body> ... </body> </html>
If your website has an Atom feed, you would use the
application/atom+xml type for the
<link rel="alternate" type="application/atom+xml" title="Atom feed" href="http://www.yoursite.com/index.atom">