Password Protected Content
Our crawler does not automatically support indexing content protected by HTTP authentication. You can work around this limitation by configuring your site to allow access to our crawler agent, Swiftbot. For a more secure solution, our support team can also supply you with your account specific user agent string. If these options will not work for your content, you may want to think about implementing Swiftype using our API.