search mobile facets autocomplete spellcheck crawler rankings weights synonyms analytics engage api customize documentation install setup technology content domains user history info home business cart chart contact email activate analyticsalt analytics autocomplete cart contact content crawling custom documentation domains email engage faceted history info install mobile person querybuilder search setup spellcheck synonyms weights engage_search_term engage_related_content engage_next_results engage_personalized_results engage_recent_results success add arrow-down arrow-left arrow-right arrow-up caret-down caret-left caret-right caret-up check close content conversions-small conversions details edit grid help small-info error live magento minus move photo pin plus preview refresh search settings small-home stat subtract text trash unpin wordpress x alert case_deflection advanced-permissions keyword-detection predictive-ai sso
Site Search Documentation / site search: Crawling Private Pages
Crawling Private Pages

Site Search

Guides

Site Search API

API Reference

API Clients

Plugins

Resources

Crawling Private or Password Protected Pages

The Site Search Crawler does not index content protected by HTTP authentication.

Pro and Premium plans can configure their website to allow crawler access via a Unique User Agent.

Read more within Advanced Settings.

Stuck? Looking for help? Contact support or check out the Site Search community forum!