Navigation

View thumbnailView full size image

Allow Navigation above starting directory level

Only applies where the starting URL specifies a starting location other than the root folder, for example:

www.mysite.com/level1/level2/start.html

When this option is selected, Perceptive Search is allowed to follow links to directory levels above the starting point, for example to www.mysite.com/level1/mypage.html

When this option is deselected, Perceptive Search may only follow links at that level or lower. This can be very useful when you wish to index a portion of a site, but not the entire site, and the portion you wish to index is reflected in the site's directory structure.

Traverse between secure and unsecure content

When selected, a starting URL that begins with http:// can traverse a link to a URL starting https://, and vice versa. When deselected, spidering is restricted to the protocol of the starting URL and will not traverse across to the other.

Case-sensitive URLs

URLs are to be compared in a case insensitive manner. Check this box if the web server you are indexing is hosted on a Windows server, or the server generates mixed case URLs.

Traverse through sub-domains

When selected, allows spider to traverse across sub-domains of the starting URL. E.g., if the starting URL was www.mysite.com/index.html then the URL catalog.mysite.com/page.html is understood as a sub-domain.

Accepted external domains

Perceptive Search will only index web pages that reside on the same domain as the starting URL. This option allows you to specify external domains that Perceptive Search is allowed to crawl. When Perceptive Search encounters a link to an external domain, it will only follow the link if the domain is specified here.