Skip to main content
All CollectionsProject SettingsAdvanced settings
How can I just crawl a Subdomain?
How can I just crawl a Subdomain?
Berislav avatar
Written by Berislav
Updated over 2 years ago

You can limit the crawl to a specific subdomain in the project settings. The best way to do this is using the whitelist.

Here a short example: if we wanted to analyze only the subdomain “de.ryte.com” in our project “en.ryte.com” we would go about it like this:

  1. Make sure the toggle “Analyze subdomains” is active (Project settings > Project Setup > scroll all the way down). If this toggle is deactivated, all subdomains that differ from the one originally set in the project settings would be flagged as “external links” and an analysis of the different subdomain wouldn’t be possible.

  2. Switch to the tab "Advanced analysis" > "What to analyze" > "Homepage URL" and enter the start page of the subdomain to be analysed (Here we change the start page from https://en.ryte.com/ to https://de.ryte.com/).

  3. Open the whitelist by via “Advanced analysis” > “Include or exclude URLs” > “Include URLs (whitelist)” and enter the subdomain you want to have crawled. In our example above, that would be “de.ryte.com”.


Now you can start a new analysis. Afterwards, only the stored subdomain should appear in the analysis results. For further information on the whitelist, please see our help center article How to ignore or include URLs.

The setting "Analyze subdomain" and the whitelist are available for the packages Basic Suite and higher.

Did this answer your question?