OnCrawl uses a variable range of IP addresses to craw websites. The IP addresses we use vary depending on the volume of crawls that are being performed at any given time.
If you need OnCrawl to use a static IP address when crawling your site, we can require our crawler to use an IP address from a short list we will provide you.
Here's how to get a list of the IP addresses that OnCrawl will use to crawl your site.
Using a list of static IP addresses
- From the project home page, click "+ Set up new crawl" to go to the crawl settings page.
- Click on "Show extra settings" to make the extra settings visible.
- Scroll down to "Crawler IP Addresses" under "Extra settings". Click on this section to expand it.
- Tick the "Use static IP addresses" checkbox. When this box is ticked, it forces the OnCrawl bot to use one of the four IP addresses that appear in the list below.
Note: If this option is not available, you may need to add it to your plan. Please contact your sales representative to enable it.
You will need to add all four IP addresses in this list to your website's list of authorized IP addresses.
If you still have questions, drop us a line at @oncrawl_cs or click on the Intercom button at the bottom right of your screen to start a chat with us.
You can also find this article by searching for:
dirección IP, lista blanca
adresse IP, liste blanche