Oncrawl plans function on the basis of monthly quotas.
As long as your plan is active, this quota is renewed every month.
Please note: This information applies to the JavaScript crawler released with the Core Web Vitals update. If you are using the legacy JavaScript option without access to Core Web Vitals, this article does not apply to your plan.
How much does a crawl "cost"?
Crawling a website to analyze it consumes your URL quota in the following way:
Type of crawl | URLs crawled | URLs counted |
Normal crawl | 1 URL | 1 URL from your monthly quota |
JS without Core Web Vitals | 1 URL | 3 URL from your monthly quota |
JS with Core Web Vitals | 1 URL | 5 URL from your monthly quota |
For example, if you have a website with 50 000 pages, one JS crawl with Core Web Vitals of your entire website will use up 250 000 URLs from your quota.
What happens if you use a URL limit in your crawl settings?
If you set a URL limit in your crawl settings, this will stop the crawl when you reach that number of URLs.
It will not prevent you from spending your URL quota above that number.
For example, if you have a website with 50 000 pages and you want to spend less than 100 000 of this month's crawl quota, but you also want to run a JS crawl, you'll need to set your crawl limit to 33 000 URLs:
33 000 URLs crawled x 3 (JS cost) = 99 000 URLs from your quota