When determining the size of your log analysis quota for Oncrawl, you'll be measuring this in the number of "log lines": each time your site records a page request from a tracked bot or an SEO visit. You will need to know approximate numbers in order to estimate this ahead of time.
Only the lines with useful information for Oncrawl analyses are taken into account. By default, Oncrawl tracks Googlebot and visits referred from Google organic search. If additional bots are activated for your account, all of their lines count toward your quota too. All other lines are ignored.
Estimate the number of log entries per day and per month
You can estimate the number of lines Oncrawl will analyze by looking at two statistics:
Daily average Googlebot hits. This is the sum of Googlebot hits for the desktop and mobile bots. You can find this information in Google Search Console under Settings (in the left-hand menu) > Crawl stats.
The total number of "Crawl requests" and divide it by the number of days in your Search Console report. (This number is visible on the Settings page.) This data includes requests from all of the bots that Google uses, not just the requests from googlebot. This means that this number will give you a rough estimate, but will likely be greater than the real number of requests taken into account by Oncrawl.
If you have multiple domains or subdomains for which your are setting up log monitoring, make sure you get this information for each.
47.9K / 90 = 532
Finding the daily average bot hits in Search Console
Daily average of organic visits from Google. This can be found in any analytics tool. If you use Google Analytics (GA4), this is reported as a total number of unique sessions and can be found under Reports > Acquisition > Traffic acquisition. You will need to switch the table's primary dimension to Session source / medium and look for the line google / organic.
In this example, there are 12,555 organic sessions from Google in the time period we're looking at:
Divide the number of sessions reported by the number of days in the period you are looking at in order to obtain a daily average. If I'm looking at one week, that would mean: 12,555 sessions in a week / 7 days = 1794 sessions per day.
Note: Multiple visits by the same user within the same period can be considered to be a single session in GA4. Since Oncrawl's SEO visits does not group visits seen in your log files into sessions, the number of SEO visits in Oncrawl may be higher than the number of organic sessions in GA4.
Add these two daily estimates together: 532 crawl requests + 1794 visits = 2326 estimated lines per day.
Multiply by 30 (days per month): 69,780 lines per month.
The result is the approximate minimum number of lines of log analysis that your site requires per month with the default settings (Googlebot only).
Estimating additional lines for other bots
By default, Oncrawl only tracks Googlebot. Other bots can be activated by your Customer Success Manager, including other search engines (Bing, Yandex, Baidu…), paid search and vertical crawlers (images, video, news…), and AI crawlers and fetchers (OpenAI, Claude, Perplexity, Mistral…). You can find the full list in Oncrawl log analyzer supported bots list.
Every line from an activated bot counts toward your log analysis quota. If you plan to activate additional bots, add their estimated daily hits to your calculation:
Other Google bots (AdsBot, Googlebot-Image, Googlebot-Video…): the Crawl stats report in Google Search Console breaks down crawl requests by Googlebot type.
Other search engines: use the crawl statistics provided by their webmaster tools, such as Bing Webmaster Tools.
AI bots and other bots without a reporting tool: the most reliable method is to count their lines in a sample of your server logs (for example, one full day).
Multiply the daily total by 30 and add it to your monthly estimate.
To activate additional bots, contact your Customer Success Manager, your Account Manager, or reach out through the in-app chat.