All Collections
Log Monitoring
Log monitoring
How to view bot hits and SEO traffic from different search engines
How to view bot hits and SEO traffic from different search engines

Oncrawl supports log monitoring for Google, Bing, Baidu and Yandex

Updated over a week ago

All of Oncrawl's log monitoring reports can provide information on activity from Google, Bing, Baidu and Yandex.

However, only Google is monitored by default.

Setting up monitoring for Bing, Baidu and Yandex

This option requires the multibot subscription option for monitoring multiple search engines.


This option is available to all log analysis users for a one-time fee per additional search engine.

If you are not already a log monitoring user, you will first need to set up log monitoring.

If you are already using Oncrawl's log monitoring, you may need to do the following:

What data is available for additional search engines?

All data in the log monitoring reports is available for all four search engines supported by Oncrawl:

  • Google

  • Bing

  • Baidu

  • Yandex

This includes the following dashboards:

  • Log monitoring > Live log

  • Log monitoring > Crawl behavior

  • Log monitoring > SEO impact

  • Log monitoring > Exploration sanity

  • Log monitoring > SEA and vertical bots

How to switch between data for different search engines

The data displayed on a log monitoring dashboard relates to the search engine or search engine bot shown in the Bot dropdown menu at the top of the screen.

Switch between bots or search engines using this menu.

Why can't you view all search engines on a single chart?

Some charts do show all search engine traffic, combined. This is common on the Live log dashboard, for example:

In other views, though, the scale makes showing all bots separately difficult to read: most websites have a majority of bot and SEO traffic from a single search engine. Whether or not this search engine is Google, this main source of traffic usually dwarfs traffic from other search engines.

To ensure that the log monitoring graphs and charts are readable, Oncrawl does not show all search engines on a single graph.

How to view hits for each search engine in the Data Explorer

All log monitoring data is available in the Data Explorer for each of the search engines supported by Oncrawl.

To access log monitoring data:

  • Navigate from any analysis or log monitoring screen to the Data Explorer. Click on Tools in the left-hand sidebar, then on Data Explorer.

  • Choose the Log monitoring: Pages or the Log monitoring: Events dataset. Pages lists every URL that was hit by either a bot or an organic search visitor, along with different metrics. Events lists each hit separately, with metrics such as the date and time of the visit.

  • When creating a filter, select a metric, then choose the bot or search engine to apply it to.

Did this answer your question?