All of Oncrawl's log monitoring reports can provide information on activity from Google, Bing, Baidu and Yandex.
However, only Google is monitored by default.
Setting up monitoring for Bing, Baidu and Yandex
This option requires the multibot subscription option for monitoring multiple search engines.
This option is available to all log analysis users for a one-time fee per additional search engine.
If you are not already a log monitoring user, you will first need to set up log monitoring.
If you are already using Oncrawl's log monitoring, you may need to do the following:
Adjust your monthly quota for log lines, as you will be monitoring more "useful" lines than before.
Review your log file filtering to make sure lines for the new bots are included in the files shared with Oncrawl.
What data is available for additional search engines?
All data in the log monitoring reports is available for all four search engines supported by Oncrawl:
Google
Bing
Baidu
Yandex
This includes the following dashboards:
Log monitoring > Live log
Log monitoring > Crawl behavior
Log monitoring > SEO impact
Log monitoring > Exploration sanity
Log monitoring > SEA and vertical bots
How to switch between data for different search engines
The data displayed on a log monitoring dashboard relates to the search engine or search engine bot shown in the Bot dropdown menu at the top of the screen.
Switch between bots or search engines using this menu.
Why can't you view all search engines on a single chart?
Some charts do show all search engine traffic, combined. This is common on the Live log dashboard, for example:
In other views, though, the scale makes showing all bots separately difficult to read: most websites have a majority of bot and SEO traffic from a single search engine. Whether or not this search engine is Google, this main source of traffic usually dwarfs traffic from other search engines.
To ensure that the log monitoring graphs and charts are readable, Oncrawl does not show all search engines on a single graph.
How to view hits for each search engine in the Data Explorer
All log monitoring data is available in the Data Explorer for each of the search engines supported by Oncrawl.
To access log monitoring data:
Navigate from any analysis or log monitoring screen to the Data Explorer. Click on Tools in the left-hand sidebar, then on Data Explorer.
Choose the Log monitoring: Pages or the Log monitoring: Events dataset. Pages lists every URL that was hit by either a bot or an organic search visitor, along with different metrics. Events lists each hit separately, with metrics such as the date and time of the visit.
When creating a filter, select a metric, then choose the bot or search engine to apply it to.
