All of OnCrawl's log monitoring reports can provide information on activity from Google, Bing, Baidu and Yandex.
However, only Google is monitored by default.
Setting up monitoring for Bing, Baidu and Yandex
If you're interested in monitoring additional search engines, please contact us using the chat box at the bottom of the screen and ask to add the search engines that interest you to your log monitoring.
This option is available to all log analysis users for a one-time fee per additional search engine.
If you are not already a log monitoring user, you will first need to set up log monitoring.
If you have been using OnCrawl's log monitoring in the past, you may need to do the following:
Adjust your monthly quota for log lines, as you will be monitoring more "useful" lines than before.
Review your log file filtering to make sure lines for the new bots are included in the files shared with OnCrawl
What data is available for additional search engines?
All data in the log monitoring reports is available for all four search engines supported by OnCrawl:
Google
Bing
Baidu
Yandex
This includes the following dashboards:
Log monitoring > Live log
Log monitoring > Crawl behavior
Log monitoring > SEO impact
Log monitoring > Exploration sanity
Log monitoring > SEA and vertical bots
How to switch between data for different search engines
The data displayed on a log monitoring dashboard relates to the search engine or search engine bot shown in the Bot dropdown menu at the top of the screen.
Switch between bots or search engines using this menu.
Why can't you view all search engines on a single graph?
Most websites have a majority of bot and SEO traffic from a single search engine. Whether or not this search engine is Google, this main source of traffic usually dwarfs traffic from other search engines.
To ensure that the log monitoring graphs and charts are readable, OnCrawl does not show all search engines on a single graph.
How to view hits for each search engine in the Data Explorer
All log monitoring data is available in the Data Explorer for each of the search engines supported by OnCrawl.
To access log monitoring data:
Navigate from any analysis or log monitoring screen to the Data Explorer. Click on "Tools" in the left-hand sidebar, then on "Data Explorer".
Choose the "Log monitoring: Pages" or "Log monitoring: Events" dataset.
When creating a filter, select a metric, then choose the bot or search engine to apply it to.