All Collections
Log Monitoring
Log monitoring
How to view bot hits and SEO traffic from different search engines
How to view bot hits and SEO traffic from different search engines
OnCrawl supports log monitoring for Google, Bing, Baidu and Yandex
Rebecca Berbel avatar
Written by Rebecca Berbel
Updated over a week ago

All of OnCrawl's log monitoring reports can provide information on activity from Google, Bing, Baidu and Yandex.

However, only Google is monitored by default.

Setting up monitoring for Bing, Baidu and Yandex

If you're interested in monitoring additional search engines, please contact us using the chat box at the bottom of the screen and ask to add the search engines that interest you to your log monitoring.

This option is available to all log analysis users for a one-time fee per additional search engine.

If you are not already a log monitoring user, you will first need to set up log monitoring.

If you have been using OnCrawl's log monitoring in the past, you may need to do the following:

What data is available for additional search engines?

All data in the log monitoring reports is available for all four search engines supported by OnCrawl:

  • Google

  • Bing

  • Baidu

  • Yandex

This includes the following dashboards:

  • Log monitoring > Live log

  • Log monitoring > Crawl behavior

  • Log monitoring > SEO impact

  • Log monitoring > Exploration sanity

  • Log monitoring > SEA and vertical bots

How to switch between data for different search engines

The data displayed on a log monitoring dashboard relates to the search engine or search engine bot shown in the Bot dropdown menu at the top of the screen.

Switch between bots or search engines using this menu.

Why can't you view all search engines on a single graph?

Most websites have a majority of bot and SEO traffic from a single search engine. Whether or not this search engine is Google, this main source of traffic usually dwarfs traffic from other search engines.

To ensure that the log monitoring graphs and charts are readable, OnCrawl does not show all search engines on a single graph.

How to view hits for each search engine in the Data Explorer

All log monitoring data is available in the Data Explorer for each of the search engines supported by OnCrawl.

To access log monitoring data:

  • Navigate from any analysis or log monitoring screen to the Data Explorer. Click on "Tools" in the left-hand sidebar, then on "Data Explorer".

  • Choose the "Log monitoring: Pages" or "Log monitoring: Events" dataset.

  • When creating a filter, select a metric, then choose the bot or search engine to apply it to.

Did this answer your question?