Splunk integration

If you're a Splunk user, the OnCrawl Splunk integration automates the uploading of indexed logs to your private, secure FTP space.

Updated over a week ago

Splunk users can now take advantage of the OnCrawl Splunk integration, which is now in beta. The OnCrawl Splunk connector automates the uploading of indexed logs to the private, secure FTP space associated with your account. This facilitates the process not only by eliminating manual actions that take up your (or your web developers') time. It also ensures that log are uploaded daily, preventing gaps in the data.

Using the Splunk integration, you benefit from additional log file analysis compared to the information Splunk can offer. OnCrawl provides in-depth cross-analysis between log data from Splunk and data from other sources.

What data does OnCrawl use from Splunk?

OnCrawl fetches your logs, filters for lines related to SEO (organic) visits and Googlebot hits, uploads the filtered results to the OnCrawl ftp, and queues the files for analysis. The parsing and analysis of your logs is carried out by the OnCrawl Log Analyzer.

Your indexed logs provide data concerning:

  • The number of Googlebot hits for the different bots belonging to Google.

  • The number of organic hits (visitors coming from a Google SERP).

  • The timestamps of Googlebot and organic hits.

  • URLs receiving Googlebot and organic hits.

  • HTTP status reported for URLs receiving Googlebot and organic hits.

  • Page size of URLs receiving Googlebot and organic hits.

  • Reported load time for pages receiving Googlebot and organic hits.

  • Crawl frequency.

This data is combined with other data on the OnCrawl platform, including crawl data, to provide precise and actionable insights.

What versions of Splunk are supported?

OnCrawl supports Splunk Cloud and Splunk Enterprise versions, which both allow third party connections.

What information will you need?

In order to connect to your Splunk instance and access your logs, we will need the following information:

  1. Hostname and port: for Splunk Cloud, this page explains how to find your hostname and port.If you manage your own Splunk instances outside of Splunk Cloud, make sure the port is open.

  2. Username and password: you will need to create a user for OnCrawl with read access to the Splunk indexes that contain your SEO logs.

  3. Index names: the names of the indexes on your Splunk instance that contain your SEO logs.

  4. Source types: the names of the sourcetypes in your index that contain your SEO logs.

  5. App name (if used): sometimes indexes are only available within the context of a Splunk App. If this is the case, please provide the name of the app and make sure that the user created for OnCrawl has access to the app.

How to connect your Splunk and OnCrawl accounts

Reach out to your sales contact by clicking on the blue Intercom button at the bottom right of any screen in the OnCrawl application and we'll be happy to help you set it up.

Going further

If you still have questions, drop us a line at @oncrawl_cs or click on the Intercom button at the bottom right of your screen to start a chat with us.

Happy crawling!

This article can also by found by searching for:

Connecter Splunk, intégration, téléchargement automatique des logs, integración, envío automático de registros, conectar con Splunk

Did this answer your question?