In OnCrawl

πŸ“ˆ 1. Make sure your account has access to the Data Studio option (if not, here's how to get access).


πŸ“ˆ 2. Copy your Data Studio access key.
You'll need this later to paste it in Data Studio to set up the connector.

You can find your access key in your account settings, under Tokens in the sidebar.

(Here are the full instructions on where to find it.)

πŸ“ˆ 3. Decide which crawls you want to include in Data Studio reports and export them for Data Studio.

Please note: You might not be able to send information to Data Studio if the project has been shared with you. This is because the Data Studio key is attributed to the project owner (the person who created the project). If a project containing analyses you want to export to Data Studio has been shared with you, you will need to contact the person who shared it with you.

Data Studio will group your crawls by crawl profile. This helps ensure that your averages and comparisons over time take into account similar views of your site.

There are two ways to get crawl data from OnCrawl via the Data Studio connector:

  • Send new analyses to Data Studio as they're created:
    - From the project home page, click Set up a new crawl.
    - Scroll down to the Analysis section.
    - Expand the Export to settings.
    - Tick the Enable export to Data Studio checkbox.

    Once the crawl has been launched and completed, the data will be available via the connector.

This will automatically connect all future analyses with this crawl profile to Data Studio.

You can also view and copy your Data Studio key here when the checkbox is ticked.

  • Send completed analyses to Data Studio after they've finished:
    - From the project home page, scroll down to the list of crawl reports (at the bottom of the screen).
    - Choose the crawl you want to be available in Data Studio and click on the three buttons on the right side of the screen. This opens a menu.
    - Click on Export to Data Studio. The screen will update automatically and you will see that the export is in progress.

The time it takes to export data from OnCrawl to Data Studio depends on the number of URLs that have been crawled.

πŸ“ˆ 4. Wait until the export has finished to view the data in Data Studio.

If no exports have been completed yet, you'll see an error when you try to add a chart in Data Studio. This error will be resolved automatically when the export finishes.

In Data Studio

Now you can add the connector in Data Studio.

πŸ“ˆ 5. Head over to Data Studio: https://datastudio.google.com/

You will need to have a Data Studio account. Sign-in, or create one now if you need to.

πŸ“ˆ 6. Add your OnCrawl data as a new Data Source.

  • Click Create
  • Choose Data Source.
  • Search for OnCrawl. You will see the connector appear under Partner Connectors.
  • Click on it, and authorize it if necessary.

πŸ“ˆ 7. Set up the connector.

  • Paste the Data Studio access key that you copied from OnCrawl. (Here's where to find it if you skipped that step.)
  • When asked to, choose the crawl profile to associate with this data set.
    If you have multiple crawl profiles you want to use β€” even if they're from different projects β€”, you can create multiple Data Sources for the same OnCrawl account. In this case, we suggest renaming your Data Sources so you can tell them apart!
  • Make sure that the Use report template for new reports is checked. This will pre-load a template with examples and getting started information if you create a new report from the Data Source.
  • Click the blue Connect button. This connects the Data Source in Data Studio to the crawl data you selected in OnCrawl, and takes you to the Data Source page where you can adjust different elements of the Data Source and get an overview of all of the fields. (Or you can find the field list with definitions here.)
  • If you want to change the Data Source's name, here's one place you can do it: click on the name at the top of the page and enter a new one.

πŸ“ˆ 8. Create a new report.

  • From the Data Source page, click Create a report.
  • Explore the template, modify it, and get comfortable using your OnCrawl data.

πŸ“ˆ 9. Add OnCrawl data to an existing report

Now let's assume you already have a report, or you're creating one entirely from scratch with no template.

  • In an existing report, click Add data in the bar at the top of the page.
  • If you've already set up the Data Source for the OnCrawl Data you want, click on the My Data Sources tab and select your OnCrawl Data Source. Otherwise, search for OnCrawl and follow the instructions in step 7 above to set up the connector.
  • Click Add a new chart in the bar at the top of the page and choose the chart type you want to add.
  • Place the chart by clicking on the report in the location where you want to place the chart.
  • In the chart settings on the right, click on the name of the Data Source to change it to OnCrawl if necessary.

πŸ“ˆ 10. Blend OnCrawl data with other Data Sources

Here's an example of how to "blend" OnCrawl data with Google Analytics data.

Why blend OnCrawl and Google Analytics? As part of a crawl, OnCrawl collects data over a period of time for Google Analytics and Google Search Console, we've chosen not to export this information from OnCrawl to Data Studio. In Data Studio, you can get day-by-day information, straight from the source, using blended data sources.

Before we start, make sure you've created a Data Source for your Google Analytics account for the same website as your crawl data.

Because Google Analytics never uses the page's full URL, you might want to add a calculated field to the Data Source so that you can create it based on the information already present in the Data Source:

  • Start with a chart using OnCrawl data like the one you just created in step 9.
  • In the chart settings on the right, click Blend data.
  • Click Add another Data Source.
  • Choose your Analytics data source.
  • Modify the Join Key for both Data Sources. Here are two of the best ways to connect OnCrawl and Google Analytics:
    - OnCrawl: URL + Analytics: calculated field for Full URL
    or
    - OnCrawl: Path + Analytics: Page
  • Add, for each Data Source, the metrics you want to use.

You can now create charts using data from both sources and cross-analyze relationships between analytics and crawl data.

Note: You can also blend two OnCrawl Data Sources together. For example, if you've crawled two different sections of your site using different crawl profiles, you can blend them in order to create a broader view of your site.

Where to get help

If you need help, check out the Data Studio FAQ article.

You can also contact us with questions or to report an issue with the OnCrawl Data Studio connector by clicking on the blue chat button at the bottom right of the screen. This button appears if you are logged in to OnCrawl.


Did this answer your question?