Oncrawl

Rebecca Berbel

Emma Labrador

Philippe David

Where to start, how to get a crawl set up, and how to connect additional data

How to get started

A short video to show you how to launch a new crawl with OnCrawl and customize the crawl settings.

[Tutorial] How to set up a crawl with OnCrawl

Learn how to customize the crawl speed of OnCrawl's SEO crawler. Default settings too fast or too slow? Tailor the speed to your needs.

[Tutorial] How to set crawl speed with OnCrawl

OnCrawl's Data Explorer is a powerful tool that allows you to create downloadable, custom reports about your URLs

[Tutorial] How to use the OnCrawl Data Explorer

See how to connect external accounts like Google Search Console to use that data in OnCrawl

[Tutorial] How to connect external data in OnCrawl

Video tutorials

Step-by-step guide to getting your Oncrawl Looker Studio connector up and running

Setting up your Looker Studio connector in 10 steps

Create your projects, start your first crawls, upload your log files and produce cross-analysis.

Account Setup in 10 Steps

You can sort and filter results directly in the OnCrawl Data Explorer. Here's how.

Data Explorer Sorting and Filters

How to recover a lost password

General

You can plan a crawl to run at a specific time, or create a recurring crawl. Here's how

Scheduling a crawl

Set crawl parameters, save crawl settings as a profile to reuse later, create cross-data reports, and launch your crawl.

Crawl settings

Understand the different ways to crawl pages with OnCrawl

Crawl mode: spider mode VS URL list

How (and why) to use a virtual robot.txt file to tell the OnCrawl bot how to crawl your site

Virtual robots.txt

Oncrawl's crawler users a series of different IP addresses to crawl websites. You can greenlist these IP addresses if necessary.

What IPs does Oncrawl use to crawl a website?

Use a virtual robots.txt in order to limit the crawl to a subset of pages on a website

Crawl part of a website

Sometimes you'll want to crawl only certain subdomains of your site, while excluding other subdomains from the crawl. Find out how.

How to crawl some subdomains but not others

Tanguy

Crawl setup

How to set up your connection to Majestic in order to combine crawl and backlink data

Connecting your Majestic account

Include your Google Analytics data in Oncrawl to understand how technical SEO metrics relate to user behavior in your analytics data.

Connecting to your Google Analytics account

Oncrawl's approach to external data through connectors

Data sources

Declare your Adobe Analytics account in Oncrawl and access cross-analysis in the SEO Impact Report

Connecting to your Adobe Analytics account

An easy guide to setup a cross-data analysis between Piano Analytics and Oncrawl to access the SEO Impact Report

Connecting to your Piano Analytics account

A step-by-step guide to combine your Search Console data to your crawl data via the Ranking Report

Connecting your Google Search Console account

Data ingestion with a CSV file is a powerful tool that lets you add outside data to any crawl. A step-by-step guide.

Data Ingestion with CSV files

How to add third-party datasets to a crawl report and enrich your analysis

Data Ingestion

Your project or your site has evolved and you no longer want your Google Analytics or GSC account to be associated with your OnCrawl project