Oncrawl

Rebecca Berbel

Emma Labrador

Philippe David

Where to start, how to get a crawl set up, and how to connect additional data

How to get started

A short video to show you how to launch a new crawl with OnCrawl and customize the crawl settings.

[Tutorial] How to set up a crawl with OnCrawl

Learn how to customize the crawl speed of OnCrawl's SEO crawler. Default settings too fast or too slow? Tailor the speed to your needs.

[Tutorial] How to set crawl speed with OnCrawl

OnCrawl's Data Explorer is a powerful tool that allows you to create downloadable, custom reports about your URLs

[Tutorial] How to use the OnCrawl Data Explorer

See how to connect external accounts like Google Search Console to use that data in OnCrawl

[Tutorial] How to connect external data in OnCrawl

Video tutorials

Step-by-step guide to getting your Oncrawl Looker Studio connector up and running

Setting up your Looker Studio connector in 10 steps

Create your projects, start your first crawls, upload your log files and produce cross-analysis.

Account Setup in 10 Steps

You can sort and filter results directly in the OnCrawl Data Explorer. Here's how.

Data Explorer Sorting and Filters

How to recover a lost password

General

You can plan a crawl to run at a specific time, or create a recurring crawl. Here's how

Scheduling a crawl

Set crawl parameters, save crawl settings as a profile to reuse later, create cross-data reports, and launch your crawl.

Crawl settings

Understand the different ways to crawl pages with OnCrawl

Crawl mode: spider mode VS URL list

How (and why) to use a virtual robot.txt file to tell the OnCrawl bot how to crawl your site

Virtual robots.txt

Oncrawl's crawler users a series of different IP addresses to crawl websites. You can greenlist these IP addresses if necessary.

What IPs does Oncrawl use to crawl a website?

Use a virtual robots.txt in order to limit the crawl to a subset of pages on a website

Crawl part of a website

Sometimes you'll want to crawl only certain subdomains of your site, while excluding other subdomains from the crawl. Find out how.

How to crawl some subdomains but not others

Tanguy

Crawl setup

Declare your Google Analytics account in OnCrawl: unlock high crawling rates, use a virtual robots.txt file and access the SEO Impact Report

Connecting to your Google Analytics account

Declare your Adobe Analytics account in Oncrawl and access cross-analysis in the SEO Impact Report

Connecting to your Adobe Analytics account

An easy guide to setup a cross-data analysis between Piano Analytics and Oncrawl to access the SEO Impact Report

Analytics: Piano Analytics (AT Internet)

A step-by-step guide to combine your Search Console data to your crawl report

Rankings report

Data ingestion with a CSV file is a powerful tool that lets you add outside data to any crawl. A step-by-step guide.

Data Ingestion with CSV files

How to add third-party datasets to a crawl report and enrich your analysis

Data Ingestion

Your project or your site has evolved and you no longer want your Google Analytics or GSC account to be associated with your OnCrawl project

How to get started

Video tutorials

General

Crawl setup

Connecting additional data