How to get started | OnCrawl Help Center

Video tutorials

[Tutorial] How to set up a crawl with OnCrawl

A short video to show you how to launch a new crawl with OnCrawl and customize the crawl settings.

Written by Rebecca Berbel
Updated yesterday

[Tutorial] How to set crawl speed with OnCrawl

Learn how to customize the crawl speed of OnCrawl's SEO crawler. Default settings too fast or too slow? Tailor the speed to your needs.

Written by Rebecca Berbel
Updated yesterday

[Tutorial] How to use the OnCrawl Data Explorer

OnCrawl's Data Explorer is a powerful tool that allows you to create downloadable, custom reports about your URLs

Written by Rebecca Berbel
Updated yesterday

[Tutorial] How to connect external data in OnCrawl

See how to connect external accounts like Google Search Console to use that data in OnCrawl

Written by Rebecca Berbel
Updated yesterday

General

Setting up your Data Studio connector in 10 steps

Step-by-step guide to getting your OnCrawl Data Studio connector up and running

Written by Rebecca Berbel
Updated yesterday

Account Setup in 10 Steps

Create your projects, start your first crawls, upload your log files and produce cross-analysis.

Written by Emma Labrador
Updated yesterday

Data Explorer Sorting and Filters

You can sort and filter results directly in the OnCrawl Data Explorer. Here's how.

Written by Rebecca Berbel
Updated yesterday

How to recover a lost password

What to do if you forgot your password.

Written by Rebecca Berbel
Updated yesterday

Crawl setup

Scheduling a crawl

You can plan a crawl to run at a specific time, or create a recurring crawl. Here's how

Written by Rebecca Berbel
Updated yesterday

Crawl settings

Set crawl parameters, save crawl settings as a profile to reuse later, create cross-data reports, and launch your crawl.

Written by Rebecca Berbel
Updated yesterday

Crawl mode: spider mode VS URL list

Understand the different ways to crawl pages with OnCrawl

E

Written by Elodie
Updated yesterday

Virtual robots.txt

How (and why) to use a virtual robot.txt file to tell the OnCrawl bot how to crawl your site

Written by Rebecca Berbel
Updated yesterday

What IPs does OnCrawl use to crawl a website?

OnCrawl uses a dynamic range of IP addresses to crawl websites. If necessary, it's possible to restrict this range to a series of static IPs

Written by Rebecca Berbel
Updated yesterday

Crawl part of a website

Use a virtual robots.txt in order to limit the crawl to a subset of pages on a website

Written by Tanguy
Updated yesterday

How to crawl some subdomains but not others

Sometimes you'll want to crawl only certain subdomains of your site, while excluding other subdomains from the crawl. Find out how.

Written by Rebecca Berbel
Updated yesterday

Connecting additional data

Connecting to your Google Analytics account

Declare your Google Analytics account in OnCrawl: unlock high crawling rates, use a virtual robots.txt file and access the SEO Impact Report

Written by Rebecca Berbel
Updated yesterday

Connecting to your Adobe Analytics account

Declare your Adobe Analytics account in OnCrawl and access cross-analysis in the SEO Impact Report

Written by Rebecca Berbel
Updated yesterday

Analytics: AT Internet

An easy guide to setup a cross-data analysis between AT Internet and OnCrawl to access the SEO Impact Report

Written by Rebecca Berbel
Updated yesterday

Rankings report

A step-by-step guide to combine your Search Console data to your crawl report

Written by Emma Labrador
Updated yesterday

Data Ingestion with CSV files

Data ingestion with a CSV file is a powerful tool that lets you add outside data to any crawl. A step-by-step guide.

Written by Rebecca Berbel
Updated yesterday

Data Ingestion

How to add third-party datasets to a crawl report and enrich your analysis

Written by Emma Labrador
Updated yesterday

How to remove a Google account from a project

Your project or your site has evolved and you no longer want your Google Analytics or GSC account to be associated with your OnCrawl project

Written by Rebecca Berbel
Updated yesterday