FAQ

Rebecca Berbel avatar E Erle Alberton avatar
14 articles in this collection
Written by Rebecca Berbel, Elodie, and Erle Alberton

What format can I use for my sitemaps?

You can scan sitemaps to discover pages that might not otherwise be linked to your site structure. Here are the formats OnCrawl supports.
Rebecca Berbel avatar
Written by Rebecca Berbel
Updated over a week ago

How can I find the location of a 3xx (redirection) status code?

3xx status codes indicate a redirected page. Here’s how to find the page that was redirected, as well as the page it was redirected to.
Rebecca Berbel avatar
Written by Rebecca Berbel
Updated over a week ago

How to recover a lost password

What to do if you forgot your password.
Rebecca Berbel avatar
Written by Rebecca Berbel
Updated over a week ago

How to create a custom Segmentation?

Categorize pages according to filters defined on a multitude of different metrics. Discover how to create your segmentation.
E
Written by Elodie
Updated over a week ago

How to check urls in sitemap?

Here is how to make sure that your sitemaps will be taken into account during the analysis
Erle Alberton avatar
Written by Erle Alberton
Updated over a week ago

How to quickly scan and analyze a list of URLs?

Sometimes you may need to analyze a more or less important list of URLs without browsing the entire site. Here is how to proceed.
Erle Alberton avatar
Written by Erle Alberton
Updated over a week ago

How to use REGEX to create filters (Data Explorer & Segmentations)

Understand patternal detection in fields to get to the essentials faster
Erle Alberton avatar
Written by Erle Alberton
Updated over a week ago

How to render JS (JavaScript) using OnCrawl

If all or part of your website is built using JavaScript, you may need to render pages in order to for a bot to be able to crawl them.
Rebecca Berbel avatar
Written by Rebecca Berbel
Updated over a week ago

What to do when my graphs are empty

What to do if you ran a crawl, but your graphs and charts aren't showing any data
Rebecca Berbel avatar
Written by Rebecca Berbel
Updated over a week ago

Why does my report only contain one URL?

What to do if your crawl results yield an analysis with only one URL.
Rebecca Berbel avatar
Written by Rebecca Berbel
Updated over a week ago

How to connect and operate with the OnCrawl API

OnCrawl is based on a platform built around an API. You can create your own application to request this API very easily, here's how to do it
Erle Alberton avatar
Written by Erle Alberton
Updated over a week ago

How to create and validate Custom Fields (Data Scraping)

Data scraping is an option that allows you to analyse a portion of the source code extracted during a crawl using custom fields.
Rebecca Berbel avatar
Written by Rebecca Berbel
Updated over a week ago

How to create a file listing all links pointing to a 301 URL, the old URL, and the new URL

You have permanently redirected (301) URLs. Here's how to create a list of all the links, the URL, and the URL they are redirected to.
Rebecca Berbel avatar
Written by Rebecca Berbel
Updated this week

How to segment groups of pages based on your Data Layer - Google Tag Manager example

Want to make your Google Analytics data consistent with OnCrawl data & reports? Here is how to create categories based on your Data Layer
Erle Alberton avatar
Written by Erle Alberton
Updated over a week ago