Advanced uses and settings
13 articles
Link DatasetUnderstanding the information collected by Oncrawl about a website's links
How to use REGEX in OncrawlUse pattern detection in fields to get to the essentials faster. Use regular expressions to create filters (Data Explorer & Segmentations)
How to use alerts for SEO monitoring in OncrawlLearn how to establish and manage SEO alerts with Oncrawl, monitoring metrics like 404s, redirects, and duplicate titles proactively.
Lucene REGEX Cheat SheetIn this article you'll learn how to use Regex with Oncrawl. This article is based on the Elastic Search Article
Custom dashboardsMake your own dashboards to track key issues in one place
Crawl over crawlA crawl over crawl compares the results of two crawls to show you the impact of your changes or how two sites differ.
Data scraping and custom fieldsData scraping is an option that allows you to analyse a portion of the source code extracted during a crawl using custom fields.
How to crawl a site that uses JavaScriptIf all or part of your website is built using JavaScript (JS), you may need to render pages in order to for a bot to be able to crawl them.
Customize your user-agent in OncrawlLearn how to change the bot identity used to crawl your website.
Getting Started with the Oncrawl APIOncrawl is based on a platform built around an API. Create your own application to request this API very easily. Here's how to do it.
Oncrawl connector for Looker StudioAnswers to your questions about the Oncrawl Looker Studio (ex Data Studio) connector
Build your own chart and leverage all Oncrawl data endpointsTake complete control of your chart design and easily create a variety of visualizations
Enhance alert precision with ratio-based conditionsWith the ratio mode in the alert builder, you can configure alerts that compare two metrics.