# Oncrawl Help

> Help center for Oncrawl

## Getting started with Oncrawl

- [Account Setup in 10 Steps](https://help.oncrawl.com/en/articles/1714077-account-setup-in-10-steps.md): Start your Oncrawl SEO journey with a 10-step guide, from account setup to using various features for in-depth SEO analysis.
- [What IPs does Oncrawl use to crawl a website?](https://help.oncrawl.com/en/articles/2288662-what-ips-does-oncrawl-use-to-crawl-a-website.md): Secure access by greenlisting Oncrawl's static IP addresses, ensuring smooth and uninterrupted website crawling.
- [Domain ownership verification \(Verified domains\)](https://help.oncrawl.com/en/articles/9030711-domain-ownership-verification-verified-domains.md): Discover Oncrawl's domain ownership policy and how you should verify your own domains in order to unlock advanced crawl settings.
- [Connecting to your Piano Analytics account](https://help.oncrawl.com/en/articles/1421932-connecting-to-your-piano-analytics-account.md): An easy guide to setup a cross-data analysis between Piano Analytics and Oncrawl to access the SEO Impact Report
- [Connecting your Google Search Console account](https://help.oncrawl.com/en/articles/1795476-connecting-your-google-search-console-account.md): A step-by-step guide to combine your Google Search Console and Google Discover data to your crawl data \(Ranking Report and Google Discover Lens\).
- [Connecting to your Google Analytics account](https://help.oncrawl.com/en/articles/2477156-connecting-to-your-google-analytics-account.md): Include your Google Analytics data in Oncrawl to understand how technical SEO metrics relate to user behavior in your analytics data.
- [Connecting to your Adobe Analytics account](https://help.oncrawl.com/en/articles/2477249-connecting-to-your-adobe-analytics-account.md): Declare your Adobe Analytics account in Oncrawl and access cross-analysis in the SEO Impact Report
- [Connect Majestic: Step-by-Step Guide](https://help.oncrawl.com/en/articles/7913820-connect-majestic-step-by-step-guide.md): Integrate Majestic with Oncrawl for enriched backlink and crawl data, enhancing your SEO strategy with consolidated insights.
- [Data Ingestion](https://help.oncrawl.com/en/articles/1482979-data-ingestion.md): How to add external data to a crawl without using a connector
- [Data Ingestion with CSV files](https://help.oncrawl.com/en/articles/2536081-data-ingestion-with-csv-files.md): Data ingestion with a CSV file is a powerful tool that lets you add outside data to any crawl. A step-by-step guide.
- [External data sources](https://help.oncrawl.com/en/articles/7913695-external-data-sources.md): Understand how Oncrawl integrates external data, through connectors, for comprehensive data analysis.
- [Oncrawl Lenses](https://help.oncrawl.com/en/articles/12495943-oncrawl-lenses.md): Predefined entry points tailored to your SEO use cases.
- [Choosing your crawl mode: Spider mode vs. a URL list vs. Sitemaps mode](https://help.oncrawl.com/en/articles/2033806-choosing-your-crawl-mode-spider-mode-vs-a-url-list-vs-sitemaps-mode.md): Understand the different ways to crawl your site's pages with Oncrawl.
- [How to crawl some subdomains but not others](https://help.oncrawl.com/en/articles/2120614-how-to-crawl-some-subdomains-but-not-others.md): Sometimes you'll want to crawl only certain subdomains of your site, while excluding other subdomains from the crawl. Find out how.
- [How to crawl a staging/pre-prod website](https://help.oncrawl.com/en/articles/2290013-how-to-crawl-a-staging-pre-prod-website.md): It's good practice to protect staging websites and pre-production websites from bots. Here's how to crawl one before it goes live.
- [Crawl settings](https://help.oncrawl.com/en/articles/2350011-crawl-settings.md): Set crawl parameters, save crawl settings as a profile to reuse later, create cross-data reports, and launch your crawl.
- [How to define rules of inclusion/exclusion for URL patterns in your crawl setup](https://help.oncrawl.com/en/articles/8684765-how-to-define-rules-of-inclusion-exclusion-for-url-patterns-in-your-crawl-setup.md): How to tell the crawler what part of your site to analyze by including/excluding groups of URLs
- [Optimize Content Analysis with the Exclude Content Feature](https://help.oncrawl.com/en/articles/10513044-optimize-content-analysis-with-the-exclude-content-feature.md): This feature allows you to filter out dense, redundant, content from your analysis, enabling you to focus on what truly matters
- [Scheduling a crawl](https://help.oncrawl.com/en/articles/2553854-scheduling-a-crawl.md): If you would like to launch a crawl at a specific time or you wish to create a recurring crawl, here's how.
- [How to use alerts for SEO monitoring in Oncrawl](https://help.oncrawl.com/en/articles/6984784-how-to-use-alerts-for-seo-monitoring-in-oncrawl.md): Learn how to establish and manage SEO alerts with Oncrawl, monitoring metrics like 404s, redirects, and duplicate titles proactively.
- [Enhance alert precision with ratio-based conditions](https://help.oncrawl.com/en/articles/11103976-enhance-alert-precision-with-ratio-based-conditions.md): With the ratio mode in the alert builder, you can configure alerts that compare two metrics.

## Data analysis & dashboards

- [How to use crawl results to find redirection loops](https://help.oncrawl.com/en/articles/2096263-how-to-use-crawl-results-to-find-redirection-loops.md): Your crawl results can help you to quickly produce a list of all redirected pages and the pages to which they are redirected.
- [Auditing Core Web Vitals](https://help.oncrawl.com/en/articles/5373099-auditing-core-web-vitals.md): Optimize Core Web Vitals using Oncrawl, understanding their role in Google's algorithms and impact on rankings.
- [Ranking performance](https://help.oncrawl.com/en/articles/6525760-ranking-performance.md): Learn how to use Ranking performance
- [GA4 Metrics: Understanding them for enhanced data analysis](https://help.oncrawl.com/en/articles/7945648-ga4-metrics-understanding-them-for-enhanced-data-analysis.md): Harness GA4 metrics in Oncrawl for thorough cross-analysis with crawl data, exploring metrics, reports, and filters.
- [Crawl over crawl](https://help.oncrawl.com/en/articles/2330293-crawl-over-crawl.md): A crawl over crawl compares the results of two crawls to show you the impact of your changes or how two sites differ.
- [How to explore and export data with in Data Explorer](https://help.oncrawl.com/en/articles/2465638-how-to-explore-and-export-data-with-in-data-explorer.md): How to use the Oncrawl Data Explorer, select a dataset, sort and filter data, choose the displayed fields, perform calculations, save views and export the resulting report.
- [Link Dataset](https://help.oncrawl.com/en/articles/6673890-link-dataset.md): Understanding the information collected by Oncrawl about a website's links
- [Custom dashboards](https://help.oncrawl.com/en/articles/2764526-custom-dashboards.md): Make your own dashboards to track key issues in one place
- [How to use dashboard templates](https://help.oncrawl.com/en/articles/8861218-how-to-use-dashboard-templates.md): Use dashboard templates to customize your analysis results and easily add new or subject-specific dashboards to your analyses.

## Log monitoring & AI bots

- [Log Monitoring Setup Step-by-step](https://help.oncrawl.com/en/articles/1567762-log-monitoring-setup-step-by-step.md): Prerequisite: An Oncrawl Log Monitoring Subscription
- [How many days of logs should I upload?](https://help.oncrawl.com/en/articles/1852591-how-many-days-of-logs-should-i-upload.md): Find out how many days of logs to upload for different uses in OnCrawl's analyses.
- [Log monitoring date ranges](https://help.oncrawl.com/en/articles/3008472-log-monitoring-date-ranges.md): What dates are covered in the log monitoring report? How can you change the period or the level of detail?
- [How often should I upload new log files to OnCrawl?](https://help.oncrawl.com/en/articles/4686579-how-often-should-i-upload-new-log-files-to-oncrawl.md): Log monitoring only works if it is constantly and continuously updated. How often should you upload new logs?
- [How to secure a FTP connection when uploading log files to Oncrawl?](https://help.oncrawl.com/en/articles/1089538-how-to-secure-a-ftp-connection-when-uploading-log-files-to-oncrawl.md): If you manually upload log files to Oncrawl via our FTP server, you must use a secure \(FTPS\) connection.
- [How to automate the daily upload of log files on the FTP?](https://help.oncrawl.com/en/articles/1092335-how-to-automate-the-daily-upload-of-log-files-on-the-ftp.md): This is a sample script for Apache server on Linux
- [Server side log format configuration](https://help.oncrawl.com/en/articles/1624556-server-side-log-format-configuration.md): Learn how to setup your server log configuration regarding the type of server you are using.
- [Splunk integration](https://help.oncrawl.com/en/articles/2452575-splunk-integration.md): If you're a Splunk user, the OnCrawl Splunk integration automates the uploading of indexed logs to your private, secure FTP space.
- [How to set up log monitoring if you use Amazon S3](https://help.oncrawl.com/en/articles/2669341-how-to-set-up-log-monitoring-if-you-use-amazon-s3.md): Do you use an Amazon S3 bucket to store your log data? Here's how to connect your logs to Oncrawl.
- [How to set up log monitoring if you use GCP](https://help.oncrawl.com/en/articles/5069361-how-to-set-up-log-monitoring-if-you-use-gcp.md): Do you use a Google Cloud Storage bucket to store your log data? Here's how to connect your logs to OnCrawl.
- [How to set up Oncrawl log monitoring with Akamai](https://help.oncrawl.com/en/articles/5806798-how-to-set-up-oncrawl-log-monitoring-with-akamai.md): Using Akamai and interested in using Oncrawl for your SEO log analysis? Here's what you need to know.
- [SEA & vertical bots](https://help.oncrawl.com/en/articles/2318344-sea-vertical-bots.md): The SEA & Vertical bots dashboard provides information about hits by additional Google bots that is extracted from an analysis of your logs.
- [How to filter log lines](https://help.oncrawl.com/en/articles/2764431-how-to-filter-log-lines.md): Don't want to share everything? Want faster processing? Remove unnecessary lines from your logs before uploading to OnCrawl.
- [How to get the most out of live log monitoring](https://help.oncrawl.com/en/articles/4911307-how-to-get-the-most-out-of-live-log-monitoring.md): Here's how to use the live log monitoring function in OnCrawl to see in near real time how Google explores your site
- [How to view bot hits and SEO traffic from different search engines](https://help.oncrawl.com/en/articles/5206520-how-to-view-bot-hits-and-seo-traffic-from-different-search-engines.md): Oncrawl supports log monitoring for Google, Bing, Baidu and Yandex
- [AI Search Lens](https://help.oncrawl.com/en/articles/13653107-ai-search-lens.md): Metrics and dashboards from AI Search Lens explained.
- [Oncrawl log analyzer supported bots list](https://help.oncrawl.com/en/articles/12556120-oncrawl-log-analyzer-supported-bots-list.md): The following list includes all bots currently supported in the Oncrawl platform. The list is continuously updated to ensure accurate log monitoring.
- [How to reduce the size of log files](https://help.oncrawl.com/en/articles/403729-how-to-reduce-the-size-of-log-files.md): The size of access log files can be easily reduced by 95% with pre-filtering and compression
- [How to check the quality and status of uploaded log files](https://help.oncrawl.com/en/articles/878530-how-to-check-the-quality-and-status-of-uploaded-log-files.md): The OnCrawl Log Manager Tool is an interface that can help you understand and monitor your logs uploading and parsing processes.
- [How to calculate the number of resources needed for log analysis](https://help.oncrawl.com/en/articles/2325141-how-to-calculate-the-number-of-resources-needed-for-log-analysis.md): OnCrawl log analysis levels are based on the number of lines in your logs. Here's how to estimate how many lines you need.
- [Receive alerts when no new log data is received](https://help.oncrawl.com/en/articles/5253168-receive-alerts-when-no-new-log-data-is-received.md): Oncrawl will alert you by email if we don't have recent, usable data from your logs. Here's how to set up the alerts.
- [How to resolve log monitoring alerts](https://help.oncrawl.com/en/articles/5253170-how-to-resolve-log-monitoring-alerts.md): Oncrawl will alert you by email if we don't have recent, usable data from your logs. Here's how to resolve an issue if you receive an alert.

## Best practices & guides

- [How to segment groups of pages based on your Data Layer - Google Tag Manager example](https://help.oncrawl.com/en/articles/501568-how-to-segment-groups-of-pages-based-on-your-data-layer-google-tag-manager-example.md): Want to make your Google Analytics data consistent with OnCrawl data & reports? Here is how to create categories based on your Data Layer
- [How to create a segmentation](https://help.oncrawl.com/en/articles/1954782-how-to-create-a-segmentation.md): Create page groups \(segments\) and categorize pages according to any metrics you want.
- [Segmentation and page groups](https://help.oncrawl.com/en/articles/2325099-segmentation-and-page-groups.md): Segmentation is a way of creating page groups in order to view your technical SEO data in a meaningful way.
- [How to use regex to define page groups](https://help.oncrawl.com/en/articles/2536034-how-to-use-regex-to-define-page-groups.md): You can use regular expressions \(regex\) to create segmentations with page groups based on information in URLs and other metrics.
- [How to create a segmentation based on scraped data for publication dates](https://help.oncrawl.com/en/articles/2564610-how-to-create-a-segmentation-based-on-scraped-data-for-publication-dates.md): You need to analyze your pages based on publication date, relative to today's date. We'll take it step by step.
- [Crawl frequency](https://help.oncrawl.com/en/articles/404275-crawl-frequency.md): What is crawl frequency? Best practices to crawl frequency?
- [Crawl ratio & unique pages](https://help.oncrawl.com/en/articles/404276-crawl-ratio-unique-pages.md): How to optimize crawl ratio? What are unique pages?
- [Crawl part of a website](https://help.oncrawl.com/en/articles/411078-crawl-part-of-a-website.md): Use a virtual robots.txt in order to limit the crawl to a subset of pages on a website
- [How \(and why\) to use a virtual robot.txt file](https://help.oncrawl.com/en/articles/1155162-how-and-why-to-use-a-virtual-robot-txt-file.md): Use a virtual robot.txt file to tell the Oncrawl bot how to crawl your site
- [How to quickly scan and analyze a list of URLs?](https://help.oncrawl.com/en/articles/1346961-how-to-quickly-scan-and-analyze-a-list-of-urls.md): Sometimes you may need to analyze a more or less important list of URLs without browsing the entire site. Here is how to proceed.
- [How to check URLs in a sitemap](https://help.oncrawl.com/en/articles/1546583-how-to-check-urls-in-a-sitemap.md): Here is how to make sure that your sitemaps will be taken into account during the analysis
- [Customize your user-agent in Oncrawl](https://help.oncrawl.com/en/articles/2249336-customize-your-user-agent-in-oncrawl.md): Learn how to change the bot identity used to crawl your website.
- [How to explore all of the URLs in my sitemap](https://help.oncrawl.com/en/articles/2436240-how-to-explore-all-of-the-urls-in-my-sitemap.md): Sometimes you just want data on the URLs in your sitemap. It's possible to do this using a list of URLs with Oncrawl.
- [Dealing with Duplicate Content: SEO Best Practices](https://help.oncrawl.com/en/articles/404237-dealing-with-duplicate-content-seo-best-practices.md): Manage duplicate content effectively with Oncrawl’s best practices to enhance SEO and improve rankings.
- [Using the Management of pages with content duplication issues chart](https://help.oncrawl.com/en/articles/1656594-using-the-management-of-pages-with-content-duplication-issues-chart.md): Explore how Oncrawl's Duplicate Content Cluster Map works to identify and manage duplicate content on your site. Learn about content blocks,
- [Text to Code ratio](https://help.oncrawl.com/en/articles/2625919-text-to-code-ratio.md): Learn about the text to code ratio and its significance in SEO. Discover how it can indicate technical issues and impact page performance.
- [Content Lens scoring and metrics definitions](https://help.oncrawl.com/en/articles/15431888-content-lens-scoring-and-metrics-definitions.md): Understand how the content quality feature rates your webpages content
- [Content Lens Guide - How to enable the content quality analysis](https://help.oncrawl.com/en/articles/15433340-content-lens-guide-how-to-enable-the-content-quality-analysis.md): How to use the content lens and best practices
- [Understanding Status Codes in SEO](https://help.oncrawl.com/en/articles/404175-understanding-status-codes-in-seo.md): Understand the SEO impact of HTTP status codes like 200, 301, 404 with Oncrawl and the best practices involving them.
- [Understanding SEO Visits in Oncrawl](https://help.oncrawl.com/en/articles/404369-understanding-seo-visits-in-oncrawl.md): Learn what SEO visits are in Oncrawl and the best practices for increasing them.
- [How can I find the target of a 3xx \(redirection\) status code?](https://help.oncrawl.com/en/articles/2120991-how-can-i-find-the-target-of-a-3xx-redirection-status-code.md): 3xx status codes indicate a redirected page. Here’s how to find the page that was redirected, as well as the page it was redirected to.
- [How does Oncrawl calculate load time?](https://help.oncrawl.com/en/articles/2570655-how-does-oncrawl-calculate-load-time.md): This article explores what is load time and how it is calculated in Oncraw.
- [Data scraping and custom fields](https://help.oncrawl.com/en/articles/1062534-data-scraping-and-custom-fields.md): Data scraping is an option that allows you to analyse a portion of the source code extracted during a crawl using custom fields.
- [How to use REGEX in Oncrawl](https://help.oncrawl.com/en/articles/1155188-how-to-use-regex-in-oncrawl.md): Use pattern detection in fields to get to the essentials faster. Use regular expressions to create filters \(Data Explorer & Segmentations\)
- [Lucene REGEX Cheat Sheet](https://help.oncrawl.com/en/articles/1685982-lucene-regex-cheat-sheet.md): In this article you'll learn how to use Regex with Oncrawl. This article is based on the Elastic Search Article
- [How to create a file listing all links pointing to a 301 URL, the old URL, and the new URL](https://help.oncrawl.com/en/articles/1044515-how-to-create-a-file-listing-all-links-pointing-to-a-301-url-the-old-url-and-the-new-url.md): You have permanently redirected \(301\) URLs. Here's how to create a list of all the links, the URL, and the URL they are redirected to.
- [Filtering URLs on dashboards with an OQL filter](https://help.oncrawl.com/en/articles/9859059-filtering-urls-on-dashboards-with-an-oql-filter.md): Filter out pages you don't want to see in your charts
- [Build your own chart and leverage all Oncrawl data endpoints](https://help.oncrawl.com/en/articles/11027404-build-your-own-chart-and-leverage-all-oncrawl-data-endpoints.md): Take complete control of your chart design and easily create a variety of visualizations

## Oncrawl bot behavior

- [What counts as a single URL in Oncrawl?](https://help.oncrawl.com/en/articles/2767544-what-counts-as-a-single-url-in-oncrawl.md): Understand how Oncrawl handles URL variations during a crawl
- [How does the Oncrawl bot find and crawl pages?](https://help.oncrawl.com/en/articles/2767653-how-does-the-oncrawl-bot-find-and-crawl-pages.md): What does Oncrawl's bot do to find and crawl pages? In this article, we explain how it works.
- [Oncrawl bot: what URLs are known, crawled and analyzed?](https://help.oncrawl.com/en/articles/2771616-oncrawl-bot-what-urls-are-known-crawled-and-analyzed.md): What pages does Oncrawl know about, crawl, and analyze?
- [What files are considered to be "resources" in Oncrawl?](https://help.oncrawl.com/en/articles/5824431-what-files-are-considered-to-be-resources-in-oncrawl.md): When the crawler or log analyzer encounters a reference to certain types of files, it groups them as "resources". Here's the complete list.
- [What browers can I use with Oncrawl?](https://help.oncrawl.com/en/articles/10032887-what-browers-can-i-use-with-oncrawl.md): Oncrawl supports most recent browsers. Check to find out whether yours is compatible.

## Glossary

- [Glossary of terms used in Oncrawl](https://help.oncrawl.com/en/articles/3810681-glossary-of-terms-used-in-oncrawl.md): Where to start if you don't know what something means
- [Understanding Redirect Loops and Chains: SEO Impact](https://help.oncrawl.com/en/articles/2371603-understanding-redirect-loops-and-chains-seo-impact.md): Improve SEO and UX by resolving redirect loops and chains with Oncrawl's identification and resolution tools.
- [What are compliant pages?](https://help.oncrawl.com/en/articles/1541886-what-are-compliant-pages.md): Oncrawl has a page categorization feature that allows you to see which pages can be indexed \(i.e. compliant pages\) and which ones can't.
- [Orphan pages](https://help.oncrawl.com/en/articles/404268-orphan-pages.md): What are orphan pages? How to find and fix them with Oncrawl.
- [Active pages](https://help.oncrawl.com/en/articles/404267-active-pages.md): What are active pages?
- [Active orphan pages](https://help.oncrawl.com/en/articles/404341-active-orphan-pages.md): What are active orphan pages?
- [Fresh Rank](https://help.oncrawl.com/en/articles/404279-fresh-rank.md): What is the Fresh Rank? How is it calculated?
- [Meta Tags](https://help.oncrawl.com/en/articles/404084-meta-tags.md): What are the main meta tags used in SEO? How to optimize meta tags?
- [HTML tags reports in Oncrawl](https://help.oncrawl.com/en/articles/404092-html-tags-reports-in-oncrawl.md): What are the HTML tags that are important in SEO and where to see them in Oncrawl
- [Social tags](https://help.oncrawl.com/en/articles/404188-social-tags.md): What are social tags and how to use them
- [Word count distribution](https://help.oncrawl.com/en/articles/404241-word-count-distribution.md): Understand how word count can impact your SEO and which Oncrawl charts can help you identify where you may have thin content.
- [Structured data](https://help.oncrawl.com/en/articles/404191-structured-data.md): What are structured data & schema.org? How to optimize structured data?
- [N-grams](https://help.oncrawl.com/en/articles/404245-n-grams.md): What are n-grams? Why look at n-grams for SEO?
- [How to use Saved Filters](https://help.oncrawl.com/en/articles/10740974-how-to-use-saved-filters.md): A filter can now be saved in Oncrawl and be reuse across the platform among: data explorer, segmentations, alerts, reports.
- [Inrank: Understanding Oncrawl's SEO Visibility Metric](https://help.oncrawl.com/en/articles/404228-inrank-understanding-oncrawl-s-seo-visibility-metric.md): Utilize Oncrawl’s Inrank metric for SEO visibility, understanding its calculation, significance, and application in SEO.
- [Canonical URLs](https://help.oncrawl.com/en/articles/404229-canonical-urls.md): Explore how to use rel=canonical and the data available in Oncrawl for analysis of your canonical strategy
- [Follow - Nofollow](https://help.oncrawl.com/en/articles/404234-follow-nofollow.md): How to use follow nofollow attributes?
- [Page depth](https://help.oncrawl.com/en/articles/404190-page-depth.md): How to optimize page depth?
- [Hreflangs and translated pages](https://help.oncrawl.com/en/articles/1479694-hreflangs-and-translated-pages.md): How to use hreflang rel=alternate tags to manage translated pages
- [Load Time](https://help.oncrawl.com/en/articles/404095-load-time.md): How to optimize load time?

## Account, quotas & team management

- [How to recover a lost password](https://help.oncrawl.com/en/articles/2120233-how-to-recover-a-lost-password.md): What to do if you forgot your password.
- [How to remove Google Analytics or Google Search Console from your project](https://help.oncrawl.com/en/articles/2518968-how-to-remove-google-analytics-or-google-search-console-from-your-project.md): Learn how to disconnect Google Analytics or Google Search Console from your Oncrawl project with these step-by-step instructions.
- [Rename a project](https://help.oncrawl.com/en/articles/3695945-rename-a-project.md): Need to change the name of a project? It's easy.
- [Projects](https://help.oncrawl.com/en/articles/6606462-projects.md): What is a project in Oncrawl and how to manage projects
- [Invite a new member to a workspace](https://help.oncrawl.com/en/articles/1735751-invite-a-new-member-to-a-workspace.md): How to invite someone to view or collaborate in Oncrawl
- [Workspaces](https://help.oncrawl.com/en/articles/8167267-workspaces.md): What are workspaces and how to use them
- [Manage workspace members with access to a project](https://help.oncrawl.com/en/articles/8368946-manage-workspace-members-with-access-to-a-project.md): How to check or modify the workspace members with access to a specific project
- [Monthly crawl quota tokens: what are they and how they work](https://help.oncrawl.com/en/articles/5349409-monthly-crawl-quota-tokens-what-are-they-and-how-they-work.md): Oncrawl plans function on the basis of monthly quotas. Learn what it means and how to manage it effectively.

## Data export & API

- [Getting Started with the Oncrawl API](https://help.oncrawl.com/en/articles/1148410-getting-started-with-the-oncrawl-api.md): Oncrawl is based on a platform built around an API. Create your own application to request this API very easily. Here's how to do it.
- [Big Data Export for Google Bucket](https://help.oncrawl.com/en/articles/4043045-big-data-export-for-google-bucket.md): Follow this tutorial to use the Big Data Export to send crawl and link data to your Google bucket.
- [Big Data Export for AWS \(Amazon S3\)](https://help.oncrawl.com/en/articles/4097568-big-data-export-for-aws-amazon-s3.md): Follow this tutorial to use the Big Data Export to send crawl and link data to AWS \(Amazon S3\).
- [Download center](https://help.oncrawl.com/en/articles/8178515-download-center.md): How to manage very large exports from Oncrawl
- [Oncrawl connector for Looker Studio](https://help.oncrawl.com/en/articles/3704487-oncrawl-connector-for-looker-studio.md): Answers to your questions about the Oncrawl Looker Studio \(ex Data Studio\) connector
- [Setting up your Looker Studio connector in 10 steps](https://help.oncrawl.com/en/articles/4459755-setting-up-your-looker-studio-connector-in-10-steps.md): Step-by-step guide to getting your Oncrawl Looker Studio connector up and running
- [Introduction to the Oncrawl MCP Server](https://help.oncrawl.com/en/articles/14196013-introduction-to-the-oncrawl-mcp-server.md): Connect Oncrawl to your AI tools with the MCP Server to access data, automate actions, and speed up your SEO workflows.
- [Oncrawl MCP Server – Tools reference](https://help.oncrawl.com/en/articles/14211468-oncrawl-mcp-server-tools-reference.md): Discover the Oncrawl MCP tools… access data, run analyses, and manage SEO operations directly from your AI assistant.
- [Getting started with the Oncrawl AI Assistant](https://help.oncrawl.com/en/articles/14804468-getting-started-with-the-oncrawl-ai-assistant.md): Use the Oncrawl AI Assistant to explore your SEO data, run analyses, and perform actions directly from your Oncrawl account.

## Trouble-shooting

- [How to check if Oncrawl services are up or down](https://help.oncrawl.com/en/articles/4528886-how-to-check-if-oncrawl-services-are-up-or-down.md): Check whether everything's working as expected and receive maintenance notifications
- [Use reasonable-surfer weighting in Inrank](https://help.oncrawl.com/en/articles/16119201-use-reasonable-surfer-weighting-in-inrank.md): Use zone-based weighting to distribute Inrank according to the position of internal links on each page.
- [Why does my report only contain one URL?](https://help.oncrawl.com/en/articles/1155167-why-does-my-report-only-contain-one-url.md): What to do if your crawl results yield an analysis with only one URL.
- [How to crawl a site that uses JavaScript](https://help.oncrawl.com/en/articles/1155180-how-to-crawl-a-site-that-uses-javascript.md): If all or part of your website is built using JavaScript \(JS\), you may need to render pages in order to for a bot to be able to crawl them.
- [Why is my crawl blocked at one URL / Why won't my crawl start?](https://help.oncrawl.com/en/articles/2565144-why-is-my-crawl-blocked-at-one-url-why-won-t-my-crawl-start.md): Your crawl won't start or is stuck after one or two URLs. That's no good! Here are some of the most common issues and how to fix them.
- [How to bypass geographic redirects by crawling with HTTP headers](https://help.oncrawl.com/en/articles/2958167-how-to-bypass-geographic-redirects-by-crawling-with-http-headers.md): Crawl problems because your site redirects the Oncrawl bot because it doesn't have the right location-based cookie? Here's how to fix it.
- [How to modify crawl limits while crawling](https://help.oncrawl.com/en/articles/3136175-how-to-modify-crawl-limits-while-crawling.md): How to change crawl speed and max crawl depth after launching your crawl
- [What to do when my graphs are empty](https://help.oncrawl.com/en/articles/1155176-what-to-do-when-my-graphs-are-empty.md): What to do if you ran a crawl, but your graphs and charts aren't showing any data
- [Why is my data different between Oncrawl and Google Analytics \(GA4\)](https://help.oncrawl.com/en/articles/1394643-why-is-my-data-different-between-oncrawl-and-google-analytics-ga4.md): Are you seeing differences between numbers in Google Analytics \(GA4\) and numbers in Oncrawl, when looking at your GA4 data?
- [Archived crawls and how to un-archive them](https://help.oncrawl.com/en/articles/2282266-archived-crawls-and-how-to-un-archive-them.md): Oncrawl archives old crawls. The data's still there. Here's how to unarchive all or part of an archived crawl.
- [Migrating from GA Universal Analytics to GA4 in Oncrawl](https://help.oncrawl.com/en/articles/8002645-migrating-from-ga-universal-analytics-to-ga4-in-oncrawl.md): Are you replacing your GA-UA account with GA4? Here's everything you need to do to update your data sources in Oncrawl.
- [What format can I use for my sitemaps?](https://help.oncrawl.com/en/articles/2121166-what-format-can-i-use-for-my-sitemaps.md): You can use sitemaps to compare and add data to a crawl. Here are the formats Oncrawl supports.
- [How to Open and Work with CSV Files in Excel or Sheets](https://help.oncrawl.com/en/articles/3011405-how-to-open-and-work-with-csv-files-in-excel-or-sheets.md): Handle CSV files effectively in Excel/Sheets with insights from Oncrawl's Data Explorer and enhance your data management skills.