Understanding how the Oncrawl bot works
5 articles
What counts as a single URL in Oncrawl?Understand how Oncrawl handles URL variations during a crawl
How does the Oncrawl bot find and crawl pages?What does Oncrawl's bot do to find and crawl pages? In this article, we explain how it works.
Oncrawl bot: what URLs are known, crawled and analyzed?What pages does Oncrawl know about, crawl, and analyze?
What files are considered to be "resources" in Oncrawl?When the crawler or log analyzer encounters a reference to certain types of files, it groups them as "resources". Here's the complete list.
What browers can I use with Oncrawl?Oncrawl supports most recent browsers. Check to find out whether yours is compatible.