We let you specify the name of the user agent (the name of the bot) that will be used to crawl your site.

You may want to do this if your site is performing differently for Google's crawler than for OnCrawl's, or if your site restricts access to bots based on their user agent name.

You'll need to modify this in the crawl settings before running your crawl. Here's how.

Modify the user agent name in the crawl settings

From the project page, click "Set up new crawl" to open the crawl settings page.

Click on "Crawl bot" to expand the section.

The field "Bot name" is required. By default, we name our bot "OnCrawl", but you can replace this with anything you'd like.

The full user agent that will be used is displayed on the right.

That's it!

Going further

If you still have questions about the OnCrawl bot and its user agent, feel free to drop us a line at @oncrawl_cs or click on the Intercom button at the bottom right of your screen to start a chat with us.

Happy crawling!

You can also find this article by searching for:
cambiar el nombre del user-agent
changer le nom de l'user-agent

Did this answer your question?