Skip to main content

Advice and answers from the Oncrawl Team

Search results for:log
Log monitoring date ranges
What dates are covered in the log monitoring report? How can you change the period or the level of detail?… Log monitoring data is available by day, by week, or by month in the Log Monitoring Report… Best practices for log monitoring date ranges
How to filter log lines
Don't want to share everything? Want faster processing? Remove unnecessary lines from your logs before uploading to OnCrawl… You may want to use OnCrawl's SEO log monitoring solution but not want to share all of your server log… You can filter your log lines and provide OnCrawl with only the log lines that are useful for SEO analysis
Server side log format configuration
Learn how to setup your server log configuration regarding the type of server you are using… W3C Extended Log File Format… NSCA Common Log File Format
How to resolve log monitoring alerts
Oncrawl will alert you by email if we don't have recent, usable data from your logs. Here's how to resolve an issue if you receive an alert… No useful log lines for the threshold period in the latest files… The log files you send us contain data, but can't be parsed
Log Monitoring Setup Step-by-step
Prerequisite: An Oncrawl Log Monitoring Subscription… you have access to the right log files Check your log format Prepare answers to parsing… questions Activate log monitoring in your project Check access to log file storage location
Oncrawl log analyzer supported bot list
The following list includes all bots currently supported in the Oncrawl platform. The list is continuously updated to ensure accurate log monitoring
How to reduce the size of log files
The size of access log files can be easily reduced by 95% with pre-filtering and compression… Reducing the size of access log files before sending them to ftp.oncrawl.com make them much faster to… You can use your favorite compression program to compress access log files before sending them
Receive alerts when no new log data is received
Oncrawl will alert you by email if we don't have recent, usable data from your logs. Here's how to set up the alerts… When setting up log monitoring… Oncrawl can alert you to problems in your log monitoring process that prevent you from being able to
[Tutorial] How to upload a log file to OnCrawl
Need help getting started with log file analysis? Here's one place to start!… To upload a log file to OnCrawl, you will first need to activate log monitoring for this project, and… Each request is a log line, and looks something like this
How to set up log monitoring if you use GCP
Do you use a Google Cloud Storage bucket to store your log data? Here's how to connect your logs to OnCrawl… uploading log data to OnCrawl… In the GCS browser, click on the name of the bucket containing your log files