Skip to main content

Advice and answers from the Oncrawl Team

Search results for:log

Log monitoring date ranges
What dates are covered in the log monitoring report? How can you change the period or the level of detail?… Log monitoring data is available by day, by week, or by month in the Log Monitoring Report… Best practices for log monitoring date ranges
How to filter log lines
Don't want to share everything? Want faster processing? Remove unnecessary lines from your logs before uploading to OnCrawl… You may want to use Oncrawl's SEO log monitoring solution but not want to share all of your server log… You can filter your log lines and provide OnCrawl with only the log lines that are useful for SEO analysis
Server side log format configuration
Learn how to setup your server log configuration regarding the type of server you are using… W3C Extended Log File Format… NSCA Common Log File Format
How to resolve log monitoring alerts
Oncrawl will alert you by email if we don't have recent, usable data from your logs. Here's how to resolve an issue if you receive an alert… No useful log lines for the threshold period in the latest files… The log files you send us contain data, but can't be parsed
Log Monitoring Setup Step-by-step
Prerequisite: An Oncrawl Log Monitoring Subscription… you have access to the right log files Check your log format Prepare answers to parsing… questions Activate log monitoring in your project Check access to log file storage location
How to reduce the size of log files
The size of access log files can be easily reduced by 95% with pre-filtering and compression… Reducing the size of access log files before sending them to ftp.oncrawl.com make them much faster to… You can use your favorite compression program to compress access log files before sending them
Receive alerts when no new log data is received
Oncrawl will alert you by email if we don't have recent, usable data from your logs. Here's how to set up the alerts… When setting up log monitoring… Oncrawl can alert you to problems in your log monitoring process that prevent you from being able to
How to set up log monitoring if you use GCP
Do you use a Google Cloud Storage bucket to store your log data? Here's how to connect your logs to OnCrawl… uploading log data to OnCrawl… In the GCS browser, click on the name of the bucket containing your log files
How often should I upload new log files to OnCrawl?
Log monitoring only works if it is constantly and continuously updated. How often should you upload new logs?… If you aren't interested in live log monitoring, you should upload new log data about once per day… You can use the Log Manager Tools to track and report on how often you upload log files to OnCrawl
How to calculate the number of resources needed for log analysis
OnCrawl log analysis levels are based on the number of lines in your logs. Here's how to estimate how many lines you need… Estimate the number of log entries per day and per month… Using log analysis with SEA and vertical search optimization bots