Prerequisite: an active subscription to OnCrawl Advanced
Which files should I upload?
Web servers create multiple log files. The relevant information for SEO analysis lies in access log files. These files contain every request made to the web server, one request per line. It usually looks like:
127.0.0.1 - - [28/Aug/2015:06:45:41 +0200] "GET /apache_pb.gif HTTP/1.0" 200 2326 "http://www.example.com/start.html" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
The required fields are:
- date with time and timezone
- User Agent
- status code
- size of response in bytes
- port of the request (80 on HTTP / 443 on HTTPS)
- client IP
Uploading log files to OnCrawl FTP
You identified which files to transfer to OnCrawl. Now open your favorite FTP client and open a connection to:
Username: <your OnCrawl username>
Password: <your OnCrawl password>
Navigate to the directory matching the name of your project.
Upload one or more files into that directory.
You're (almost) done! If your access log files have a standard format they will be automatically processed by OnCrawl and appear in the log monitoring section of your project.
How should I name the log files?
OnCrawl will process any file that you upload to the project directory. You are free to name the files the way you want.
A good practice is to include the date in the filename because they are easier to find afterward.
If you have multiple servers, you may also include the server name in the file names to make sure the files do not overwrite each other. Another option is to create one directory per server and send the log file of each server to its specific directory.