Apache

Recommended format:

LogFormat "%{HOST}i:%p %h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"" combined_host_ssl
  • %{HOST}i : hostname of the query
  • %p : server port
  • %h : client IP
  • %l : remote logname. Not used by OnCrawl by standard in log formats
  • %u : remote user. Not used by OnCrawl by standard in log formats
  • %t : request date time
  • %r : first line of request
  • %>s : response status code
  • %b : size of the response in bytes
  • %{Referer}i : referer
  • %{User-Agent}i : User agent

Full documentation: 

https://httpd.apache.org/docs/2.2/en/mod/mod_log_config.html#page-header

Nginx

Recommended format:

log_format combined_vhosts '$host:$server_port $remote_addr - $remote_user [$time_local] "$request" $status $body_bytes_sent "$http_referer" "$http_user_agent"';

Reference documentation:

Nginx log_format
Nginx variables

Did this answer your question?