URLs

The URLs tab aggregates the log file data for every unique URL discovered, based upon the chosen time period and user-agent(s). These can both be configured in the top right hand corner.

The summarised data includes the following –

• URL – The URL discovered.
• Last Response Code – The last response code from events.
• Time Of Last Response – The date and time of the last log event.
• Days Since Last Crawl – Days since a URL was crawled based upon the time of last response, and last date of events available in the log file uploaded.
• Content Type – The content type is guessed from the file extension, as it’s not provided in a log file and there is no crawling involved. So it’s not from the HTTP response. Hence, these will not be completely accurate, merely a best guess at this stage.
• Total Bytes – The total bytes downloaded of all log events for the URL.
• Average Bytes – The average size in bytes of all log events for the URL.
• Total CO2 (mg) – The total CO2 in mg of all log events for the URL.
• Average CO2 (mg) – The average CO2 in mg of all log events for the URL.
• Average Response Time (ms) – The length of time taken (measured in milliseconds) to download the URL on average.
• Num Events – The total number of events for the URL.
• All Bots – The total number of bot events for the URL.
• Googlebot – The total number of Googlebot events for the URL.
• Bingbot – The total number of Bingbot events for the URL.
• Googlebot Mobile – The total number of Googlebot Mobile events for the URL.
• Googlebot Smartphone – The total number of Googlebot Smartphone events for the URL.
• Yandex – The total number of Yandex events for the URL.
• Baidu – The total number of Baidu events for the URL.