How to log the spider's visit in my http web server log file? - Site Owners Forums

wryfhk22 · 09-17-2011, 01:54 AM

Hi, there was a time when I use the weblog expert to view the statistic of my site, the sample that came with the software was showing what crawlers that had visited the site within a period. In my http web server log file doesn't show this as well as the analysis result.

My question : Is there anything to be set in order to log the spider's visit to my site?

Thanks a million.

markbensonseo · 09-18-2011, 11:49 AM

we can't get exact details of specific spider.

tahir741 · 09-26-2014, 02:21 AM

I think there is no log to get spiders information on visit of website

09-17-2011, 01:54 AM	#1
wryfhk22 Registered User Join Date: Mar 2011 Posts: 267	How to log the spider's visit in my http web server log file? Hi, there was a time when I use the weblog expert to view the statistic of my site, the sample that came with the software was showing what crawlers that had visited the site within a period. In my http web server log file doesn't show this as well as the analysis result. My question : Is there anything to be set in order to log the spider's visit to my site? Thanks a million. __________________ *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.*

09-18-2011, 11:49 AM	#2
markbensonseo Registered User Join Date: Jan 2011 Posts: 29	we can't get exact details of specific spider. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

09-26-2014, 02:21 AM	#3
tahir741 Registered User Join Date: Sep 2014 Location: India Posts: 139	I think there is no log to get spiders information on visit of website __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)