![]() |
#2 |
Registered User
Join Date: Mar 2012
Posts: 259
|
Robots.txt file can be used to tell search engines that which of your website pages/directories should not be crawled.
|
![]() |
![]() |
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
|
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
sitemap.xml and robots.txt? | jamesranatte | Search Engine Optimization | 5 | 01-31-2012 11:16 PM |