|
Notices |
|
Thread Tools | Rate Thread | Display Modes |
![]() |
#14 |
Registered User
Join Date: Mar 2016
Posts: 20
|
Robots.txt file is used to give instruction to the search engine crawler to which page has to crawled or not by allowing or disallowing.
|
![]() |
![]() |
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
|
|