Thread: What is the use of Robots.txt?
View Single Post
Old 10-23-2015, 03:17 AM   #5
NancyFernandes
Registered User
 
Join Date: Mar 2015
Location: Mumbai
Posts: 91
Quote:
Originally Posted by omkarsoft View Post
Hello Friends,

Please tell me about, What is the use of Robots.txt?
Robots.txt helps to tell bots, which pages of the website need to be crawled and which should be avoided. Robots tag is the alternate of Robots.txt file, the only difference is tag need to be mentioned in each and every web page of a website, whereas .txt file is uploaded only once i.e at the root of the website.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
NancyFernandes is offline   Reply With Quote