What is the use of Robots.txt? - Site Owners Forums

		Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization > Google
What is the use of Robots.txt?

FAQ

Calendar

Today's Posts

Notices

Welcome to SiteOwnersForums.com #1 Webmasters Community Online

You are currently viewing our forum as a guest which gives you limited access.
Membership is absolutely FREE and registration is FAST & SIMPLE so please, Register Today and join one of the friendliest communities on the net!
If you have any problems with the registration process or your account login, please contact us.

Thread Tools

Rate Thread

Display Modes

10-23-2015, 03:17 AM

NancyFernandes

Registered User

Join Date: Mar 2015

Location: Mumbai

Posts: 91

Quote:

Originally Posted by omkarsoft

Hello Friends,

Please tell me about, What is the use of Robots.txt?

Robots.txt helps to tell bots, which pages of the website need to be crawled and which should be avoided. Robots tag is the alternate of Robots.txt file, the only difference is tag need to be mentioned in each and every web page of a website, whereas .txt file is uploaded only once i.e at the root of the website.

__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Forum Rules

Forum Jump

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Crawlers, spider & robots.txt?	jackthomas087	Search Engine Optimization	0	04-22-2014 03:29 AM
Evil bots consuming all my sites traffic even after i disallowed them in robots.txt	Fking	General Discussion	1	12-13-2013 11:27 PM
How to edit virtual robots.txt file in wordpress?	geniusoptimizer	PHP / mySQL	1	04-12-2013 12:36 PM
The robots.txt file	rubberfender	Yahoo	0	12-02-2012 07:32 PM
Unable to delete robots.txt file	notfake	Yahoo	0	04-29-2012 02:19 AM

All times are GMT -7. The time now is 02:31 AM.