What is robots.txt? - Site Owners Forums

		Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization
What is robots.txt?

FAQ

Calendar

Today's Posts

Mark Forums Read

Notices

Welcome to SiteOwnersForums.com #1 Webmasters Community Online

You are currently viewing our forum as a guest which gives you limited access.
Membership is absolutely FREE and registration is FAST & SIMPLE so please, Register Today and join one of the friendliest communities on the net!
If you have any problems with the registration process or your account login, please contact us.

Thread Tools

Rate Thread

Display Modes

12-11-2012, 11:53 PM	#12
ronaldotson45 Registered User Join Date: Dec 2012 Posts: 5	Robot.txt file indicate search crawler which information in this website is prohibited or do not crawl. if owner of the site does not want any of the file to be indexed or crawled by robot or spider then robot.txt file being used

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools
Show Printable Version Email this Page
Display Modes	Rate This Thread
Switch to Linear Mode Switch to Hybrid Mode Threaded Mode	Rate This Thread:

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is Off HTML code is Off Forum Rules

Forum Jump

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Evil bots consuming all my sites traffic even after i disallowed them in robots.txt	Fking	General Discussion	1	12-13-2013 11:27 PM
Robots.txt	sameerseo	Search Engine Optimization	26	09-28-2012 04:18 AM
robots.txt	wheelbarrow001	Google	2	07-27-2012 04:10 AM
Unable to delete robots.txt file	notfake	Yahoo	0	04-29-2012 02:19 AM
What Is Robots.txt?	samlko	Search Engine Optimization	13	03-09-2012 02:37 PM

All times are GMT -7. The time now is 03:02 AM.