What Is Robot File . - Site Owners Forums

listylesy · 11-20-2015, 02:09 AM

Hello Friends.
Please Tell Me.
What Is Robot File ?

NancyFernandes · 11-20-2015, 03:18 AM

Robot File helps to tell search engine, which pages of website need to be crawled and which need to be avoided. It is the first file, which is checked by the bots after visiting the website.

Nexgenwebmaster · 11-20-2015, 03:33 AM

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

CarolineMurphy · 11-20-2015, 03:36 AM

Robots.txt is a text file which you put in your site to tell search engine bot which pages you would like them not to crawl.

Martinricky · 11-20-2015, 03:47 AM

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

NetgainsTech · 11-20-2015, 03:49 AM

robots.txt file help in blocking unwanted pages from Google search result by disallowing bots to crawl particular pages.

jootavoota · 11-20-2015, 03:56 AM

robot.txt is use for make understand to googlebot.

smmexpertss · 11-20-2015, 11:44 PM

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

SanGoku · 11-21-2015, 03:06 AM

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

Pillars · 11-21-2015, 03:38 AM

Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit.

ArvindSingh · 11-21-2015, 10:44 AM

robot file is very important

11-20-2015, 02:09 AM	#1
listylesy Registered User Join Date: Oct 2015 Posts: 20	What Is Robot File . Hello Friends. Please Tell Me. What Is Robot File ? __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

11-20-2015, 03:18 AM	#2
NancyFernandes Registered User Join Date: Mar 2015 Location: Mumbai Posts: 91	Robot File helps to tell search engine, which pages of website need to be crawled and which need to be avoided. It is the first file, which is checked by the bots after visiting the website. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

11-20-2015, 03:33 AM	#3
Nexgenwebmaster Registered User Join Date: Nov 2015 Posts: 4	Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: " means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.*

11-20-2015, 03:36 AM	#4
CarolineMurphy Registered User Join Date: Mar 2015 Posts: 124	Robots.txt is a text file which you put in your site to tell search engine bot which pages you would like them not to crawl. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. , To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

11-20-2015, 03:47 AM	#5
Martinricky Registered User Join Date: Aug 2015 Posts: 434	Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: " means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

11-20-2015, 03:49 AM	#6
NetgainsTech Registered User Join Date: Sep 2015 Location: India Posts: 36	robots.txt file help in blocking unwanted pages from Google search result by disallowing bots to crawl particular pages. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

11-20-2015, 03:56 AM	#7
jootavoota Registered User Join Date: Apr 2015 Posts: 43	robot.txt is use for make understand to googlebot. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. , To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. , To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

11-20-2015, 11:44 PM	#8
smmexpertss Registered User Join Date: Sep 2015 Location: UK Posts: 447	Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

11-21-2015, 03:06 AM	#9
SanGoku Registered User Join Date: Apr 2013 Posts: 382	Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

11-21-2015, 03:38 AM	#10
Pillars Registered User Join Date: Aug 2015 Location: Chennai, TN, India Posts: 362	Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

11-21-2015, 10:44 AM	#11
ArvindSingh Registered User Join Date: Nov 2015 Posts: 143	robot file is very important

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools
Show Printable Version Email this Page
Display Modes	Rate This Thread
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode	Rate This Thread:

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Computer File Name Extensions	johnsoncla	Social Networks	2	03-19-2015 03:09 AM
What do you mean by Robot. txt file?	davidwrenint	Search Engine Optimization	2	08-25-2014 01:32 AM
telepresence robot	hemnchy	General Discussion	1	01-02-2014 04:35 AM
RSS Feed	rajivwebads	Search Engine Optimization	12	08-31-2012 07:15 AM
include file using html	ncjbhd	HTML / DHTML	0	10-17-2011 12:21 AM