What Is Robot File . - Site Owners Forums

listylesy · 11-20-2015, 02:09 AM

Hello Friends.
Please Tell Me.
What Is Robot File ?

NancyFernandes · 11-20-2015, 03:18 AM

Robot File helps to tell search engine, which pages of website need to be crawled and which need to be avoided. It is the first file, which is checked by the bots after visiting the website.

Nexgenwebmaster · 11-20-2015, 03:33 AM

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

CarolineMurphy · 11-20-2015, 03:36 AM

Robots.txt is a text file which you put in your site to tell search engine bot which pages you would like them not to crawl.

Martinricky · 11-20-2015, 03:47 AM

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

NetgainsTech · 11-20-2015, 03:49 AM

robots.txt file help in blocking unwanted pages from Google search result by disallowing bots to crawl particular pages.

jootavoota · 11-20-2015, 03:56 AM

robot.txt is use for make understand to googlebot.

smmexpertss · 11-20-2015, 11:44 PM

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

SanGoku · 11-21-2015, 03:06 AM

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

Pillars · 11-21-2015, 03:38 AM

Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit.

ArvindSingh · 11-21-2015, 10:44 AM

robot file is very important

11-20-2015, 02:09 AM	#1
listylesy Registered User Join Date: Oct 2015 Posts: 20	What Is Robot File . Hello Friends. Please Tell Me. What Is Robot File ? __________________ Chennai to tirupati package \| Chennai to tirupati tour package \| Chennai to tirupati car package

11-20-2015, 03:18 AM	#2
NancyFernandes Registered User Join Date: Mar 2015 Location: Mumbai Posts: 91	Robot File helps to tell search engine, which pages of website need to be crawled and which need to be avoided. It is the first file, which is checked by the bots after visiting the website. __________________ Event exhibitions app \| Web based visitor management system \| App for meeting

11-20-2015, 03:33 AM	#3
Nexgenwebmaster Registered User Join Date: Nov 2015 Posts: 4	Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site. __________________ Accountants services in north lakes

11-20-2015, 03:36 AM	#4
CarolineMurphy Registered User Join Date: Mar 2015 Posts: 124	Robots.txt is a text file which you put in your site to tell search engine bot which pages you would like them not to crawl. __________________ Website Designing in Mumbai \| Best SEO Companies \| Top SEO companies in Mumbai \| Website Designing Company in Mumbai \| Web Design Services \| top seo companies \| Web Development Company in Mumbai \| Web Design Company Bangalore, SEO Services in Bangalore

11-20-2015, 03:47 AM	#5
Martinricky Registered User Join Date: Aug 2015 Posts: 434	Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site. __________________ Dentist in Delhi \| Best Dentist in Ashok Vihar \| Best Dentist in Shalimar Bagh \| Best Prosthodontist in Delhi

11-20-2015, 03:49 AM	#6
NetgainsTech Registered User Join Date: Sep 2015 Location: India Posts: 36	robots.txt file help in blocking unwanted pages from Google search result by disallowing bots to crawl particular pages. __________________ Netgains IT Technology

11-20-2015, 03:56 AM	#7
jootavoota Registered User Join Date: Apr 2015 Posts: 43	robot.txt is use for make understand to googlebot. __________________ Website Designing Company in Delhi, Wordpress Web Development, Ecommerce Web Development

11-20-2015, 11:44 PM	#8
smmexpertss Registered User Join Date: Sep 2015 Location: UK Posts: 447	Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

11-21-2015, 03:06 AM	#9
SanGoku Registered User Join Date: Apr 2013 Posts: 382	Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

11-21-2015, 03:38 AM	#10
Pillars Registered User Join Date: Aug 2015 Location: Chennai, TN, India Posts: 362	Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit. __________________ SEO company in chennai SEO services in chennai web development company in chennai web design company in chennai Digital marketing company in chennai Digital marketing training in chennai SEO training in chennai Top seo company in chennai web design in chennai social media marketing in chennai

11-21-2015, 10:44 AM	#11
ArvindSingh Registered User Join Date: Nov 2015 Posts: 143	robot file is very important

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools
Show Printable Version Email this Page
Display Modes	Rate This Thread
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode	Rate This Thread:

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Computer File Name Extensions	johnsoncla	Social Networks	2	03-19-2015 03:09 AM
What do you mean by Robot. txt file?	davidwrenint	Search Engine Optimization	2	08-25-2014 01:32 AM
telepresence robot	hemnchy	General Discussion	1	01-02-2014 04:35 AM
RSS Feed	rajivwebads	Search Engine Optimization	12	08-31-2012 07:15 AM
include file using html	ncjbhd	HTML / DHTML	0	10-17-2011 12:21 AM