Which is better Robots.txt or Meta Robots Tag? - Site Owners Forums

bababangali · 01-27-2017, 03:43 AM

Hello friends,

I would like to know that Which is better Robots.txt or Meta Robots Tag?

wellliving · 01-29-2017, 10:38 PM

Robots.txt files are best for disallowing a whole section of a site, such as a category whereas a meta tag is more efficient at disallowing single files and pages. You could choose to use both a meta robots tag and a robots.txt file as neither has authority over the other, but “noindex” always has authority over “index” requests.

emilyoliver · 01-29-2017, 11:50 PM

I prefer Robot.txt file are best

gurujeet · 01-30-2017, 01:06 AM

I believe Meta Robots is Better than Robots.txt

jamesroben · 02-01-2017, 05:12 AM

In order to exclude individual pages from search engine indices, the noindex meta tag is actually superior to robots.txt. ... You want to use 'noindex,follow' in a robots meta tag, rather than robots.txt , because it will allow the link juice to pass through. It is better from a SEO perspective.

markfernando · 02-01-2017, 05:38 AM

I think robots meta tags are are better then robots.txt.

tyagi · 02-01-2017, 10:24 PM

ROBOTS.TXT file is better because it is a file of that exact name stored in the root of your web server.
It provides instructions to spiders and other web page crawler about what pages of your site they provide and should not visit.

Thank you!

Happy to help you.

jaychristopher · 02-01-2017, 10:35 PM

Why Meta Robots is Better than Robots.txt. Below is an example of about.com's robots.txt file. Notice that they are blocking the directory /library/nosearch/. ... In order to exclude individual pages from search engine indices, the noindex meta tag <meta name="robots" content="noindex"> is actually superior to robots.txt.

jamesrobertt · 02-03-2017, 12:02 AM

Why Meta Robots is Better than Robots.txt. Below is an example of about.com's robots.txt file. Notice that they are blocking the directory /library/nosearch/. ... In order to exclude individual pages from search engine indices, the noindex meta tag <meta name="robots" content="noindex"> is actually superior to robots.txt.

johnkevin · 02-03-2017, 12:08 AM

They Are robots.txt is better.

01-27-2017, 03:43 AM	#1
bababangali Registered User Join Date: Dec 2014 Posts: 198	Which is better Robots.txt or Meta Robots Tag? Hello friends, I would like to know that Which is better Robots.txt or Meta Robots Tag? __________________ World famous best astrologer in India \| Black magic for girlfriend-boyfriend \| kala jadu \| Girl Vashikaran by hair \| How to do black magic tricks

01-29-2017, 10:38 PM	#2
wellliving Registered User Join Date: Dec 2015 Location: USA Posts: 743	Robots.txt files are best for disallowing a whole section of a site, such as a category whereas a meta tag is more efficient at disallowing single files and pages. You could choose to use both a meta robots tag and a robots.txt file as neither has authority over the other, but “noindex” always has authority over “index” requests. __________________ organic bedding \| cotton bedding \| organic cotton bedding \| ocotton bedding sets \| Organic latex pillow

01-30-2017, 01:06 AM	#4
gurujeet Registered User Join Date: Sep 2016 Posts: 84	I believe Meta Robots is Better than Robots.txt __________________ SEO Services in Hyderabad \| Digital marketing companies in Hyderabad

02-01-2017, 05:12 AM	#5
jamesroben Registered User Join Date: Nov 2016 Posts: 124	In order to exclude individual pages from search engine indices, the noindex meta tag is actually superior to robots.txt. ... You want to use 'noindex,follow' in a robots meta tag, rather than robots.txt , because it will allow the link juice to pass through. It is better from a SEO perspective. __________________ Best SEO company outsource seo services USA

02-01-2017, 10:24 PM	#7
tyagi Registered User Join Date: Jan 2017 Posts: 102	ROBOTS.TXT file is better because it is a file of that exact name stored in the root of your web server. It provides instructions to spiders and other web page crawler about what pages of your site they provide and should not visit. Thank you! Happy to help you. __________________ Bangalore Web Designing Company \| Web Development Company in Bangalore

01-29-2017, 11:50 PM	#3
emilyoliver Registered User Join Date: Sep 2016 Posts: 248	I prefer Robot.txt file are best

02-01-2017, 05:38 AM	#6
markfernando Registered User Join Date: Feb 2017 Location: USA Posts: 26	I think robots meta tags are are better then robots.txt.

02-01-2017, 10:35 PM	#8
jaychristopher Registered User Join Date: Nov 2016 Posts: 234	Why Meta Robots is Better than Robots.txt. Below is an example of about.com's robots.txt file. Notice that they are blocking the directory /library/nosearch/. ... In order to exclude individual pages from search engine indices, the noindex meta tag <meta name="robots" content="noindex"> is actually superior to robots.txt. __________________ singapore erp provider \| inventory management software \| sales crm software

02-03-2017, 12:02 AM	#9
jamesrobertt Registered User Join Date: Dec 2016 Posts: 530	Why Meta Robots is Better than Robots.txt. Below is an example of about.com's robots.txt file. Notice that they are blocking the directory /library/nosearch/. ... In order to exclude individual pages from search engine indices, the noindex meta tag <meta name="robots" content="noindex"> is actually superior to robots.txt. __________________ Preach the Gospel Help the homeless How To Be Saved Global Ministry Baptism Five Fold Ministry Online Minister http://servinglove.ca/

02-03-2017, 12:08 AM	#10
johnkevin Registered User Join Date: Oct 2016 Posts: 259	They Are robots.txt is better. __________________ software quality assurance training free qa training online

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
What is the difference between robots.txt and meta robots? and Which is the best?	Sachin89765	Search Engine Optimization	0	12-13-2016 02:58 AM
Which is better Robots.txt or Meta Robots Tag?	apranajoshi	Search Engine Optimization	8	08-30-2016 01:26 AM
Which is better Robots.txt or Meta Robots Tag?	riyakhan	Search Engine Optimization	3	12-14-2015 01:01 AM