Which is better Robots.txt or Meta Robots Tag? - Site Owners Forums

bababangali · 01-27-2017, 03:43 AM

Hello friends,

I would like to know that Which is better Robots.txt or Meta Robots Tag?

wellliving · 01-29-2017, 10:38 PM

Robots.txt files are best for disallowing a whole section of a site, such as a category whereas a meta tag is more efficient at disallowing single files and pages. You could choose to use both a meta robots tag and a robots.txt file as neither has authority over the other, but “noindex” always has authority over “index” requests.

emilyoliver · 01-29-2017, 11:50 PM

I prefer Robot.txt file are best

gurujeet · 01-30-2017, 01:06 AM

I believe Meta Robots is Better than Robots.txt

jamesroben · 02-01-2017, 05:12 AM

In order to exclude individual pages from search engine indices, the noindex meta tag is actually superior to robots.txt. ... You want to use 'noindex,follow' in a robots meta tag, rather than robots.txt , because it will allow the link juice to pass through. It is better from a SEO perspective.

markfernando · 02-01-2017, 05:38 AM

I think robots meta tags are are better then robots.txt.

tyagi · 02-01-2017, 10:24 PM

ROBOTS.TXT file is better because it is a file of that exact name stored in the root of your web server.
It provides instructions to spiders and other web page crawler about what pages of your site they provide and should not visit.

Thank you!

Happy to help you.

jaychristopher · 02-01-2017, 10:35 PM

Why Meta Robots is Better than Robots.txt. Below is an example of about.com's robots.txt file. Notice that they are blocking the directory /library/nosearch/. ... In order to exclude individual pages from search engine indices, the noindex meta tag <meta name="robots" content="noindex"> is actually superior to robots.txt.

jamesrobertt · 02-03-2017, 12:02 AM

Why Meta Robots is Better than Robots.txt. Below is an example of about.com's robots.txt file. Notice that they are blocking the directory /library/nosearch/. ... In order to exclude individual pages from search engine indices, the noindex meta tag <meta name="robots" content="noindex"> is actually superior to robots.txt.

johnkevin · 02-03-2017, 12:08 AM

They Are robots.txt is better.

01-27-2017, 03:43 AM	#1
bababangali Registered User Join Date: Dec 2014 Posts: 198	Which is better Robots.txt or Meta Robots Tag? Hello friends, I would like to know that Which is better Robots.txt or Meta Robots Tag? __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

01-29-2017, 10:38 PM	#2
wellliving Registered User Join Date: Dec 2015 Location: USA Posts: 743	Robots.txt files are best for disallowing a whole section of a site, such as a category whereas a meta tag is more efficient at disallowing single files and pages. You could choose to use both a meta robots tag and a robots.txt file as neither has authority over the other, but “noindex” always has authority over “index” requests. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

01-30-2017, 01:06 AM	#4
gurujeet Registered User Join Date: Sep 2016 Posts: 84	I believe Meta Robots is Better than Robots.txt __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

02-01-2017, 05:12 AM	#5
jamesroben Registered User Join Date: Nov 2016 Posts: 124	In order to exclude individual pages from search engine indices, the noindex meta tag is actually superior to robots.txt. ... You want to use 'noindex,follow' in a robots meta tag, rather than robots.txt , because it will allow the link juice to pass through. It is better from a SEO perspective. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

02-01-2017, 10:24 PM	#7
tyagi Registered User Join Date: Jan 2017 Posts: 102	ROBOTS.TXT file is better because it is a file of that exact name stored in the root of your web server. It provides instructions to spiders and other web page crawler about what pages of your site they provide and should not visit. Thank you! Happy to help you. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

01-29-2017, 11:50 PM	#3
emilyoliver Registered User Join Date: Sep 2016 Posts: 248	I prefer Robot.txt file are best

02-01-2017, 05:38 AM	#6
markfernando Registered User Join Date: Feb 2017 Location: USA Posts: 26	I think robots meta tags are are better then robots.txt.

02-01-2017, 10:35 PM	#8
jaychristopher Registered User Join Date: Nov 2016 Posts: 234	Why Meta Robots is Better than Robots.txt. Below is an example of about.com's robots.txt file. Notice that they are blocking the directory /library/nosearch/. ... In order to exclude individual pages from search engine indices, the noindex meta tag <meta name="robots" content="noindex"> is actually superior to robots.txt. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* \| *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* \| *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

02-03-2017, 12:02 AM	#9
jamesrobertt Registered User Join Date: Dec 2016 Posts: 530	Why Meta Robots is Better than Robots.txt. Below is an example of about.com's robots.txt file. Notice that they are blocking the directory /library/nosearch/. ... In order to exclude individual pages from search engine indices, the noindex meta tag <meta name="robots" content="noindex"> is actually superior to robots.txt. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

02-03-2017, 12:08 AM	#10
johnkevin Registered User Join Date: Oct 2016 Posts: 259	They Are robots.txt is better. __________________ *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.*

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
What is the difference between robots.txt and meta robots? and Which is the best?	Sachin89765	Search Engine Optimization	0	12-13-2016 02:58 AM
Which is better Robots.txt or Meta Robots Tag?	apranajoshi	Search Engine Optimization	8	08-30-2016 01:26 AM
Which is better Robots.txt or Meta Robots Tag?	riyakhan	Search Engine Optimization	3	12-14-2015 01:01 AM