Which is better Robots.txt or Meta Robots Tag? - Site Owners Forums

riyakhan · 12-10-2015, 01:58 AM

Hello friends,

Which is better Robots.txt or Meta Robots Tag?

sarvodyaseo · 12-11-2015, 05:30 AM

robots.txt is the better then robot tag

ngocptit · 12-14-2015, 12:44 AM

What is Robots.txt?

The Robots Exclusion Protocol (REP) is a group of web standards that regulate web robot behavior and search engine indexing. The REP consists of the following:

The original REP from 1994, extended 1997, defining crawler directives for robots.txt. Some search engines support extensions like URI patterns (wild cards).
Its extension from 1996 defining indexer directives (REP tags) for use in the robots meta element, also known as "robots meta tag." Meanwhile, search engines support additional REP tags with an X-Robots-Tag. Webmasters can apply REP tags in the HTTP header of non-HTML resources like PDF documents or images.
The Microformat rel-nofollow from 2005 defining how search engines should handle links where the A Element's REL attribute contains the value "nofollow."

cybnetics · 12-14-2015, 01:01 AM

Robot.txt is better than meta robot.tag

12-10-2015, 01:58 AM	#1
riyakhan Registered User Join Date: Jun 2015 Posts: 42	Which is better Robots.txt or Meta Robots Tag? Hello friends, Which is better Robots.txt or Meta Robots Tag? __________________ Kala Jadu to get love back \| Black Magic Love Spell in Hindi \| Sifli Black magic spells \| Muslim Black Magic Spells Removal

12-11-2015, 05:30 AM	#2
sarvodyaseo Registered User Join Date: Mar 2014 Posts: 86	robots.txt is the better then robot tag __________________ Custom Website Designing Company \| Mobile Apps Development Company \| Software Development Company \| Website Design Company \| Yearly Horoscope\| Latest Fashion Trends in India for Womens \| Buy Online Designer Clothes for men \| House Party Planners in Delhi NCR

12-14-2015, 12:44 AM	#3
ngocptit Registered User Join Date: Dec 2015 Location: New York City Posts: 12	What is Robots.txt? The Robots Exclusion Protocol (REP) is a group of web standards that regulate web robot behavior and search engine indexing. The REP consists of the following: The original REP from 1994, extended 1997, defining crawler directives for robots.txt. Some search engines support extensions like URI patterns (wild cards). Its extension from 1996 defining indexer directives (REP tags) for use in the robots meta element, also known as "robots meta tag." Meanwhile, search engines support additional REP tags with an X-Robots-Tag. Webmasters can apply REP tags in the HTTP header of non-HTML resources like PDF documents or images. The Microformat rel-nofollow from 2005 defining how search engines should handle links where the A Element's REL attribute contains the value "nofollow." __________________ Instamate 2.0 Review \| Graphitii Review

12-14-2015, 01:01 AM	#4
cybnetics Registered User Join Date: Nov 2015 Location: Delhi Posts: 60	Robot.txt is better than meta robot.tag __________________ Website Designing Company \| SEO Company in Delhi \| Digital Marketing Company \| CMS Development company

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
robots meta tag	zinavoco	Search Engine Optimization	9	09-27-2015 11:26 PM
If the meta robots tag has a value of "no index, no follow" what does it mean?	poojaseo	Search Engine Optimization	0	06-06-2014 03:08 AM
How to add a robots follow meta tag?	jamesranatte	Search Engine Optimization	1	10-11-2012 10:24 PM
What is Robots meta tag?	samlko	Search Engine Optimization	2	04-06-2012 12:10 AM

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)