Site Owners Forums - Webmaster Forums

Site Owners Forums - Webmaster Forums (http://siteownersforums.com/index.php)
-   Search Engine Optimization (http://siteownersforums.com/forumdisplay.php?f=16)
-   -   Which is better Robots.txt or Meta Robots Tag? (http://siteownersforums.com/showthread.php?t=162159)

riyakhan 12-10-2015 01:58 AM

Which is better Robots.txt or Meta Robots Tag?
 
Hello friends,

Which is better Robots.txt or Meta Robots Tag?

sarvodyaseo 12-11-2015 05:30 AM

robots.txt is the better then robot tag

ngocptit 12-14-2015 12:44 AM

What is Robots.txt?

The Robots Exclusion Protocol (REP) is a group of web standards that regulate web robot behavior and search engine indexing. The REP consists of the following:

The original REP from 1994, extended 1997, defining crawler directives for robots.txt. Some search engines support extensions like URI patterns (wild cards).
Its extension from 1996 defining indexer directives (REP tags) for use in the robots meta element, also known as "robots meta tag." Meanwhile, search engines support additional REP tags with an X-Robots-Tag. Webmasters can apply REP tags in the HTTP header of non-HTML resources like PDF documents or images.
The Microformat rel-nofollow from 2005 defining how search engines should handle links where the A Element's REL attribute contains the value "nofollow."

cybnetics 12-14-2015 01:01 AM

Robot.txt is better than meta robot.tag


All times are GMT -7. The time now is 05:18 AM.


Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.