![]() |
Which is better Robots.txt or Meta Robots Tag?
Hello friends,
Which is better Robots.txt or Meta Robots Tag? |
robots.txt is the better then robot tag
|
What is Robots.txt?
The Robots Exclusion Protocol (REP) is a group of web standards that regulate web robot behavior and search engine indexing. The REP consists of the following: The original REP from 1994, extended 1997, defining crawler directives for robots.txt. Some search engines support extensions like URI patterns (wild cards). Its extension from 1996 defining indexer directives (REP tags) for use in the robots meta element, also known as "robots meta tag." Meanwhile, search engines support additional REP tags with an X-Robots-Tag. Webmasters can apply REP tags in the HTTP header of non-HTML resources like PDF documents or images. The Microformat rel-nofollow from 2005 defining how search engines should handle links where the A Element's REL attribute contains the value "nofollow." |
Robot.txt is better than meta robot.tag
|
All times are GMT -7. The time now is 05:18 AM. |
Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.