Site Owners Forums - Webmaster Forums

Site Owners Forums - Webmaster Forums (http://siteownersforums.com/index.php)
-   Search Engine Optimization (http://siteownersforums.com/forumdisplay.php?f=16)
-   -   Which is better — Meta Robot tags or robots.txt? (http://siteownersforums.com/showthread.php?t=210957)

abhaykumar 03-15-2018 10:18 PM

Which is better — Meta Robot tags or robots.txt?
 
Hlo Friends,
Which is better — Meta Robot tags or robots.txt?

buyinstagram 03-15-2018 10:22 PM

Is it better to use meta tags* or the robots.txt file for informing spiders/crawlers to include or exclude a page?

Are there any issues in using both the meta tags and the robots.txt?

evejones 03-15-2018 10:30 PM

Quote:

Originally Posted by abhaykumar (Post 777370)
Hlo Friends,
Which is better — Meta Robot tags or robots.txt?

You can also use both instead of wasting time in finding better of the two

TheDogLine 03-15-2018 10:34 PM

Robots.txt files are best for disallowing a whole section of a site, such as a category whereas a meta tag is more efficient at disallowing single files and pages. You could choose to use both a meta robots tag and a robots.txt file as neither has authority over the other, but “noindex” always has authority over “index” requests.


All times are GMT -7. The time now is 03:18 AM.


Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.