![]() |
Which is better — Meta Robot tags or robots.txt?
Hlo Friends,
Which is better — Meta Robot tags or robots.txt? |
Is it better to use meta tags* or the robots.txt file for informing spiders/crawlers to include or exclude a page?
Are there any issues in using both the meta tags and the robots.txt? |
Quote:
|
Robots.txt files are best for disallowing a whole section of a site, such as a category whereas a meta tag is more efficient at disallowing single files and pages. You could choose to use both a meta robots tag and a robots.txt file as neither has authority over the other, but “noindex” always has authority over “index” requests.
|
All times are GMT -7. The time now is 03:18 AM. |
Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.