02-01-2017, 10:24 PM
|
#7 |
|
Registered User
Join Date: Jan 2017
Posts: 102
|
ROBOTS.TXT file is better because it is a file of that exact name stored in the root of your web server.
It provides instructions to spiders and other web page crawler about what pages of your site they provide and should not visit. Thank you! Happy to help you.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| What is the difference between robots.txt and meta robots? and Which is the best? | Sachin89765 | Search Engine Optimization | 0 | 12-13-2016 02:58 AM |
| Which is better Robots.txt or Meta Robots Tag? | apranajoshi | Search Engine Optimization | 8 | 08-30-2016 01:26 AM |
| Which is better Robots.txt or Meta Robots Tag? | riyakhan | Search Engine Optimization | 3 | 12-14-2015 01:01 AM |
All times are GMT -7. The time now is 02:19 AM.