05-01-2018, 04:11 AM
|
#4 |
|
Registered User
Join Date: Dec 2015
Location: USA
Posts: 743
|
Hi
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site. https://www.welllivingshop.com/baby/
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| What is Robot.txt? | kumar1_16 | General Discussion | 11 | 03-29-2017 03:15 AM |
| Robot.txt? | siva SEO | Search Engine Optimization | 17 | 01-09-2015 07:02 PM |
| how can Create the Robot.txt | pankaj | Search Engine Optimization | 3 | 10-08-2014 03:43 AM |
| how can create the Robot.txt file | eagleeye dental | Search Engine Optimization | 0 | 09-01-2014 09:40 PM |
All times are GMT -7. The time now is 04:16 AM.