02-07-2018, 12:25 AM
|
#5 |
|
Registered User
Join Date: Nov 2017
Posts: 156
|
In a nutshell. Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. It works likes this: a robot wants to vists a Web site URL, say http://www.example.com/welcome.html.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| What is robot.txt file and what are the benefits of using it..? | AshokDixit89 | Search Engine Optimization | 8 | 05-05-2017 04:30 AM |
| Why We Use robot.txt file In Seo..? | ankitasharma123 | Search Engine Optimization | 7 | 04-20-2017 12:59 PM |
| Which pages should be put in robot.txt file? | Martinricky | Search Engine Optimization | 1 | 07-24-2016 11:15 PM |
| how can create the Robot.txt file | eagleeye dental | Search Engine Optimization | 0 | 09-01-2014 09:40 PM |
All times are GMT -7. The time now is 04:44 AM.