01-24-2019, 05:20 AM
|
#5 |
|
Registered User
Join Date: Sep 2016
Posts: 617
|
The asterisk after “user-agent” means that the robots.txt file applies to all web robots that visit the site. The slash after “Disallow” tells the robot to not visit any pages on the site.After all, one of the major goals of SEO is to get search engines to crawl your site easily so they increase your ranking.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Thread Tools | |
| Display Modes | Rate This Thread |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| robot.txt | Shivam Tripathi | Web Promotion | 5 | 12-16-2018 10:11 PM |
| Why are you applying for this job? (or) Why this role attract you? (or) | Pavan Techn | General Discussion | 0 | 06-10-2018 10:30 AM |
| Talk about the role of backlink | johnandme | Search Engine Optimization | 2 | 05-19-2015 05:12 AM |
| how to use html5 attribute 'role'? | arronmattwills | Graphic Design | 1 | 02-01-2014 06:03 AM |
| The role of keywords for a website | sinicline | 5 | 08-28-2013 11:14 PM | |
All times are GMT -7. The time now is 11:00 PM.