03-25-2019, 12:04 AM
|
#2 |
|
Registered User
Join Date: Feb 2018
Posts: 186
|
The robots.txt file, also known as the robots exclusion protocol or standard, is a text file that tells web robots (most often search engines) which pages on your site to crawl. It also tells web robots which pages not to crawl. ... The slash after “Disallow” tells the robot to not visit any pages on the site.
More Details Contact Hourglass IT Solutions Our Services: Web Design Company | Digital Marketing Services Chennai | Seo Company in Chennai | Mobile App Development Company Chennai | Ecommerce Web Design Services
__________________
HourGlass IT Solutions |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Robots.txt or Meta Robots.txt??? | santoshkumar | Search Engine Optimization | 10 | 02-14-2017 04:03 AM |
| Robots.txt | jaysh4922 | Search Engine Optimization | 13 | 07-28-2016 05:10 AM |
| Evil bots consuming all my sites traffic even after i disallowed them in robots.txt | Fking | General Discussion | 1 | 12-13-2013 11:27 PM |
| How to edit virtual robots.txt file in wordpress? | geniusoptimizer | PHP / mySQL | 1 | 04-12-2013 12:36 PM |
| Unable to delete robots.txt file | notfake | Yahoo | 0 | 04-29-2012 02:19 AM |
All times are GMT -7. The time now is 12:47 PM.