View Single Post
Old 11-21-2016, 12:18 AM   #8
jordanangel
Registered User
 
Join Date: Aug 2016
Posts: 387
Use a text editor to create the robots.txt file and add REP directives to block content from being visited by the bots. The text file should be saved in ASCII or UTF-8 encoding. Create a list of Disallow directives listing the content you want blocked.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
jordanangel is offline   Reply With Quote