|
Use a text editor to create the robot txt file and add REP DIRECTIVES to block content from being visited by the bots. The text file should be saved in ASCII or UTF 8 encoding. Create a list of disallow directives listing the content you blocked.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|