|
Robots.txt is a file, that instruct to the crawler what pages are to be crawl and index it in to the server
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|