|
Robot.txt is a text file.
It gives instruction to search engine crawlers about indexing and caching of a web page, file of website or directory, domain.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|