|
What is robots.txt?
It is a kind of text file utilized to provide the instructions to the crawlers about the caching and indexing of a website, directory, domain or a file of a webpage.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
!
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|