|
Well robots.txt is actually a notepad file in which we create instructions/commands for web crawler to not check out and index the link. It is used when the web page is new and there is no content in the web page, therefore it is important for SEO.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|