|
Robot.txt is used to give knowledge about any website to google. Search engines can know which thing has to be crawled in any website and which should not to be crawled with the help of robot.txt.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|