|
Robots.txt is a text (not html) file you put on your root directory to tell search robots which files to ignore (or alternatively) which files to crawl. It also helps Search Engines to locate the Sitemap of the website and hence crawl the entire website in depth... helping in your rankings and traffic.
__________________
230% more traffic with 12+
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|