A Robots.txt file can control the Search Engine bots (eg. Google, bing, Yahoo, Ask, Yandex). If you want to prevent any directory/content of your website from indexing into search. Then using robots.txt you can block those content or directory.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|