What are the various uses of robots.txt?
 

What are the various uses of robots.txt?

Robots.txt file is used to guide the search engine automatically to the page you want it to search for and then index the page. Most sites also have the directories and files do not need to search engine robots to visit. Thus creating a robots.txt file can help you in SEO.

The robots.txt file is a very simple format that can be created by the tool Notepad. If you use WordPress robots.txt file would look like this

User-agent: *
Disallow: / wp-
Disallow: / feed /
Disallow: / trackback /

ok! that was awesome! thanks for posting.

.................................................. .................................................. .............................

(bai viet rat huu ich !)

.................................................. .................................................. ..............................

bảng giá dây cáp điện cadivi mới nhất cadivi

What an great information

Robots.txt file is used to guide the search engine automatically to the page you want it to search for and then index the page. Most sites also have the directories and files do not need to search engine robots to visit. Thus creating a robots.txt file can help you in SEO.

The robots.txt file is a very simple format that can be created by the tool Notepad. If you use WordPress robots.txt file would look like this

User-agent: *
Disallow: / wp-
Disallow: / feed /
Disallow: / trackback /