View Single Post
Old 01-12-2017, 12:32 AM   #5
BryceBrady
Registered User
 
Join Date: Oct 2016
Posts: 580
Robots.txt file is used to guide the search engine automatically to the page you want it to search for and then index the page. Most sites also have the directories and files do not need to search engine robots to visit. Thus creating a robots.txt file can help you in SEO.

The robots.txt file is a very simple format that can be created by the tool Notepad. If you use WordPress robots.txt file would look like this

User-agent: *
Disallow: / wp-
Disallow: / feed /
Disallow: / trackback /
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
BryceBrady is offline   Reply With Quote