Site Owners Forums - Webmaster Forums - View Single Post

multai · 04-02-2018, 02:28 AM

Use robots.txt to prevent crawling of search results pages or other auto-generated pages that don't add much value for users coming from search engines.

http://www.multaisolutions.com/web.html

04-02-2018, 02:28 AM	#24
multai Registered User Join Date: Apr 2018 Posts: 59	Use robots.txt to prevent crawling of search results pages or other auto-generated pages that don't add much value for users coming from search engines. http://www.multaisolutions.com/web.html