Site Owners Forums - Webmaster Forums - View Single Post - What is the importance of robot.txt in SEO?

rajkiran · 02-07-2019, 01:58 AM

Robots.txt is a text file located in the site's root directory for search engines Spiders and Crawlers what website pages and files you want or don't want them to visit.

02-07-2019, 01:58 AM	#5
rajkiran Registered User Join Date: Aug 2016 Posts: 961	Robots.txt is a text file located in the site's root directory for search engines Spiders and Crawlers what website pages and files you want or don't want them to visit.