Site Owners Forums - Webmaster Forums - View Single Post

pxljobs · 07-28-2016, 02:04 AM

The robot.txt file is an on page technique you put on your site to tell search robots which pages you would like them not to visit it give secure to your web page this process is known as robot.txt

07-28-2016, 02:04 AM	#13
pxljobs Registered User Join Date: Jul 2016 Location: Bangalore Posts: 370	The robot.txt file is an on page technique you put on your site to tell search robots which pages you would like them not to visit it give secure to your web page this process is known as robot.txt