Site Owners Forums - Webmaster Forums - View Single Post

towertech · 01-28-2016, 06:26 AM

Hi,

Robots.txt : You can disallow search engine bot via robots.txt

in robots.txt you can put the list of web URL of your website that you don;t want to crawl by Google bot.

Thanks

01-28-2016, 06:26 AM	#2
towertech Registered User Join Date: Jan 2016 Posts: 38	Hi, Robots.txt : You can disallow search engine bot via robots.txt in robots.txt you can put the list of web URL of your website that you don;t want to crawl by Google bot. Thanks