Site Owners Forums - Webmaster Forums - View Single Post

aajokhio · 03-22-2016, 04:40 PM

Basically, Robots Txt File Allow or Disallow with Google Robots for Crawl your Post, Pages etc. You set it as your requirement after that Google Robots crawl your post pages you have set up in Robots Txt File.

03-22-2016, 04:40 PM	#13
aajokhio Registered User Join Date: May 2015 Location: Hyderabad/Pakistan Posts: 25	Basically, Robots Txt File Allow or Disallow with Google Robots for Crawl your Post, Pages etc. You set it as your requirement after that Google Robots crawl your post pages you have set up in Robots Txt File.