How to know about robot.txt ?
 

How to know that a particular site have robot.txt file or not ?
please reply me

Just put the link into your browser and check it.

domain.com/robots.txt

Its very simple. please type in your browser domain.com/robots.txt, its will be opened if robots already installed.

Just put the link in browser

thanks guys for you valuable response

Robots.txt file is very important for website.In this file website owner decide what part of the website hide /keep from visitor.For find this file present or not use domain name/robots.txt .

Robot.txt is the main thing used by web developers.It is used to restrict some web page in our site when search engine crawling.

Online Marketplace Script | Wanelo clone script | Multi vendor shopping cart

just type in your browser domain.com/robots.txt u will see it

its very simple.just put your domain name and write /robots.txt.

robots.txt text file are use generally search engine information allow or not.

Robot.txt is the file used to hidden the pages in the website from the crawler or spider.