Site Owners Forums - Webmaster Forums

Site Owners Forums - Webmaster Forums (http://siteownersforums.com/index.php)
-   Search Engine Optimization (http://siteownersforums.com/forumdisplay.php?f=16)
-   -   What is robots.txt (http://siteownersforums.com/showthread.php?t=213652)

guptareena3555 04-02-2018 02:42 AM
What is robots.txt
 
Hello friends,












What is robots.txt......?

Daisyallie 04-02-2018 02:51 AM
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.

k2bseo 04-02-2018 02:56 AM
It is the file which consists of files and folders in which google not should not crawl

Elizabethezhil 04-02-2018 03:21 AM
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.


All times are GMT -7. The time now is 08:34 AM.


Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.