What is robot text - Page 3 - Site Owners Forums

jeffzeilenga · 03-13-2013, 04:05 AM

using Robots.txt is a file we can guide search engines to crawl or not to crawl certain sections of your website.

outure11 · 03-25-2013, 10:17 PM

Actually the search engines handle nofollow differently. Google will not follow the link, assign PR to it, or give it weight in its algorithm. Yahoo will follow the link but give it no weight in their algorithm. MSN says they won't give the link any value but it is hard to confirm exactly what they're doing.

johnmartin9990 · 03-26-2013, 01:46 AM

Well ... robots.text isa text file in which you difine instruction which page you want to be crawl or not to all robots of search engines.

hostsingh · 03-27-2013, 01:20 AM

Robots.txt is a text file you put it on your web site to tell search robots which pages you would like them not to visit. It is important to clarify that robots.txt is not a way from preventing search engines from crawling your site.

03-25-2013, 10:17 PM	#32
outure11 Registered User Join Date: Oct 2012 Posts: 334	Actually the search engines handle nofollow differently. Google will not follow the link, assign PR to it, or give it weight in its algorithm. Yahoo will follow the link but give it no weight in their algorithm. MSN says they won't give the link any value but it is hard to confirm exactly what they're doing. __________________ *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.*

03-27-2013, 01:20 AM	#34
hostsingh Registered User Join Date: Jan 2013 Posts: 19	Robots.txt is a text file you put it on your web site to tell search robots which pages you would like them not to visit. It is important to clarify that robots.txt is not a way from preventing search engines from crawling your site. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Anchor Text Vs Google Algorithm	Jimerson12	Search Engine Optimization	1	06-27-2025 05:18 AM
telepresence robot	hemnchy	General Discussion	1	01-02-2014 04:35 AM
Robot text.	terrijhon	Search Engine Optimization	18	06-08-2013 03:35 PM
Hidden text and links	farm gate	Google	0	11-11-2012 08:08 PM
Text Areas	ncjbhd	HTML / DHTML	1	11-15-2011 04:09 AM

03-13-2013, 04:05 AM	#31
jeffzeilenga Registered User Join Date: Mar 2013 Posts: 58	using Robots.txt is a file we can guide search engines to crawl or not to crawl certain sections of your website.

03-26-2013, 01:46 AM	#33
johnmartin9990 Registered User Join Date: Mar 2013 Posts: 4	Well ... robots.text isa text file in which you difine instruction which page you want to be crawl or not to all robots of search engines.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)