06-19-2018, 10:30 AM
|
#5 |
|
Registered User
Join Date: May 2018
Posts: 23
|
Crawling is the process done by the google crawler called Googlebot (also known as robot, bot or spider) to search new pages and index them to the Google Index.
If you don't want crawler to find any certain page then add rel="nofollow" tag to that page. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| What is web Crawling? | newproaudio | General Discussion | 3 | 01-09-2018 04:57 AM |
| Google Crawling and Indexation 101 | sinicline | Search Engine Optimization | 20 | 02-05-2016 07:47 PM |
| Indexing and Crawling. | binarynpixel | Search Engine Optimization | 7 | 09-13-2014 04:11 AM |
| Regarding Google Crawling | James12smith | Search Engine Optimization | 1 | 12-31-2013 02:43 AM |
All times are GMT -7. The time now is 11:27 PM.