05-01-2019, 11:16 PM
|
#5 |
|
Registered User
Join Date: Feb 2018
Location: Bangalore
Posts: 283
|
there is a limit to robots.txt file in terms of filesize 500 KB as Vipin points out. A maximum file size may be enforced per crawler. Content which is after the maximum file size may be ignored. Google currently enforces a size limit of 500kb.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Thread Tools | |
| Display Modes | Rate This Thread |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Why We Use robot.txt file In Seo..? | ankitasharma123 | Search Engine Optimization | 7 | 04-20-2017 12:59 PM |
| What is the Size of Disavow link file? | softqubetechno | Search Engine Optimization | 2 | 03-21-2014 05:07 AM |
All times are GMT -7. The time now is 01:44 PM.