|
|
02-16-2018, 05:27 AM
|
#1 |
|
Registered User
Join Date: Mar 2017
Location: Dubai
Posts: 149
|
Yes, there is a limit to robots.txt file in terms of filesize 500 KB as Vipin points out. > A maximum file size may be enforced per crawler. Content which is after the maximum file size may be ignored.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
 |
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Thread Tools | |
| Display Modes | Rate This Thread |
Hybrid Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| What is the limit of a robot.txt file? | ruhikhan | Search Engine Optimization | 7 | 01-22-2018 04:28 AM |
| What is robot.txt file and what are the benefits of using it? | Martinricky | Social Networks | 31 | 12-21-2016 02:46 AM |
| Is there a limit to robots.txt file? | sparkleoffice | Search Engine Optimization | 0 | 12-05-2016 02:58 AM |
| how can create the Robot.txt file | eagleeye dental | Search Engine Optimization | 0 | 09-01-2014 09:40 PM |
All times are GMT -7. The time now is 07:36 AM.