|
|
06-16-2019, 02:30 AM
|
#1 |
|
Registered User
Join Date: Sep 2015
Location: UNIT 1B THE SUMMIT MANCHESTER ROAD BURNLEY BB11 5HG
Posts: 376
|
Yes, there is a limit to robots.txt file in terms of filesize 500 KB as Vipin points out. A maximum file size may be enforced per crawler. Content which is after the maximum file size may be ignored. Google currently enforces a size limit of 500kb.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. / To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. / To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. / To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
 |
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Hybrid Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| What is the limit of a robot.txt file? | artijain1900 | Search Engine Optimization | 11 | 05-17-2022 12:48 AM |
| What is the limit of a robot.txt file? | ninadordev | Search Engine Optimization | 4 | 12-24-2021 12:29 AM |
| What is the limit of a robot.txt file? | partee | Review My Website | 6 | 09-01-2019 10:27 PM |
| What is the limit of a robot.txt file? | NandiniShinde | Search Engine Optimization | 23 | 07-25-2018 11:49 PM |
| What is the limit of a robot.txt file? | ruhikhan | Search Engine Optimization | 7 | 01-22-2018 04:28 AM |
All times are GMT -7. The time now is 04:28 AM.