Site Owners Forums - Webmaster Forums - View Single Post - What is the limit of a robot.txt file?

Hello Friends,

Google actually crawls 500 KB of text in robots.txt file.

__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

01-04-2021, 03:08 AM	#10
pharmasecure Registered User Join Date: Jun 2018 Posts: 508	Hello Friends, Google actually crawls 500 KB of text in robots.txt file. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.