What is the limit of a robot.txt file? - Site Owners Forums

		Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization
What is the limit of a robot.txt file?

FAQ

Calendar

Today's Posts

Notices

Welcome to SiteOwnersForums.com #1 Webmasters Community Online

You are currently viewing our forum as a guest which gives you limited access.
Membership is absolutely FREE and registration is FAST & SIMPLE so please, Register Today and join one of the friendliest communities on the net!
If you have any problems with the registration process or your account login, please contact us.

Thread Tools

Rate Thread

Display Modes

04-05-2018, 03:19 AM	#1
Elizabethezhil Registered User Join Date: Aug 2017 Posts: 259	Robots.txt file is used to information to the web crawler whether it crawls particular page or not. For example,the webpage consists of information about login and payment details we can make disallow that page. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is Off HTML code is Off Forum Rules

Forum Jump

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
What is the limit of a robot.txt file?	ninadordev	Search Engine Optimization	4	12-24-2021 12:29 AM
What is the limit of a robot.txt file?	ruhikhan	Search Engine Optimization	7	01-22-2018 04:28 AM
What is robot.txt file and what are the benefits of using it?	Martinricky	Social Networks	31	12-21-2016 02:46 AM

All times are GMT -7. The time now is 06:27 AM.