txt directives prevents search spiders from crawling the URL?
Which of the following robots.txt directives prevents search spiders from crawling the URL?
A: Allow: /
B: Disallow:
C: Disallow: /page1
D: Both A & C
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|