SEOClerks

Clear
Sign In Join

How would you prevent this?

  • angie828 Level X3
    • 4

    Write the reason you're deleting this FAQ

    How would you prevent this?

    Is there a way to prevent a spider from attaching itself to a URL that you do not want on the search engines?

    #spiders #search #engines Webmaster Related
    Share post:

    Comments

    Please login or sign up to leave a comment

    Join
    robertman11

    robertman11

    Use your robots.txt file or use .htaccess to actually blog the spider (you can block by IP or by user-client).
    13 years ago
    1970-01-01T00:00:00+0000

    Are you sure you want to delete this post?

    Light

    Light

    Thanks for the information guys. How would you prevent this?
    13 years ago
    1970-01-01T00:00:00+0000

    Are you sure you want to delete this post?