SEOClerks

Clear
Sign In Join

What to do to make website crawl able?

  • bhagatghanvri Level 1
    • 5

    Write the reason you're deleting this FAQ

    What to do to make website crawl able?

    Which are the important aspects to keep in mind while creating a website that can help making a crawl able website? My previous websites are not crawled by Google. I have created those websites by using Wordpress.

    # SEO
    Share post:

    Comments

    Please login or sign up to leave a comment

    Join
    stevexavior

    stevexavior

    Wordpress websites are easily crawled by Google and other search engines. But if your websites are not crawled by Google then you can submit indexing request from your website's webmaster tools.
    11 years ago
    1969-12-31T19:00:00-0500

    Are you sure you want to delete this post?

    sunil0021

    sunil0021

    Submit on above url and change your robots.txt file to index*

    - Sunil Bishnoi
    11 years ago
    1969-12-31T19:00:00-0500

    Are you sure you want to delete this post?

    Corzhens

    Corzhens

    I am also interested in knowing how the crawlers reach the website. My initial understanding is that the crawlers only check on sites that are in the index of the search engines. Perhaps it is imperative for new sites to submit the link to the search engines so it will be included in the indexing and therefore it will also be in the list of the crawlers for checking. When you upload new contents, the crawler will tag your site as active. Correct me if I am wrong on what I said.
    6 years ago
    1969-12-31T19:00:00-0500

    Are you sure you want to delete this post?