SEOClerks

Clear
Sign In Join

Robots .txt

  • spykaushik Level 1
    • 4

    Write the reason you're deleting this FAQ

    Robots .txt

    What will the following robots.txt file do?

    a. It will allow Google to crawl any of the dynamically generated pages. It will also allow the AltaVista scooter bot to access every page
    b. It will disallow Google from crawling any of the dynamically generated pages. It will also disallow the AltaVista scooter bot from accessing any page
    c. It will disallow Google from crawling any of the dynamically generated pages. It will allow the AltaVista scooter bot to access every page
    d. None of the above

    # SEO
    Share post:

    Comments

    Please login or sign up to leave a comment

    Join
    spyindiavimlesh

    spyindiavimlesh

    Robots.txt code
    User-agent: *
    Disallow: /
    11 years ago

    Are you sure you want to delete this post?