August 28-29 incident:
Some orders and payments from around 28 August are still being restored — read the incident report, or contact support if something of yours is missing. You will be asked to choose a new password at your next sign-in.
Some people have speculated that Google bots actually ignore your robots.txt file, though most bots are supposed to be bound to respect this file. There is nothing to say they will though.Some people have speculated that Google bots actually ignore your robots.txt file, though most bots are supposed to be bound to respect this file. There is nothing to say they will though.
A search engine bot will not ignore the robots.txt file. They were programmed to respect and obey this file for the good of the site owner. If you do not have this file on your site, you can expect that a bot will crawl every page it can find.A search engine bot will not ignore the robots.txt file. They were programmed to respect and obey this file for the good of the site owner. If you do not have this file on your site, you can expect that a bot will crawl every page it can find.
Ethan
Are you sure you want to delete this post?