# The actual policy User-agent: * Disallow: / # The motivation # Imagine someone walking on the street. That person is certainly in public space # and can be viewed by anyone. Now change the situation by adding a camera that # is filming this public space, and recording every moment to another publicly # accessible space. We all understand there is a difference between the # situation before and after the camera was added, right? It is all the same # for websites: everyone can view this website, but I will ask people to not put # a 'camera' on it recording every moment to another publicly accessible space. # Q: How about The Internet Archive? # A: I consider archiving only necessary for actual public information. Think # governments, news, court decisions, etc. Not personal websites. # Q: Do you have you something to hide? # A: Yes. People make errors. They should be able to fix them. They should not # get haunted by their wrong-doings for the rest of their life. # Q: How about Bitcoin and other blockchain projects? # A: That's why I don't use them. # Q: Then how do you use Git? # A: git reset --soft HEAD~1; git push --force # Q: Are you aware that bots can ignore a robots.txt file? # A: Yes. Just as a DNT-header can get ignored, or a trespasser can ignore the # "Do not pass"-sign. It is mainly to signal intent; no-one has an excuse now.