Robots.txt is such an important document to be added to a website. This site has it too! Mainly I use it to tell the SE that I eaither want (or not) to index a website and how (based on folders I want to allow or restrict).