Where do you put your robots.txt?

[tmblearning]

Where do you put your robots.txt?

[biglyft18]

Robots.txt. While simple, a robots.txt file can have a large effect on how search engines crawl your website.

[MVM Infotech]

Keep in mind that only one file or folder can be used per Disallow line. You may add as many Disallow lines as you need. Once complete, save and upload your robots.txt file to the root directory of your site. For example, if your domain is www.mydomain.com, you will place the file at www.mydomain.com/robots.txt.

[Optnation]

I think the better way to describe it is to have it in the root web folder of your domain.
so http://example.com/robots.txt you can also put your sitemap.xml in the root or refer to it with a Sitemap: http://example.com/fldr/smap.xml line in your robots.txt.
You can use Google Webmaster Tools to check to make sure you haven't restricted anything you didn't mean to.

[praveenitech40]

The robots.txt file, also known as the robots exclusion protocol or standard, is a text file that tells web robots (most often search engines) which pages on your site to crawl. It also tells web robots which pages not to crawl. Let's say a search engine is about to visit a site.

[jerryperes]

Where do you put your robots.txt?


Open a notepad and save the file as robots, all lowercase. Make sure to choose .txt as the file type extension (in word, choose 'plain text').

Next step is, add the following two lines of text to your file are as given below:
User-agent:*
Disallow:

[dombowkett]

In the domain root of the website, we put robots.txt & sitemap.xml both files.

[shubha1206]

Robots.txt file is a text file which provides instruction to how to crawl and index page or content of the website.