PDA

View Full Version : How we create the robot.txt ...



paramountgroup
05-14-2012, 07:48 AM
Describe the robot.txt and what are the main use of this ...

watson123
05-15-2012, 02:36 AM
Simply create a text document and save the new document as robots.txt Do not use a html editor to create the file unless is has the ability to create a plain text document (ASCII). Most computers will allow you to create a text document using notepad.
*Right click on your desktop
* Choose new
* Choose text document
*Open the document you just created
* Insert instructions to robots
*Click on save as
Save document as robots.txt

motorcyclestore
05-15-2012, 02:47 AM
You must have purchased hosting,you can't do this in free web hosting providing sites.Just open that particular page(php) AND ENTER THAT ROBORT TXT CODE.

sabrinasai
05-15-2012, 02:59 AM
Well most of the time robots.txt is much easier and less time. With the meta tag, you can say "follow" or "nofollow" and you can not specify directories without complicated rules. robots.txt is very simple and quick.

blessy_smith
05-15-2012, 03:37 AM
Thanks for sharing the informative post.

Amy.Sarin
05-15-2012, 05:39 AM
Robots.txt is a text (not html) file you put on your root directory to tell search robots which files to ignore (or alternatively) which files to crawl. It also helps Search Engines to locate the Sitemap of the website and hence crawl the entire website in depth... helping in your rankings and traffic.

Creating a robots.txt file is a matter of just a few seconds.
- Right click on your desktop
- Choose new - text document (you can use notepad too)
- Insert instructions to crawling bots.
- Save the document as robots.txt

You may now upload this file to your top/ root directory
e.g. http://yourdomainname/robots.txt

riinfotech45
05-15-2012, 07:10 AM
Simply create a text document and save the new document as robots.txt Do not use a html editor to create the file unless is has the ability to create a plain text document (ASCII). Most computers will allow you to create a text document using notepad.
*Right click on your desktop
* Choose new
* Choose text document
*Open the document you just created
* Insert instructions to robots
*Click on save as
Save document as robots.txt

such a great information.. thanks for sharing..