How to Create Robots.txt Files

[priyawilson]

How to Create Robots.txt Files?????????????????

_________________________________
picnic spots near gurgaon
(http://www.arounddelhi.net/?page_id=203)

[smartkathy]

Hi there. If you want, then here you go:

http://www.seomoz.org/learn-seo/robotstxt

Here is different types of way.

Thanks

[css4me]

Hi priyawilson, robot.txt file creation is very easy and its depend on your need that which code is written.
For example if you want to disallow all robots to visit your site then use the given code:
User-agent: *
Disallow: /

For more information read http://www.robotstxt.org/robotstxt.html

[pokal]

Sorry, what do you mean?

[lennonrowen]

It's not a difficult task to create a robots.txt file. Its so simple to create. Take a look below:

User-agent:*
Disallow:

It is by default setting of a robots.txt file. You have to upload it in root directory of website.

[dombowkett]

Install a WordPress SEO plugins in your website, it will create robots.txt file automatically.

[yuva12]

Open Notepad, Microsoft Word or any text editor and save the file as 'robots,' all lowercase, making sure to choose . txt as the file type extension (in Word, choose 'Plain Text' ).

[iastitlesearch]

A robots.txt file lives at the root of your site. So, for the site www.example.com, the robots.txt file lives at www.example.com/robots.txt.

Example:

# Group 1
User-agent: Googlebot
Disallow: /nogooglebot/

# Group 2
User-agent: *
Allow: /

Sitemap: http://www.example.com/sitemap.xml

[jesica]

Open Notepad, Microsoft Word or any text editor and save the file as 'robots,' all lowercase, making sure to choose. txt as the file type extension (in Word, choose 'Plain Text' ).
Next, add the following two lines of text to your file.