How To Use of Robot.txt File In Webmaster..?

[pihu147741]

Hello friends,

I Want to Know that How To Use of Robot.txt File In Webmaster..?

[HosTechS]

Robots.txt file is at the root of the website that involves sectors of your website you don’t want to be attained by search engine crawlers. Webmasters use a robot.txt file to instruct the search engine robots on how to crawl & index the web pages.

[dennis123]

A robots.txt file lives at the root of your site. So, for site www.example.com, the robots.txt file lives at www.example.com/robots.txt. robots.txt is a plain text file that follows the Robots Exclusion Standard. A robots.txt file consists of one or more rules. Each rule blocks (or or allows) access for a given crawler to a specified file path in that website.

[neelseowork]

Hello friends,

I Want to Know that How To Use of Robot.txt File In Webmaster..?

What do you actually want? what is your purpose? so we answer accordingly.
what will you do by using the robots.txt file? it is just for instructing crawlers. what will you do except that?