Robot in SEO

[bangalorewebgur]

It is one of the program that routine navigation on the world wide web's HTTP structure by retrieving document that are referenced. Robots sometimes call to as Web Crawlers, Web Spiders or Web Wanderers.

It can be used for

Indexing
HTML validation
Link validation
Mirroring

[jaysh4922]

Robots.txt is frequent name of a text file that is uploaded to a Web site's root directory and linked in the html code of the Web site. The robots.txt file is used to have the funds for directions about the Web site to Web robots and spiders.

[abhijepansd]

If you want to know crawls your site or not crawls your site, you can use robots.txt file.

User-agent: *
Disallow:

picnic spots near delhi (http://www.arounddelhi.net/?page_id=203) | day picnic spots in delhi (http://www.conventionindia.in/Daysout.aspx) | manali group tour package (http://www.arounddelhi.net/?page_id=4342)

[RH-Calvin]

Robots in SEO refer to search engine programs that helps to read through webpage sources and index data in search engine database.

[edwina]

Robot.txt is a file that allows or restricts access to a website by search engine robots that crawl the web.

[davidweb09]

It give instruction to search engine bot to crawl your website.