What is Web Crawler?

[complete]

Hello Friends,

Please tell me what is web crawler.

[daikaads]

Web crawler is the search engine spider which is an algorithm that crawls and index the web page or website on SERPs.

[littlemgrnoida]

A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index.

[fakhruddin.ewc@]

Web crawler is the search engine spider which crawl the website and and store the data in server to provide the best result.

[ITSGOLIVE]

A web crawler also known as a web spider or web robot is a program or automated script which browses the World Wide Web in a methodical automated manner as a means of providing up-to-date data.

[jane1]

It is actually search engine program that crawl web information to index it or fetch it over the internet.

[gulshan rana]

A Web crawler is an Internet bot which helps in Web indexing. Web Crawler visits Websites and reads their pages and collect other important information in order to create entries for a search engine index.

[Rajdeep Bose]

A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a "spider" or a "bot."

[RH-Calvin]

Web crawler is a search engine automated program that is responsible to read through webpage source and provide information to search engines. They are known as spiders, crawlers and robots.

[Hitekschool]

A Web crawler is an Internet bot which helps in Web ordering. Web Crawler visits Websites and peruses their pages and gather other essential data with a specific end goal to make passages for a web index list.

[muslimastro]

web crawler (also known in other terms like ants, automatic indexers, bots, web spiders, web robots or web scutters) is an automated program, or script, that crawls through web pages to create an index of the data it is set to look for.

[neelseofast]

Hello Friends,

Please tell me what is web crawler.

A Web crawler is an Internet bot which helps in Web indexing. They crawl one page at a time through a website until all pages have been indexed. Web crawlers help in collecting information about a website and the links related to them, and also help in validating the HTML code and hyperlinks.

A Web crawler is also known as a Web spider, automatic indexer or simply crawler.

[davidsmith21]

A Web crawler is a program that peruses the internet in a deliberate, automatted way.

[Michealdesouza]

A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index.

[jackar56]

Web Crawler is search engine bot which use for indexing and cache