PDA

View Full Version : What is a crawler?



jacobharrison76
07-17-2014, 04:18 AM
What is a crawler?

annabelle123
07-17-2014, 11:43 AM
several crawler there, what crawler you ask.

rajivdevkk
07-18-2014, 03:19 AM
crawlers is search engines spiders. crawlers main work to crawls the pages and save its to data base to show search engine results.

josephinek
07-18-2014, 06:22 AM
It is also called as web crawlers.
It is a program.
It helps search engines use to crawl web pages for indexing.

drwebsites
07-18-2014, 07:11 AM
a program that systematically browses the World Wide Web in order to create an index of data for the search engine.

RH-Calvin
07-18-2014, 03:23 PM
Crawlers are programmable bots that move through your webpage source code and identify your webpage content. They help to cache and index your webpages in search engines.

onlinebigboss
07-19-2014, 04:47 AM
crawler is the Google spider and it is also crawl your websites and store your information on data base

NicholasK
07-20-2014, 04:46 AM
A Web crawler is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing. A Web crawler may also be called a Web spider, an ant, an automatic indexer, or (in the FOAF software context) a Web scutter.

Web search engines and some other sites use Web crawling or spidering software to update their web content or indexes of others sites' web content. Web crawlers can copy all the pages they visit for later processing by a search engine that indexes the downloaded pages so that users can search them much more quickly.

yepionline
07-20-2014, 10:00 AM
A crawler is a spider (robots) that visit Web sites and reads their pages and other information in order to create entries for a search engine index.

jhonsmith123
07-20-2014, 05:47 PM
Hi friends,

A program that systematically browses the World Wide Web in order to create an index of data.

Sophiacalvin
07-21-2014, 08:35 AM
web crawler is the spider that can helps in accessing many web pages in one crawler.

naveenkumar47
07-23-2014, 07:54 AM
great information shared in this thread thanx

rohit
07-24-2014, 07:50 AM
Crawlers and bots are more or less the same they are used to automate the work which is repetitive.

Crawlers are used by search engines to make a copy of the webpage in their database, consider a google bot / crawler visits your page then google will be having a copy of your webpage and analyze the page and rank them accordingly, Also they make a list of links available in your website and form a hierarchical order of webpages available, making one page as home and others as child pages. This type of crawling makes the search engines check for new pages available, so it can update its database.

Ezio
07-28-2014, 03:02 AM
A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index.

marclewis
07-28-2014, 04:05 AM
It is simply a program that browses the world wide web in order to provide up to date to the particular search engine.

Ranjita
07-28-2014, 04:17 AM
A crawler is a word given to Google's system that browses the World Wide Web. It is also called spider. The main purpose of the crawler is indexing your site.

omthavertch
07-28-2014, 06:52 AM
crawler is the a robot of the search engine to index the site and every search engine has its bot to crawl the site

sapnajha
07-28-2014, 09:17 AM
Crawlers and bots are more or less the same they are used to automate the work which is repetitive.
Crawlers are used by search engines to make a copy of the webpage in their database, consider a google bot / crawler visits your page then google will be having a copy of your webpage and analyze the page and rank them accordingly, Also they make a list of links available in your website and form a hierarchical order of webpages available, making one page as home and others as child pages. This type of crawling makes the search engines check for new pages available, so it can update its database.

Jackandrew
07-28-2014, 09:46 AM
A crawler is a program that visits your web sites and reads all their pages and other information in order to create entries for a search engine index. It is also known as a web spider.

jane18
07-28-2014, 10:25 AM
Crawlers are search engine's programs to crawl website and its pages.

colnettella
07-28-2014, 12:04 PM
Crawlers are search engines spiders that crawls the pages and save it to their data base to show search engine results.

AvniShergill
07-29-2014, 05:13 AM
Crawler refers to the program that visits website and reads pages and other information in order to index the page.

rousellwall
08-05-2014, 06:42 AM
Well, Crawlers are also known as a Google Spider. They are programmed bot, they crawl websites and stores regarding information of website in their database.

marclewis
08-07-2014, 02:37 AM
The program that visits web sites and reads their pages to create entries for a search engine index is called crawler.

Ship497
08-07-2014, 03:12 AM
A crawler is a bot of search engine which index website pages.

SammiRose
08-07-2014, 03:19 AM
Crawler is basically program who runs around to collect the websites datas to update in the Search Engines Databases

Bharti Mahour
08-07-2014, 03:56 AM
Google's crawler helps to crawl the web pages to save in data base.

janeleonard
08-08-2014, 05:48 AM
A crawler or a robot is a search engine program to visit the pages and index them in the database. It helps to retrieve the indexed information to display in the SERPs.