Page 1 of 2 12 LastLast
Results 1 to 15 of 28
  1. #1

  2. #2
    Registered User
    Join Date
    Apr 2014
    Posts
    16
    several crawler there, what crawler you ask.

  3. #3
    Senior Member
    Join Date
    Sep 2013
    Location
    Delhi
    Posts
    387
    crawlers is search engines spiders. crawlers main work to crawls the pages and save its to data base to show search engine results.

  4. #4
    Registered User
    Join Date
    Dec 2013
    Posts
    76
    It is also called as web crawlers.
    It is a program.
    It helps search engines use to crawl web pages for indexing.
    Elance clone script helps to create eCommerce website Agriya .

  5. #5
    Member
    Join Date
    May 2014
    Location
    Burnley
    Posts
    93
    a program that systematically browses the World Wide Web in order to create an index of data for the search engine.

  6. #6
    Senior Member
    Join Date
    Jun 2013
    Location
    Forum
    Posts
    5,019
    Crawlers are programmable bots that move through your webpage source code and identify your webpage content. They help to cache and index your webpages in search engines.
    Cheap VPS | $1 VPS Hosting
    Windows VPS Hosting | Windows with Remote Desktop
    Cheap Dedicated Server | Free IPMI Setup

  7. #7
    Member
    Join Date
    Jul 2014
    Location
    banglore
    Posts
    75
    crawler is the Google spider and it is also crawl your websites and store your information on data base

  8. #8
    A Web crawler is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing. A Web crawler may also be called a Web spider, an ant, an automatic indexer, or (in the FOAF software context) a Web scutter.

    Web search engines and some other sites use Web crawling or spidering software to update their web content or indexes of others sites' web content. Web crawlers can copy all the pages they visit for later processing by a search engine that indexes the downloaded pages so that users can search them much more quickly.
    Quality of Directory Submission Service http://www.enormousseo.com/

  9. #9
    Registered User
    Join Date
    Jan 2013
    Location
    Lisbon
    Posts
    62
    A crawler is a spider (robots) that visit Web sites and reads their pages and other information in order to create entries for a search engine index.

  10. #10
    Senior Member
    Join Date
    Jan 2013
    Location
    Ranchi
    Posts
    205

    What is a crawler?

    Hi friends,

    A program that systematically browses the World Wide Web in order to create an index of data.

  11. #11
    Registered User
    Join Date
    Dec 2013
    Posts
    58
    web crawler is the spider that can helps in accessing many web pages in one crawler.

  12. #12
    Registered User
    Join Date
    Dec 2013
    Posts
    80
    great information shared in this thread thanx

  13. #13
    Registered User
    Join Date
    Apr 2014
    Location
    india
    Posts
    404
    Crawlers and bots are more or less the same they are used to automate the work which is repetitive.

    Crawlers are used by search engines to make a copy of the webpage in their database, consider a google bot / crawler visits your page then google will be having a copy of your webpage and analyze the page and rank them accordingly, Also they make a list of links available in your website and form a hierarchical order of webpages available, making one page as home and others as child pages. This type of crawling makes the search engines check for new pages available, so it can update its database.

  14. #14
    Registered User
    Join Date
    Jun 2014
    Posts
    103
    A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index.

  15. #15
    Registered User
    Join Date
    Jul 2014
    Posts
    88
    It is simply a program that browses the world wide web in order to provide up to date to the particular search engine.

Page 1 of 2 12 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

  Find Web Hosting      
  Shared Web Hosting UNIX & Linux Web Hosting Windows Web Hosting Adult Web Hosting
  ASP ASP.NET Web Hosting Reseller Web Hosting VPS Web Hosting Managed Web Hosting
  Cloud Web Hosting Dedicated Server E-commerce Web Hosting Cheap Web Hosting


Premium Partners:


Visit forums.thewebhostbiz.com: to discuss the web hosting business, buy and sell websites and domain names, and discuss current web hosting tools and software.