Page 2 of 2 FirstFirst 12
Results 16 to 28 of 28
  1. #16
    Junior Member
    Join Date
    Jun 2014
    Posts
    7
    A crawler is a word given to Google's system that browses the World Wide Web. It is also called spider. The main purpose of the crawler is indexing your site.

  2. #17
    Registered User omthavertch's Avatar
    Join Date
    Jul 2014
    Posts
    66
    crawler is the a robot of the search engine to index the site and every search engine has its bot to crawl the site

  3. #18
    Senior Member
    Join Date
    Jul 2014
    Location
    India
    Posts
    100
    Crawlers and bots are more or less the same they are used to automate the work which is repetitive.
    Crawlers are used by search engines to make a copy of the webpage in their database, consider a google bot / crawler visits your page then google will be having a copy of your webpage and analyze the page and rank them accordingly, Also they make a list of links available in your website and form a hierarchical order of webpages available, making one page as home and others as child pages. This type of crawling makes the search engines check for new pages available, so it can update its database.

  4. #19
    Registered User Jackandrew's Avatar
    Join Date
    Jul 2014
    Location
    Los Angeles, Texas, United States
    Posts
    122
    A crawler is a program that visits your web sites and reads all their pages and other information in order to create entries for a search engine index. It is also known as a web spider.

  5. #20
    Registered User
    Join Date
    May 2014
    Location
    Ludhiana
    Posts
    58
    Crawlers are search engine's programs to crawl website and its pages.

  6. #21
    Member
    Join Date
    Jul 2014
    Posts
    40
    Crawlers are search engines spiders that crawls the pages and save it to their data base to show search engine results.

  7. #22
    Senior Member
    Join Date
    May 2014
    Posts
    184
    Crawler refers to the program that visits website and reads pages and other information in order to index the page.

  8. #23
    Senior Member
    Join Date
    Jun 2013
    Posts
    270
    Well, Crawlers are also known as a Google Spider. They are programmed bot, they crawl websites and stores regarding information of website in their database.

  9. #24
    Registered User
    Join Date
    Jul 2014
    Posts
    88
    The program that visits web sites and reads their pages to create entries for a search engine index is called crawler.

  10. #25
    Senior Member
    Join Date
    Sep 2013
    Posts
    204
    A crawler is a bot of search engine which index website pages.
    Transocean Shipping Ventures Pvt. Ltd. - Offers Ship Management Services.

  11. #26
    Registered User SammiRose's Avatar
    Join Date
    Jun 2014
    Location
    Denver
    Posts
    117
    Crawler is basically program who runs around to collect the websites datas to update in the Search Engines Databases
    Windows VPS Hosting
    Cloud VPS
    Every problem has a solution

  12. #27
    Google's crawler helps to crawl the web pages to save in data base.

  13. #28
    A crawler or a robot is a search engine program to visit the pages and index them in the database. It helps to retrieve the indexed information to display in the SERPs.

Page 2 of 2 FirstFirst 12

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

  Find Web Hosting      
  Shared Web Hosting UNIX & Linux Web Hosting Windows Web Hosting Adult Web Hosting
  ASP ASP.NET Web Hosting Reseller Web Hosting VPS Web Hosting Managed Web Hosting
  Cloud Web Hosting Dedicated Server E-commerce Web Hosting Cheap Web Hosting


Premium Partners:


Visit forums.thewebhostbiz.com: to discuss the web hosting business, buy and sell websites and domain names, and discuss current web hosting tools and software.