Results 1 to 12 of 12
  1. #1
    Registered User
    Join Date
    Aug 2019
    Location
    Kathmandu, Nepal
    Posts
    4

    What is web crawler ?

    Hello Everyone,

    If you know please tell me.

  2. #2
    Hey David,
    to know the easily searchable question's answer, I would suggest using Google. You will get instant answers.

  3. #3
    Senior Member
    Join Date
    Jul 2019
    Posts
    582
    A web crawler or a search engine spider is a computer program that gathers information from hundreds of billions of WebPages and reads those pages and organizes them by creating an entry in a search engine index.2 hours ago

  4. #4

  5. #5
    Senior Member
    Join Date
    Jul 2019
    Posts
    110
    A crawler is a computer program that automatically searches documents on the Web. Crawlers are primarily programmed for repetitive actions so that browsing is automated.

  6. #6
    Senior Member
    Join Date
    Apr 2019
    Location
    Mumbai
    Posts
    355
    A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web

  7. #7
    Senior Member
    Join Date
    Sep 2019
    Posts
    770
    A web crawler, or spider, is a type of bot that's typically operated by search engines like Google and Bing. Their purpose is to index the content of websites all across the Internet so that those websites can appear in search engine results.

  8. #8

  9. #9
    Senior Member
    Join Date
    Nov 2018
    Posts
    1,348
    A Web Crawler (also known as a search engine spider, searchbot, robot) is a program which is used by search engine to find what is new on Internet(website). This process is called Crawling.

  10. #10
    Registered User
    Join Date
    Apr 2016
    Posts
    792
    A crawler is a computer program that automatically searches documents on the Web. Crawlers are primarily programmed for repetitive actions so that browsing s automated.

  11. #11

  12. #12
    Registered User
    Join Date
    Nov 2019
    Posts
    2,528
    A web crawler copies webpages so that they can be processed later by the search engine, which indexes the downloaded pages. This allows users of the search engine to find webpages quickly. The web crawler also validates links and HTML code, and sometimes it extracts other information from the website

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

  Find Web Hosting      
  Shared Web Hosting UNIX & Linux Web Hosting Windows Web Hosting Adult Web Hosting
  ASP ASP.NET Web Hosting Reseller Web Hosting VPS Web Hosting Managed Web Hosting
  Cloud Web Hosting Dedicated Server E-commerce Web Hosting Cheap Web Hosting


Premium Partners:


Visit forums.thewebhostbiz.com: to discuss the web hosting business, buy and sell websites and domain names, and discuss current web hosting tools and software.