Results 1 to 8 of 8
  1. #1

  2. #2
    Senior Member
    Join Date
    Aug 2021
    Location
    931 Clayton St San Francisco, CA 94117 United States
    Posts
    118
    Quote Originally Posted by Cyril30 View Post
    Hello,

    What is web crawling?
    Hello Cyril30

    "Web search engines (Google) and a few other websites use Web crawling to update their web content or website updates. Web crawlers copy pages for processing by a search engine, which indexes the downloaded pages so that users can search more relevant queries."

  3. #3
    Member
    Join Date
    Oct 2021
    Location
    USA
    Posts
    64
    Quote Originally Posted by Cyril30 View Post
    Hello,

    What is web crawling?
    Hey Cyril 30,

    A web crawler (also known as a web spider or web robot) is a program or automated script which browses the World Wide Web in a methodical, automated manner.

    This process is called Web crawling or spidering.

    Many legitimate sites, in particular search engines, use spidering as a means of providing up-to-date data.

    Web crawlers are mainly used to create a copy of all the visited pages for later processing by a search engine, that will index the downloaded pages to provide fast searches.

    Crawlers can also be used for automating maintenance tasks on a Web site, such as checking links or validating HTML code.

    Also, crawlers can be used to gather specific types of information from Web pages, such as harvesting e-mail addresses (usually for spam).

    Hope this solves the query!

  4. #4
    Member
    Join Date
    Oct 2021
    Location
    USA
    Posts
    64
    Quote Originally Posted by Cyril30 View Post
    Hello,

    What is web crawling?
    Hey Cyril 30,

    A web crawler (also known as a web spider or web robot) is a program or automated script which browses the World Wide Web in a methodical, automated manner.

    This process is called Web crawling or spidering.

    Many legitimate sites, in particular search engines, use spidering as a means of providing up-to-date data.

    Web crawlers are mainly used to create a copy of all the visited pages for later processing by a search engine, that will index the downloaded pages to provide fast searches.

    Crawlers can also be used for automating maintenance tasks on a Web site, such as checking links or validating HTML code.

    Also, crawlers can be used to gather specific types of information from Web pages, such as harvesting e-mail addresses (usually for spam).

    Hope this solves the query!

  5. #5
    Registered User
    Join Date
    Aug 2018
    Posts
    1,004
    Web crawling is the process of indexing data on web pages by using a program or automated script. These automated scripts or programs are known by multiple names, including web crawler, spider, spider bot, and often shortened to crawler.

    Web crawlers copy pages for processing by a search engine, which indexes the downloaded pages so that users can search more efficiently. The goal of a crawler is to learn what webpages are about. This enables users to retrieve any information on one or more pages when it’s needed.


    Oryon Networks | Singapore Web Hosting | Best web hosting provider | Best web hosting in SG | Oryon SG

  6. #6
    Senior Member
    Join Date
    Oct 2021
    Posts
    245
    Web slithering is the most common way of ordering information on website pages by utilizing a program or mechanized content. These computerized scripts or projects are known by various names, including web crawler, insect, bug bot, and frequently abbreviated to the crawler.

    Web crawlers duplicate pages for handling by an internet searcher, which files the downloaded pages with the goal that clients can look through more effectively. The objective of a crawler is to realize what pages are about. This empowers clients to recover any data on at least one page when it's required.

  7. #7
    Senior Member
    Join Date
    Dec 2021
    Location
    Nagpur, India
    Posts
    438
    We can say that web crawling is one type of Google Bot Software that collect the data from our website.*****

  8. #8
    Senior Member
    Join Date
    Dec 2021
    Posts
    369
    Web crawling is spiders or bots that search the internet and websites. They can find your site if thier are links to it that are do follow and even list site in search engines without you submitting the site. They check your site and list what it is about and search terms it should be listed for.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

  Find Web Hosting      
  Shared Web Hosting UNIX & Linux Web Hosting Windows Web Hosting Adult Web Hosting
  ASP ASP.NET Web Hosting Reseller Web Hosting VPS Web Hosting Managed Web Hosting
  Cloud Web Hosting Dedicated Server E-commerce Web Hosting Cheap Web Hosting


Premium Partners:


Visit forums.thewebhostbiz.com: to discuss the web hosting business, buy and sell websites and domain names, and discuss current web hosting tools and software.