Results 1 to 5 of 5
  1. #1
    Registered User chinmay.sahoo's Avatar
    Join Date
    Jun 2017

    Thumbs up What do you mean by search engine spider or crawler?

    Search engine spider or crawler is nothing but a robot that discussed above in the Google bot section, used to discover the new pages that have been added to the Google’s index.

  2. #2
    Registered User
    Join Date
    Aug 2016
    It's an automated crawling tool which, which helps search engine bot to discover new pages and index them accordingly

  3. #3
    Join Date
    Jul 2017
    Spider, Crawler or Bot are the terms used to describe a software tool that collects data for search engines, called Web Crawlers. This software is designed to be able to browse the World Wide Web in a systematic manner, for the purpose of collecting information of those sites for the search engine (crawl data), aiming to save Index those sites into the Search Engine database. At the same time, help those search engines provide the most accurate assessment of the website being crawled.

  4. #4
    Registered User
    Join Date
    Sep 2016
    Its automatic crawling method in search engine.which helps search engine bot to discover new pages and index them accordingly

  5. #5
    Senior Member
    Join Date
    Aug 2017
    Search engine spider or crawler: Spiders is a name for the robots or crawlers that scan web and save the information in websites to a database. Hence, "Google spiders" is another name for "Google indexing bots". Spider - a browser like program that downloads web pages. Crawler – a program that automatically follows all of the links on each web page.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

  Find Web Hosting      
  Shared Web Hosting UNIX & Linux Web Hosting Windows Web Hosting Adult Web Hosting
  ASP ASP.NET Web Hosting Reseller Web Hosting VPS Web Hosting Managed Web Hosting
  Cloud Web Hosting Dedicated Server E-commerce Web Hosting Cheap Web Hosting

Premium Partners:

Visit to discuss the web hosting business, buy and sell websites and domain names, and discuss current web hosting tools and software.