Results 1 to 5 of 5
  1. #1
    Member
    Join Date
    May 2017
    Posts
    40

    What are Spiders, Robots and Crawlers and what are their functions?

    Spiders, robot and crawler, they are all same and referred by different names. It is a software program that follows, or “Crawls” different links throughout the internet, and then grabs the content from the sites and adds to the search engine indexes.

  2. #2
    Member
    Join Date
    Sep 2017
    Posts
    55
    Spiders, Robots & Crawlers all are different names of the same Google Bot which indexed different information in Google index by crawling one by one every link, page, sitemap etc of a website.

  3. #3
    Registered User
    Join Date
    Aug 2016
    Posts
    182
    They all are same, which crawl a website, on a day to day bases and index them in google database.

  4. #4
    Senior Member deepakrajput's Avatar
    Join Date
    Feb 2012
    Location
    CA
    Posts
    1,223
    All above three keyword are same for read the website.

  5. #5
    Senior Member
    Join Date
    Jun 2013
    Location
    Forum
    Posts
    5,019
    They are all the same and are different names of a search engine automated program that is responsible to read through webpage source and provide information to search engines. They are helpful to crawl and index webpages in search engines.
    Cheap VPS | $1 VPS Hosting
    Windows VPS Hosting | Windows with Remote Desktop
    Cheap Dedicated Server | Free IPMI Setup

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

  Find Web Hosting      
  Shared Web Hosting UNIX & Linux Web Hosting Windows Web Hosting Adult Web Hosting
  ASP ASP.NET Web Hosting Reseller Web Hosting VPS Web Hosting Managed Web Hosting
  Cloud Web Hosting Dedicated Server E-commerce Web Hosting Cheap Web Hosting


Premium Partners:


Visit forums.thewebhostbiz.com: to discuss the web hosting business, buy and sell websites and domain names, and discuss current web hosting tools and software.