Results 1 to 5 of 5
  1. #1
    Registered User
    Join Date
    Feb 2017
    Location
    East Patel Nagar
    Posts
    27

    What are Spiders, Robots and Crawlers and what are their functions?

    What are Spiders, Robots and Crawlers and what are their functions?

  2. #2
    Registered User
    Join Date
    Jun 2016
    Location
    Mumbai
    Posts
    872
    Spiders, Robots and Crawlers all are same these are automated software programme search engine use to stay up to date with web activities and finding new.

  3. #3
    Senior Member
    Join Date
    Jun 2013
    Location
    Forum
    Posts
    5,019
    They are all the same and are different names of a search engine automated program that is responsible to read through webpage source and provide information to search engines. They are helpful to crawl and index webpages in search engines.
    Cheap VPS | $1 VPS Hosting
    Windows VPS Hosting | Windows with Remote Desktop
    Cheap Dedicated Server | Free IPMI Setup

  4. #4
    Registered User
    Join Date
    Aug 2016
    Posts
    83
    Spiders, Robots and Crawlers all are same these are software programme search engine use to crawl index every web page on the internet.

  5. #5
    Senior Member
    Join Date
    Feb 2017
    Posts
    222
    Spiders, Robots, and Crawlers all are same these are automated software program search engine use to stay up to date with web activities and finding new links and information to index in their database. Search engines need to keep their database updated so they created some automated programs which go from site to site and find the new data for search engine also collects the information about the webpage what is the page all about.

    All the three programs Spiders, Robots, and crawlers are same and do similar work we call them with different names these are only service tools for the search engine which helps to find and index new web links in search engine correctly.

    Search engine robots or crawlers works is to find new links for search engine and index them in search engine database. When you submit a new website or link in webmaster or search console it is kept in queue till the time robots visit the web page and verify its content.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

  Find Web Hosting      
  Shared Web Hosting UNIX & Linux Web Hosting Windows Web Hosting Adult Web Hosting
  ASP ASP.NET Web Hosting Reseller Web Hosting VPS Web Hosting Managed Web Hosting
  Cloud Web Hosting Dedicated Server E-commerce Web Hosting Cheap Web Hosting


Premium Partners:


Visit forums.thewebhostbiz.com: to discuss the web hosting business, buy and sell websites and domain names, and discuss current web hosting tools and software.