Page 1 of 3 123 LastLast
Results 1 to 15 of 36
  1. #1
    Senior Member Vamp1re's Avatar
    Join Date
    Dec 2012
    Posts
    408

    Difference between Spider and Crawlers ?

    I want to know the difference between Spiders and Crawlers?

  2. #2
    Senior Member
    Join Date
    Apr 2012
    Posts
    1,019
    Spider - a browser like program that downloads web pages.

    Crawler – a program that automatically follows all of the links on each web page.

  3. #3
    Senior Member
    Join Date
    Feb 2012
    Posts
    161
    Spider is a browser like program that download web pages
    Crawler is a program that crawls each page and links on the pages.

  4. #4
    Senior Member
    Join Date
    Apr 2013
    Location
    Sydney
    Posts
    108
    Spider crawl or save web page content in search engine database, and crawler download website url for indexing.

  5. #5
    Member
    Join Date
    May 2013
    Location
    Gurgaon, Haryana, India
    Posts
    92
    Thanks for sharing info about spider and crawler, now i know difference about it.

  6. #6
    Registered User
    Join Date
    Feb 2012
    Location
    US
    Posts
    945
    A web spider is a piece of software that scans your web pages and collects data for indexing. A program that automatically follows all of the links on each web page is called crawler.

  7. #7
    Senior Member
    Join Date
    Apr 2012
    Posts
    452
    Many sites, in particular search engines, use spidering as a means of providing up-to-date data. Web crawlers are mainly used to create a copy of all the visited pages for later processing by a search engine that will index the downloaded pages to provide fast searches.

  8. #8
    Registered User
    Join Date
    Dec 2012
    Location
    India
    Posts
    928
    Spiders,Crawlers, or google Bots are just programs the search engines use to index the content found on the World Wide Web.

  9. #9
    Registered User
    Join Date
    Feb 2013
    Location
    sydney
    Posts
    223
    I think Spider program to crawl website content and Crawler is help to indexing website urls.

  10. #10
    Registered User
    Join Date
    Oct 2011
    Location
    USA
    Posts
    16
    Spiders and crawlers both are same !

  11. #11
    Registered User
    Join Date
    Apr 2013
    Location
    India
    Posts
    71
    Crawling- Google sends its spiders to your website..
    Spider- Google visited your website and has added you to its database..

  12. #12
    Senior Member
    Join Date
    May 2013
    Posts
    231
    I used to confuse the two. But now I know the difference.

    Spiders browse and download webpages. Crawlers index your webpages to the appropriate SERP categories.

  13. #13
    Registered User
    Join Date
    Jun 2013
    Posts
    2
    Both crawls but i find some interesting difference here.

  14. #14
    Member
    Join Date
    Mar 2013
    Location
    Sydney, Australia
    Posts
    35
    Thanks for sharing knowledge about spiders and crawlers.

  15. #15
    Senior Member
    Join Date
    Mar 2011
    Location
    New Delhi
    Posts
    642
    Spider:- Spider is a application program used to scan the web pages from website.

    Crawler :-Crawler is used to crawl or index the pages from website.

Page 1 of 3 123 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

  Find Web Hosting      
  Shared Web Hosting UNIX & Linux Web Hosting Windows Web Hosting Adult Web Hosting
  ASP ASP.NET Web Hosting Reseller Web Hosting VPS Web Hosting Managed Web Hosting
  Cloud Web Hosting Dedicated Server E-commerce Web Hosting Cheap Web Hosting


Premium Partners:


Visit forums.thewebhostbiz.com: to discuss the web hosting business, buy and sell websites and domain names, and discuss current web hosting tools and software.