PDA

View Full Version : What are Spiders, Robots and Crawlers and what are their functions?



littlemgrnoida
09-11-2017, 06:46 AM
Spiders, robot and crawler, they are all same and referred by different names. It is a software program that follows, or “Crawls” different links throughout the internet, and then grabs the content from the sites and adds to the search engine indexes.

aidpcards
10-23-2017, 08:12 AM
Spiders, Robots & Crawlers all are different names of the same Google Bot which indexed different information in Google index by crawling one by one every link, page, sitemap etc of a website.

Carlbrewster
10-23-2017, 08:22 AM
They all are same, which crawl a website, on a day to day bases and index them in google database.

deepakrajput
10-24-2017, 02:23 AM
All above three keyword are same for read the website.

RH-Calvin
10-24-2017, 02:46 AM
They are all the same and are different names of a search engine automated program that is responsible to read through webpage source and provide information to search engines. They are helpful to crawl and index webpages in search engines.