PDA

View Full Version : what is spiders,crawlers,bots?



access1sol7
11-08-2016, 01:23 AM
what is spiders,crawlers,bots?

samant
11-08-2016, 01:24 AM
spiders, bots, and crawlers are the programs that harvest information for search engines

chrisgeitz
11-08-2016, 04:38 AM
Googlebot, Yahoo Slurp, and MSNbot and similar spiders, bots, and crawlers are the programs that harvest information for search engines. For anyone tracking statistics on their website, Googlebot, MSNbot, and Yahoo Slurp can be welcomed guests.

ShreyaKoushik
11-08-2016, 04:51 AM
Spider- A spider is a program run by a search engine to build a summary of a website’s content (content index). Spiders create a text-based summary of content and an address (URL) for each webpage.

Crawling- Crawling takes place when there is a successful fetching of unique URLs which can be traced from valid links from other web pages.

Bots - It had automated computer program can visit websites. It will guided by search engine algorithms It can combine the tasks of crawler & spider helpful of the indexing the web pages and through the search engines.

alpa
11-08-2016, 06:37 AM
Googlebot, Yahoo Slurp, and MSNbot and similar spiders, bots, and crawlers are the programs that harvest information for search engines.