PDA

View Full Version : google spider



manju
03-03-2009, 03:31 AM
Basically all search engine spiders function on the same principle – they crawl the Web and index pages, which are stored in a database and later use various algorithms to determine page ranking, relevancy, etc of the collected pages. While the algorithms of calculating ranking and relevancy widely differ among search engines, the way they index sites is more or less uniform and it is very important that you know what spiders are interested in and what they neglect.

Search engine spiders are robots and they do not read your pages the way a human does. Instead, they tend to see only particular stuff and are blind for many extras (Flash, JavaScript) that are intended for humans. Since spiders determine if humans will find your site, it is worth to consider what spiders like and what don't.

shennon
03-04-2009, 01:36 AM
Hi,

yep, I do agree with you. However, is there anyway to know how does particular search engine spider work? I mean how to recognize what spiders like and what don't.

~ServerPoint~
03-04-2009, 01:42 AM
I believe there are different kinds of the spiders and only SEO expert can say about them for sure.

Robdale
03-05-2009, 04:18 PM
I have seen somewhere on forum about the different search engines and their robot names. I was totally aware about it.

shennon
03-17-2009, 05:27 AM
Instead, they tend to see only particular stuff and are blind for many extras (Flash, JavaScript) that are intended for humans.

Now, spiders are able to crawl text from flash files.

mutamesthri
03-18-2009, 03:32 PM
google spiders crawl into the websites and
take the content

Social bookmark service (http://www.socialbookmark-service.com/)
Manual Directory submissions (http://www.manualdirectorysubmissions.info)
Parfumuri (http://www.cosmetice-unisex.ro)

bermuda
03-19-2009, 02:24 PM
If you are interested in noticing what spiders and robots are hitting and visiting your web pages and server on a regular basis, take a look at your log files or simply visit the Awstats section of your hosting account for details daily reports.

Robdale
03-19-2009, 04:50 PM
If you are interested in noticing what spiders and robots are hitting and visiting your web pages and server on a regular basis, take a look at your log files or simply visit the Awstats section of your hosting account for details daily reports.

Thanks for that info about log files. I will surely check out.

Henry
03-25-2009, 04:30 AM
SEO isn’t a one-time event. Search engine algorithms change regularly, so the tactics that worked last year may not work this year. SEO requires a long-term outlook and commitment.

Robdale
03-26-2009, 01:18 PM
So true, I think Google is a mystery, can't say when it will change the algorithm. Many of the large websites lost their ranks in last 6 months due to small mistakes.

ebosysindia
05-12-2009, 06:21 AM
Every search engine has different algorithms and all are work independently different way, you can get some idea about spiders from webmaster guidelines.

As spiders are just a human made program so, it can't read designs (Flash, Java Script, Tables, Frames, Etc...) search engine spiders understand binary values like 0100 1001 1110 etc.. also the spiders integrated with database and they match queries with their database and show us the required result.

Oracle
05-13-2009, 06:59 AM
google spider is the crawler used by search engines like google to keep its index updated. All search engines excluding google also run crawlers which shows up as connection to websites.

oliver6419
06-30-2010, 03:36 AM
It is part of Google search which use to search the keyword.
________________________________
Managed Services Provider (http://www.4net-technologies.co.uk/)
Managed Services (http://www.4net-technologies.co.uk/managed-services.html)

enhancerank
07-09-2010, 06:15 AM
yep its true but its hard to check how from thier database they rank the websites as there is different algorithm for all search engines

zogox
07-09-2010, 01:10 PM
I use google webmaster tool and I have seen lots of link errors that google found. I have fixed mostly but i don't want to see 20000+ crawl errors anymore. Do you know how frequently do they delete or upgrade?

tomgrey
07-24-2010, 01:15 AM
Google spider is nothing than PC program that follows some links on web and collects information as it goes. As these crawlers are merely PC programs.

Jerin
07-27-2010, 02:20 AM
Site maps are only a tactic to increase the crawler's ability of taking back your site to the search engine's index.

ddexxters75
07-27-2010, 02:28 AM
The Google Spider lives on my sites all the time I always see it there. Is this just a normal thing? Does anyone use bug spray or it's a GOOD sider
___________________
Used Auto Parts (http://www.autopartsinc.com)
Used Car Parts (http://www.autopartsinc.com)

vigorandrik
07-28-2010, 09:32 AM
Essentially it is without difficulty the search engines can interpret your website. This eventually depends on the search engine that is reading your site. A number of have the tolerance to dig deep into your site and assure to follow each link. Others may get uninterested before they finish indexing a whole page. Cautiously systematize your page content and Web site to make sure that spiders index the whole obsession - not just bits and pieces.

HaroldTyler123
08-31-2010, 04:07 AM
Google Spiders( A. googlonis) are a form of robotic devices developed by Google founders Larry Page and Sergei Brin to bring peace and prosperity to the galaxy. They come in several forms, but characteristics shared by all include an arachnoid appearance and a brightly coloured shell.




____________________________
Manchester United Hotel (http://www.manchester-hotels.uk.com/manchester-united-hotels.php)
Manchester Airport Hotels (http://www.manchester-hotels.uk.com/manchester-airport-hotels.php)