Deprecated: mysql_connect(): The mysql extension is deprecated and will be removed in the future: use mysqli or PDO instead in /home/a26f9f83/public_html/articles/includes/config.php on line 159
SEO Expert Guide - Search Engines Explained (part 1/10) > NetSparsh - Viral Content you Love & Share

SEO Expert Guide - Search Engines Explained (part 1/10)

Before we explore the world of search engine optimization, it is vital that you know a little about how search engines work and their relative market shares. It will help you to prioritize your activities later!

(a) What are Search Engines and who powers them?

There are essentially four different parts to a typical large search engine; the crawler, the directory, sponsored results and the search engine itself.

Crawlers (e.g. Google) automatically visit web pages to compile their listings, making use of a so-called robot or spider (eg. Googlebot), which follows links from one website to another, ultimately compiling an index of all the pages and sites on the internet. These crawlers provide an index, which can then searched by the search engine. You may find that several or all of the pages on your site are indexed in thisway. Some search engines have their own crawler and others buy-in crawler results from others.

Human-powered directories, such as the Open Directory, rely on submissions from the public, which are reviewed by editors for inlusion in the directory. If you get included in a directory, generally only one page from your site (usually your home - or index - page) will be listed.

Crawled results are combined with sponsored results, supplied by pay-per-click (PPC) advertisers, and the results from human-maintained directories to complete the search engine index. Check out the Search Engine Reationship Chart at Bruce Clay inc. for the latest picture on who powers whom. You will note a couple of things right away. Firstly, the dominance of the Google and Yahoo! crawlers and secondly the importance of DMOZ directory results as a back-door for many search engines.

(b) How do Search Engines find and rank sites?

Search engines do not really search the web directly, but rather an index database of the full text of web pages, which itself is drawn from the billions of web pages on the internet's servers. Search engine databases are selected and built by computer robot programs called spiders.

If a web page is never linked to by any other page, spiders cannot find it, unless the (usually new) site is submitted manually by a human at the search engine's "add URL" page. All search engine companies offer ways to do this.

After spiders find pages, they pass them on to another computer program for "indexing." This program uses an "algorithm" to assess the text, links, and other content in the page for "key words" that might be searched on at the engine. This allows the search engine to order results served by their "relevancy" to the search terms used. As each search engine has a different algorithm, it will index sites in a different way and thus serve up different relevant results.

Some types of pages and links are excluded from most search engines by policy. Others are excluded because search engine spiders cannot access them. Generally, the use of frames, flash graphics and dynamic URLs all get in the way of effective spidering and should thus be avoided.

In addition to indexing pages, most algorithms seek to establish the "authority" of a site. A site which is linked to by many other sites (using keyword-rich anchor text) is assumed to be of greater merit than one with no links at all. This activity is called "ranking" and helps search engines to sort otherwise similar results into ever-more relevant and authoratative results.

(c) Which Search Engines are the most popular?

Based on US analysis in January 2005, the top search engines (by share of total searches at home and work) are as follows:

Google Search - 47%

Yahoo! Search - 21%

MSN Search - 13%

All Others - 19%

These shocking figures do not convey the true dominance of the top players, as you have seen from the interdependence of search provision in section (a) above. You could be searching at AOL (part of the "other" 19%) and viewing Google results, for example.

There is also strong anecdotal evidence that Yahoo! and MSN tend to send more searchers through to their sponsored (or paid) results than do Google (due to the prominence of these results on their results pages). As such, for a typical small webmaster who does not use pay-per-click (PPC) advertising, they might get up to 80% of all their traffic from Google's various sites across the world.

Now you understand the market a little better, you will perhaps understand the obsession many webmasters have with Google! A top-10 position at Google for your key search terms can make your online business fly. If you drop out of that top-10, your business can literally collapse overnight!

Don't forget these key stats as you embark on your optimization journey...

Navigate the guide

Previous : SEO Expert Guide - Index of Contents

Next: SEO Expert Guide - Proposition Development (part 2/10)

About the author:

David Viney (david@viney.com) is the author of the Intranet Portal Guide; 31 pages of advice, tools and downloads covering the period before, during and after an Intranet Portal implementation.

Read the guide at http://www.viney.com/DFV/intranet_portal_guide or the Intranet Watch Blog at http://www.viney.com/intranet_watch.

In The News:

This RSS feed URL is deprecated, please update. New URLs can be found in the footers at https://news.google.com/news

Forbes

15 Common SEO Mistakes To Avoid
Forbes
Understanding SEO is the ultimate marketing discipline, especially in today's highly digital world. If you want to drive traffic to your site and increase sales, you have to keep up with the ever-changing search engine algorithms. Of course, in the ...
The benefits of using SEO for your small businessAugusta Free Press

all 8 news articles »

Forbes

Rich Snippets: A Valuable And Underutilized SEO Strategy
Forbes
In reviewing your latest digital marketing strategy, perhaps you feel like you've dotted all your i's and crossed all your t's, yet you're still not ranking as high as you'd like. You've optimized the title tags and meta descriptions and targeted all ...


Forbes

SEO Is A Must For Small Businesses: Here's How To Get Started
Forbes
If this means you have to take a crash course on search engine optimization (SEO), so be it. Another option is to create your website and then solicit SEO services from a reputable company. Although you may not have a large budget as a small business ...
SEO Ranking - What Factors You Need to Focus on for Your SitePerformanceIN

all 4 news articles »

CMSWire

How to Ensure Your SEO Plan Is Put Into Action
CMSWire
Businesses opt not to implement SEO recommendations for a variety of common reasons: lack of understanding, limited resources, bureaucracy and more. While this stonewalling will unfortunately sound all too familiar to SEO practitioners, there are ways ...


Forbes

Three Simple Steps To Seasonal SEO Success
Forbes
'Tis the season for seasonal SEO. Now you're asking: “Wait, seasonal SEO. Is that even a thing? I thought SEO was a long-term strategy.” Yes, seasonal SEO is surely a thing -- a big thing -- that should work hand-in-hand with your long-term strategy.


CMSWire

Why SEO Efforts So Often Fall Short
CMSWire
The inability to get people to implement SEO recommendations is the most common SEO fail of them all. I know, this sound like a no-brainer — but it's one of the biggest issues that we deal with as an industry. Often SEOs can explain perfectly why ...


Search Engine Journal

23 SEO & Search Takeaways from Google's Gary Illyes
Search Engine Journal
Gary Illyes, Google Webmaster Trends Analyst, opened up Pubcon in Las Vegas this morning talking about what's new with Google and what you need to know about optimizing for search. Here are the highlights.


Media Update

Video: Three easy steps to ace SEO – every time
Media Update
If your content isn't specifically designed to be found by search engines like Google or Yahoo, it won't be. media update shows you how to make your brand's content more SEO-friendly and improve your SEO strategy. Video: Three easy steps to ace SEO ...

and more »

Search Engine Journal

Google's John Mueller Predicts Much More JavaScript in SEO in the Coming Years
Search Engine Journal
Google's John Mueller predicts technical SEOs will run into more JavaScript in the coming years than they've encountered in the 2+ decades of SEO so far. To that end, for SEOs who are looking to advance their skill set, Mueller believes learning about ...

and more »

Search Engine Roundtable

Google: Huge Opportunity In Knowing JavaScript For Technical SEO
Search Engine Roundtable
Google's John Mueller believes that there is a lot of opportunity for a technical SEO to learn JavaScript. He said that there is going to be a lot more JavaScript development over the next couple years than in the previous two decades and having that ...
The Great Google/SEO Communications ConundrumSearch Engine Journal

all 2 news articles »
Google News

The Life Blood of Internet-Based Home Businesses...Search Engines

Anyone involved in an Internet-based home business will soon come... Read More

Search Engine Keywords - What Do People Search For?

Do you ever wonder how people search for things on... Read More

How Real SEO Analysis Works

If you're serious about SEO, you need to know how... Read More

Driving Your Website through Google Sandbox

What is Google Sandbox?Google Sandbox is applied on new websites,... Read More

7 Search Engine Optimization Strategy

Search engine optimization refers to the technique of making your... Read More

Local Customers Know Where to Find Local Businesses... the Internet

Through search engines and directories, the Internet provides a quick... Read More

Its Not Just All About Google Anymore

Those webmasters that stick to the old ways and focus... Read More

KEI Concerns and CID Alternative

Like many folks, I have been using KEI for some... Read More

SEO #4: Off-page Optimization

Yesterday you should have read the third course out of... Read More

Duplicate Content Penalty - How to Lose Google Ranking Fast!

Duplicate content penalty. Ever heard of it? This penalty is... Read More

How To Avoid These Ten Costly Search Engine Mistakes

If you have a website then you already know the... Read More

Here Today Gone Tomorrow

Its a matter of here today, gone tomorrow at the... Read More

Finding The True PR Of A Page?

I had an email "conversation" this last week which I... Read More

The Role of the Robots.txt File to Improve Site Ranking!

Not many web master take the time to use a... Read More

What is Search Engine Optimization?

It is no secret that search engines are the number... Read More

Google has an Achilles Heal - Will Their Competitors Notice?

Even though Google Revenues continue to soar, the hidden problem... Read More

Advertise Locally Using Search Engines

While search engine advertising has been a great advertising medium... Read More

If Content is King, then surely Relevance is Queen!

There has been a lot of to-ing and fro-ing in... Read More

The 3 Essential Components of a Search Engine Optimization Campaign

Everyday, the Search Engines average 300 MILLION searches. In a... Read More

Search Engine Optimization Explained

Search Engine Listing And OptimizationIn the world of website marketing,... Read More

Offpage Optimization: Does Article Marketing Cut the Mustard?

For those who haven't heard: article marketing is the new... Read More

What All Top Google Websites Have in Common

While it is okay to admire and envy all those... Read More

The Search Engine Secret That Is No Secret At All

It's common knowledge - we all know that it is... Read More

How to Prevent Duplicate Content with Effective Use of the Robots.txt and Robots Meta Tag

Duplicate content is one of the problems that we regularly... Read More

Increase Page Rank with Search Engine Optimization

Utilizing effective search engine optimization techniques will improve the page... Read More