Googlebot Wont Go Home

I have 'Googlebot' crawl my site every day like a dispossessed spirit that can't leave.

It was not always like this, I would go for a month or more before he came to my site and then would only crawl a few pages and leave again.

This has been going on now for two months or more, I've been watching the stats on my server everyday seeing just where he goes. He will crawl a few pages one day, and the next some other pages, and then finally leave until the morrow. After just three or four weeks, I noticed I got an infestation of lesser bots calling as well, some I have never heard of before, they seem to follow 'Googlebot' as though he is the Pied Piper of Hamelin.

What caused this infestation of bots?

Well, I got interested in rss feeds, I thought "What a good tool for drawing traffic to my site."

So I studied up on rss feeds until I understood what was involved. Now I am no 'techie', and the most programming I do is html in 'Notepad', making my own web pages.

Rss feeds use a similar language called xml, so it was easy to understand for me, and I was able to quickly make up an rss feed page in 'Notepad', placed it on my server, downloaded a 'feed reader' software, opened it up, placed the address of my feed in the 'feed reader', and up came my rss feed in the reader. It was so easy I wrote an ebook to tell everyone how to do it, it's called "Really Simple RSS".

There are many rss directories and syndication services that I submitted the address of my rss feed to, so other people can look at the feed in their 'feed reader' and see what articles I am posting.

Some of the 'subscribers' to the feed actually come and visit my site to see what it's all about, which happened almost straight away after I submitted my feed.

In less than 36 hours, 'Googlebot' found my feed!

In a little over two days later Yahoo's 'Slurp' bot found my feed, and from there on they have both been crawling my site with the lesser bots every single day.

They crawl everything, they crawl all my pdf ebooks, they look at a few pages in 'Webmasters Corner', they even look at my 'Bonus Reports', and even descend the staircase into my 'Secret Vault'!

When will they go home and stop prying into my little secrets?

I know I encourage them like leaving cheese for a mouse, by putting more pdf files, software and ebooks on my site every day, so I suppose the poor bots can't ever keep up!

I found out that like mice like cheese, that 'Googlebot' likes my pdf files, he has been fitted with digital spectacles so he is now able to actually read keyword rich pdf files all the way through to the end! So he likes pdf files.

So I have obliged him!

I put 85 pdf files up on my server one night just to keep him happily reading! I have put many more up on the server since, and will continue to create more pdf files of classic authors for free download, just to keep him calling with his 'friends'.

Isn't this a laugh?

It's like taking in a stray dog, feeding him, housing him, and the dog loosing the ability to wander off again and finding you have got a lodger for life.

My site's ranking has risen considerably both in Yahoo and Google, but for some reason that escapes me for the time being, my ranking rose more quickly in Yahoo and they rank it much higher than Google. I may well find the reason for this before long and put it in another article.

So if you are a web site owner struggling to get noticed by the web bots, don't put it off much longer, put up an rss feed with articles about your products or service and not only will 'Googlebot' call with his 'friends', but actual live people will call too.

About The Author

Tony Dean runs a web site selling ebooks and software at:- http://www.ebook-sales.com

Subscribe to his ezine just send a blank email to:- [email protected]

In The News:

How to Build SEO Into a Product  Search Engine Journal
How your business can benefit from SEO  Business MattersBusiness Matters
SEO myths debunked in free webinar  jewellerybusiness.com
10 Reasons Why SEO Doesn't Work  Search Engine Journal
How to Learn SEO: A U.S. News Guide  U.S. News & World Report
How to Dominate SEO in Small Markets  Search Engine Journal
What Is Enterprise SEO?  Search Engine Journal

?Web Content Management System fr Window?: Search Engine Typos

Oops! I meant "web content management system for windows." Do... Read More

SEO Expert Guide - Sitewide Optimization (part 4/10)

In parts 1 and 2 you learnt how to develop... Read More

Search Engine Optimisation: The Soon to be Impossible Dream!

There are today search engine and internet marketing services, in... Read More

Does The Number Of Links On A Page Affect Ranking?

Lots of research has focused on inbound links to a... Read More

3.5 Reasons You Need To Forget About Search Engines

Have you ever stopped to think how much time is... Read More

Google Patent Application - SEO Highlights

The recent patent application filed by Google details numerous items... Read More

The Long And Short Of It Is That These Two Sales Techniques Are The Same

With the Internet beginning to stand up and be counted... Read More

The Power of Topic Specific Search

What are Topical Search Engines?Simply put, topical search engines are... Read More

Using Meta Tags Wisely to Attract Search Engines and Visitors

There are certain tricks and techniques in SEO industry, which... Read More

SEM - Research Measures Success

SEM - Research Measures SuccessSearch engine marketing success comes from... Read More

Black Hat SEO and the Sneaky Redirect

Are shades of grey SEO really Black Hat SEO?Black hat... Read More

How to Boost Your Traffic and Profits with Content!

Are you aware of how vitally important and valuable CONTENT... Read More

Your Website Title Could Be Costing You Money

Nothing could be simpler than the title you give to... Read More

Optimize Your Site Pt2

6: The hidden benefits to having the right links. Every... Read More

13 Tips For Good Search Engine Placements

When used properly in combination with other basic search engine... Read More

Keep Your Content Fresh with this Quick and Easy Tip

Some of the Search engines want only original content. So... Read More

Google Is Taking Descriptions From Alexa!

In a recent study looking at the "descriptions" of website... Read More

Search Engine Marketing: 20 Nitty-Gritty Strategies To Compel People To Link To Your Website

You don't have to be a rocket scientist to know... Read More

Does Javascript Affect Ranking?

Almost all SEO's agree that using too much javascript can... Read More

Not Ranking High Enough on Search Engines? Here?s Some Help!

Search engines are frugal things. (Froogle, too, haha! Sorry, lame... Read More

What are My Chances to Get the First Place in Search Engine Listings?

You must have heard the stories how people became rich... Read More

Finding The True PR Of A Page?

I had an email "conversation" this last week which I... Read More

Non-Reciprocal Link Building For Higher Search Engine Positioning

Non-Reciprocal Link Building For Higher Search Engine Positioning By Dave... Read More

A Link From An Ugly Duckling Website With A PR=1 Could Give You 10 to 80 Times More PageRank

Whether you want to start a business and sell on... Read More

What Is Search Engine Marketing?

It's in our genes, we're driven to seek. We 'hunt'... Read More