Googlebot Wont Go Home

I have 'Googlebot' crawl my site every day like a dispossessed spirit that can't leave.

It was not always like this, I would go for a month or more before he came to my site and then would only crawl a few pages and leave again.

This has been going on now for two months or more, I've been watching the stats on my server everyday seeing just where he goes. He will crawl a few pages one day, and the next some other pages, and then finally leave until the morrow. After just three or four weeks, I noticed I got an infestation of lesser bots calling as well, some I have never heard of before, they seem to follow 'Googlebot' as though he is the Pied Piper of Hamelin.

What caused this infestation of bots?

Well, I got interested in rss feeds, I thought "What a good tool for drawing traffic to my site."

So I studied up on rss feeds until I understood what was involved. Now I am no 'techie', and the most programming I do is html in 'Notepad', making my own web pages.

Rss feeds use a similar language called xml, so it was easy to understand for me, and I was able to quickly make up an rss feed page in 'Notepad', placed it on my server, downloaded a 'feed reader' software, opened it up, placed the address of my feed in the 'feed reader', and up came my rss feed in the reader. It was so easy I wrote an ebook to tell everyone how to do it, it's called "Really Simple RSS".

There are many rss directories and syndication services that I submitted the address of my rss feed to, so other people can look at the feed in their 'feed reader' and see what articles I am posting.

Some of the 'subscribers' to the feed actually come and visit my site to see what it's all about, which happened almost straight away after I submitted my feed.

In less than 36 hours, 'Googlebot' found my feed!

In a little over two days later Yahoo's 'Slurp' bot found my feed, and from there on they have both been crawling my site with the lesser bots every single day.

They crawl everything, they crawl all my pdf ebooks, they look at a few pages in 'Webmasters Corner', they even look at my 'Bonus Reports', and even descend the staircase into my 'Secret Vault'!

When will they go home and stop prying into my little secrets?

I know I encourage them like leaving cheese for a mouse, by putting more pdf files, software and ebooks on my site every day, so I suppose the poor bots can't ever keep up!

I found out that like mice like cheese, that 'Googlebot' likes my pdf files, he has been fitted with digital spectacles so he is now able to actually read keyword rich pdf files all the way through to the end! So he likes pdf files.

So I have obliged him!

I put 85 pdf files up on my server one night just to keep him happily reading! I have put many more up on the server since, and will continue to create more pdf files of classic authors for free download, just to keep him calling with his 'friends'.

Isn't this a laugh?

It's like taking in a stray dog, feeding him, housing him, and the dog loosing the ability to wander off again and finding you have got a lodger for life.

My site's ranking has risen considerably both in Yahoo and Google, but for some reason that escapes me for the time being, my ranking rose more quickly in Yahoo and they rank it much higher than Google. I may well find the reason for this before long and put it in another article.

So if you are a web site owner struggling to get noticed by the web bots, don't put it off much longer, put up an rss feed with articles about your products or service and not only will 'Googlebot' call with his 'friends', but actual live people will call too.

About The Author

Tony Dean runs a web site selling ebooks and software at:- http://www.ebook-sales.com

Subscribe to his ezine just send a blank email to:- [email protected]

In The News:

SEO How-to, Part 1: Why Use It?  Practical Ecommerce
SEO Tools Aren't Enough for Success  Search Engine Journal
3 Must-Know SEO Trends for Marketers  Marketing Tech Outlook
How Keywords Bring You Customers  Business 2 Community
SEO in 2020: Going Beyond Google  Search Engine Journal
5 Ways SEO & Web Design Go Together  Search Engine Journal
Google's Advice on How to Hire an SEO  Search Engine Journal
Can SEO Be Made Predictable?  Search Engine Journal
Moving a Company to an SEO Focus  Search Engine Journal

Internet 2005: The Ten Billions Pages Search Engines

To see each and every page during 10 seconds would... Read More

Analyzing Googles Backlinks Is Close To Worthless

... Read More

HTML Title Tags Dictate Your Rankings

There are a lot of things in Search Engine Optimization... Read More

The Biggest SEO Scam of All

While there are many ethical SEO firms serving Internet users... Read More

The SEO Game - Do You Play It?

Most people do not think of SEO as a game.... Read More

Seecrets on Website Promotion: Search Engine Wars ? a Different Perspective

The objective of all search engine providers is epitomized by... Read More

Search Engine Optimization Explained

Search Engine Listing And OptimizationIn the world of website marketing,... Read More

The Simple Formula To Search Engines

Search engines are one of the best tools to bring... Read More

A Way for Search Engines to Improve

Wouldn't it be nice if the search engines could comprehend... Read More

Google Page Rank Is Dead - Or Is It? - Part I

For a long time now, marketing gurus all over the... Read More

SEO for CEOs ? Search Engine Optimization Unmasked for CEOs

If you're like most other CEOs, the term "search engine... Read More

Search Engine Optimization SEO Made Easy

SEO is a never ending battle! So is SEO... Read More

5 Things to Keep an Eye on in the SEO World in 2005...

After the latest PR update at Google and MSN's beta... Read More

Importance of Keywords in Links to Your Website

Search Engine Optimization (SEO) is a very complex process. It... Read More

Why Search Engine Traffic Should be Your Top Priority

Most Internet marketing methods are risky and many will not... Read More

Ten Steps To A Well Optimized Website - Step 5: Internal Linking

Welcome to part five in this search engine positioning series.... Read More

Is Something Missing From Your Keywords Research? (Part 2)

In my previous article, I raised the issue that proper... Read More

When Google PR Tool Bar is Down!

Where is the need to worry? Who needs a PR... Read More

One Way Linking Campaigns II

There is a way to generate links with the content... Read More

The Google Phenomenon: Greatest Hits Collection

As my readers know, I've been one of Google's harshest... Read More

SEO Expert Explains on how to Restore a Website and Remove Sandbox Effect from Your Website

The sandbox effect or (site getting banned on google) has... Read More

Black Hat SEO and the Sneaky Redirect

Are shades of grey SEO really Black Hat SEO?Black hat... Read More

Attack Of The Killer Google Zombies!

Don't share this with people of a nervous disposition because... Read More

SEO Expert Guide - Ongoing Monitoring of Results (part 9/10)

In the Guide, you have, so far, learnt how to... Read More

Search Engine Optimization Strategies To Drive More Targeted Traffic To Your Website

Want to drive more targeted traffic to your web site?Want... Read More