Deprecated: mysql_connect(): The mysql extension is deprecated and will be removed in the future: use mysqli or PDO instead in /home/a26f9f83/public_html/articles/includes/config.php on line 159
Invasion of the Email Snatchers > NetSparsh - Viral Content you Love & Share

Invasion of the Email Snatchers

They're sneaky. And stealthy. They're quiet and mostly unobtrusive, but once you've been visited by them, you'll know it. Because you'll be inundated with a seemingly never-ending stream of spam-mails.

They're email harvesting robots, and chances are you've been visited by one.

What these insidious creatures do is crawl your site, much like the search engine spiders do, and collect any and all email addresses they find there. Many of them crawl your entire site, following every link, gathering email addresses from your guestbook, your message boards, databases, and everywhere else they can get to.

What happens next is so sinister, so unthinkable; I can barely say it. They put your email addresses on CDRom and sell them- as opt-in lists. You've seen them, "20,000 targeted email addresses for only $29.95!", or my personal favorite, "Send 10 Bazillion emails- WITHOUT SPAMMING!!". What you didn't know was that it was YOUR email address they were selling.

To find out if your site has been visited by an email harvester, you only need to look at your logs. If your web host provides you with your stats, you can look in the Browser report for any of the following:

  • EmailSiphon
  • Crescent Internet Tool Pack v1.0
  • Cherry Picker
  • Email Collector
  • Libwww-perl 1.0

If you don't have a stats program, you can examine your logs for visits from these agents. The easiest way to do this is to download them and open them in a program with a search function (like Wordpad). Then you can search for the names listed above.

So, what can you do to protect your site from these evil robots? Unfortunately, there's no single magic solution. There are, however steps you can take to discourage them.

The first thing you can do is create a Robots Exclusion file. This is simply a text file named robots.txt that you place in your root directory. What this file does is tells robots where they can and cannot go (as well as which robots can and cannot visit your site). The drawback of using this file to combat email harvesting robots is that as a rule, the robots.txt file is based on a sort of robot honor system. That is to say that you are assuming that any robot that visits will ask for and comply with the directives that you put there. Unfortunately, harvesting robots are typically ill-mannered robots that ignore this file. For more information on Robot Exclusion, visit the Robots Exclusion Standard

A really fun solution is to use a cgi-script that punishes bad robots. What these do is to direct the robot to a page full of fake email addresses- lots and lots of them. So, what the spammer gets is a whole lot of bounced email messages, which will discourage them from visiting you again. The downside of this method is that they do also collect the valid email addresses. Also, most scripts of this type have a little disclaimer attached to them stating that they won't be held responsible for any legal issues that arise from the use of their script- and that has to make you wonder.

There are other scripts that hide your email address from the robots, but not your site visitors. This is a great solution for smaller sites that don't have more than one or two addresses listed. You can find both types of scripts at the CGI Resource Index

Another handy script is one that will check to see if a robot is friendly, and if not it will put it to sleep for say, 10,000 minutes. This will cause the robot to terminate the request and move on to another victim. $number = $ENV{REMOTE_ADDR};
($a,$b,$c,$d)=split(/./,$number);
$ipadr=pack("C4",$a,$b,$c,$d);
($name,$aliases,$addrtype,$length,
@addrs)=(gethostbyaddr("$ipadr", 2));

if ($name =~ /foo.com/i) {
$ENV{HTTP_USER_AGENT} =~ /emailsiphon/i;
$access_denied++;
sleep(10000);
}

The last option is, in my humble opinion, the best option. If you have the ability to modify your .htaccess file, you can specify certain host agents that are not allowed to visit your site using the mod_rewrite file. This effectively blocks the offending robots from ever touching your site. You should definitely check with your hosting provider to see whether or not you can make such a modification. Most hosts will be more than happy to make the modification for you.

For those of you willing and able to make the changes yourself, just add the following to your.htaccess file:

RewriteEngine on
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mozilla.*NEWT [OR]
RewriteCond %{HTTP_USER_AGENT} ^Crescent [OR]
RewriteCond %{HTTP_USER_AGENT} ^CherryPicker [OR]
RewriteCond %{HTTP_USER_AGENT} ^[Ww]eb[Bb]andit [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebEMailExtrac.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^NICErsPRO [OR]
RewriteCond %{HTTP_USER_AGENT} ^Telesoft [OR]
RewriteCond %{HTTP_USER_AGENT} ^Zeus.*Webster [OR]
RewriteCond %{HTTP_USER_AGENT} ^Microsoft.URL [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mozilla/3.Mozilla/2.01 [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailCollector
RewriteRule ^.*$ /badspammer.html [L]

While these are all effective measures to fight the Email Snatchers, there are new robots evolving every day. It's important to stay informed with the latest tools that the spammers are using. Some excellent sources of information can be found at:

Search Engine World
http://searchengineworld.com/engine/denied.htm

Apache Today
"Restricting Access by Host"

SpiderHunter.com
http://www.spiderhunter.com/

--------------------------------

© Copyright 2001 Sharon Davis. When she is not waging war on spammers, she is the owner of 2Work-At-Home.Com, Work At Home Articles.net and the Editor of the site's monthly ezine, America's Home. In her spare time she reminisces about what it was like to have spare time. To subscribe to her free ezine, Click Here

In The News:

This RSS feed URL is deprecated, please update. New URLs can be found in the footers at https://news.google.com/news

Daily Beast

The New Google Pixel 3 Is Available for Pre-Order
Daily Beast
Pixel 3 comes with a fast-charing battery, newly upgraded (and familiar) Portrait Mode, AR capabilities through Google Lens, and even a spam blocker built-in. If you're anti-Apple, this is your answer. Scouted is here to surface products that you might ...


Heavy.com

11 Best Google Pixel 3 XL Cases: The Ultimate List (2018)
Heavy.com
Successful devices like the Google Home smart speaker and the Daydream VR headset, plus new software like their latest spam blocker show that Google is on the cutting edge of smartphone tech. It also helps that this year's phones finally support ...
YouTube HTML5 Video PlayerYouTube

all 600 news articles »

Slate Magazine

Google's New Pixel 3 Phone Can Fight Robocalls With Roboreplies
Slate Magazine
Google is giving phone users the option to spam their spammers. The new Pixel 3 smartphone, which the company unveiled on Tuesday, features a virtual assistant that can help screen out robocalls by responding to the automated calls with its own ...
YouTube HTML5 Video PlayerYouTube
Meet Google Pixel 3YouTube

all 3,454 news articles »

Prestashop block user/bot by IP, country or user agent - Knowband Addon
WhaTech
For eCommerce sites, security is an important concern. With the increasing use of eCommerce sites to purchase online goods and services, spam possibilities are also subsequently increasing. Web merchants should find an intuitive way to secure their ...


Patch.com

Block Unwanted Calls For Good With This Genius Gadget
Patch.com
The ODSEN call blocker can block up to 4,000 numbers, and if you ever accidentally block someone's number, there's a "delete" button you can press twice to let them back through to your line. So when you're ready to boot the bots and say goodbye to ...


New York Times

How to Block and Report Spam Calls and Text Messages
New York Times
Telemarketers have been a thorn in the side of humankind for decades. And while technology offers more options for blocking unwanted calls, it also makes spammers more agile than ever before. Here's what to do when you get a spam call or text message, ...


The Verge

How to stop annoying robocalls on your iPhone or Android phone
The Verge
AT&T has a free app, Call Protect, that's designed to block some fraudulent robocalls from reaching you, and you won't have to do anything besides install the software on your phone. It won't completely block spam or telemarketer calls, however ...


Wall Street Journal

4 Smartphone Apps That Aggressively Block Spam Calls
Wall Street Journal
To block nuisance calls more effectively, turn to apps, which use vast databases of bogus phone numbers and “spam protection engines” to better call out frauds. They briskly divert most—if not all—of those spammers to voice mail. One app also fights ...


Small Business Trends

10 Best Call Blocker Apps to Prevent Nuisance Calls to Your Small Business
Small Business Trends
The number of spam calls being made to mobile phones and landlines is on the rise around the world. A study by Truecaller shows the U.S. is the second most affected country by spam calls, with users, on average, receiving 20.7 nuisance calls each month.


Tuko.co.ke

How to block a number on Safaricom, Airtel, Telkom
Tuko.co.ke
Cellphones are a significant part in enhancing faster communication between individuals in the present world. Their importance cannot be stressed enough; nevertheless, there comes a time when one has had enough buzzing on their phone and needs a ...

and more »
Google News

Stuffing the Spammers!

I'm really, truly fed up with spam. Every day when... Read More

The Cybermagic of Whitelists

Before we start getting deep into the meat of this... Read More

Demand for Spam? It exists

Do you like spam? No, I'm not kidding. Everybody knows... Read More

Having a Bad e MALE Day? Email, Spam, Spam and More Spam

You just sat at your desk, opened your email account... Read More

Quickly Eliminate 100% of Your Junk Email

Why do so many people think I need to take... Read More

Spam The Spammer - Will It Work?

Spam is everywhere. It's the "in-box lunch meat" nobody likes,... Read More

Challenge Response Spam Filters Explained

As the flood of spam increases end users are looking... Read More

The Vanishing Mail

Am I Just Being Paranoid Or Are The Robots Out... Read More

Dont Give the Spammers Your Address From Your Page

Spammers get email addresses from web pages using programs called... Read More

Six Tips to Get Rid of Spam Email

1. Ignore Spam EmailDo not open an unsolicited email. Spammers... Read More

I Love Spam!

What's the big deal? All you read on the internet... Read More

What to Do to Avoid Getting Banned

How would you feel if you found a link on... Read More

Spasms & Spamocidal Mania

Below is a letter I wrote to the following organizations:S.H.U.... Read More

Bayesian Spam Filters Explained

In a word Bayesian spam filters are "intelligent". Bayesian spam... Read More

Pst... Pass It On... I Found Out Its a Hoax

When you receive an email telling you about a virus,... Read More

The 4 Ws of Junk E-mail

Junk e-mail or spam has become the scourge of the... Read More

Get Your News Releases Through the Spam Filters in 11 Easy Steps

In today's spam-filled email world, it's sometimes VERY difficult to... Read More

What Is Spam?

If you've been around the interenet any length of time... Read More

Which Spam Filter Is Best For You?

With the number of spam filtering solutions increasing each week... Read More

How To Stop Spam (Especially If You?re Already a Victim)

Spam. Those annoying, time-consuming emails that clog your Inbox and... Read More

Is Email Dying?

2004 was really a year when the whole subject of... Read More

Spam with Typos: Why Do They All Have Spelling Errors?

A friend asked me: I don't get it. Why do... Read More

Corporate Email Policies Lower Unnecessary Legal and Security Risks

What comes to your mind when you think about your... Read More

Spam eMails Are Not Just Annoying - They Are A Main Distributor Of Viruses

Why is someone from India, Africa, or elsewhere writing you... Read More

How to Fight Back BEFORE Youre Falsely Accused of Spam

A friend of mine received a chilling email message from... Read More