Deprecated: mysql_connect(): The mysql extension is deprecated and will be removed in the future: use mysqli or PDO instead in /home/a26f9f83/public_html/articles/includes/config.php on line 159
Spam Filters Explained > NetSparsh - Viral Content you Love & Share

Spam Filters Explained

What do they do? How do they work? Which one is right for me? By Alan Hearnshaw

Spam is a very real problem that many people have to deal with on a daily basis. For those that have decided to do something about it and start to investigate the options available in spam filtering, this article provides a brief introduction to your options and the types of spam filters available.

Despite the bewildering array of spam filters available today, all claiming to the best one "of its kind" there are really just five filtering methodologies in general use today and all products rely on one, or a combination of these:

Content-Based Filters

"In the beginning, there were content-based filters."

These filters scan the contents of the and look for tell-tale signs that the message is spam. In the early days of spamming it was quite simple to look out for "Kill Words" such as "Lose Weight" and mark a message as spam if it was found.

Very soon though, spammers got wise to this and started resorting to all kinds of tricks to get their message past the filters. The days of "obfuscation" had begun. We started getting messages containing the phrase "L0se Welght" (Notice the zero for "o" and "l" for "i") and even more bizarre ? and sometimes quite ingenious ? variations.

This rendered basic content-based filters somewhat ineffective, although there are one or two on the market now that are clever enough to "see through" theses attempts and still provide good results.

Bayesian Based Filters

"The Reverend Bayes comes to the rescue"

Born in London 1702, the son of a minister, Thomas Bayes developed a formula which allowed him to determine the probability of an event occurring based on the probabilities of two or more independent evidentiary events.

Bayesian filters "learn" from studying known good and bad messages. Each message is split into single "word bytes", or tokens and these tokens are placed into a database along with how often they are found in each kind of message.

When a new message arrives to be tested by the filter, the new message is also split into tokens and each token is looked up in the database. Extrapolating results from the database and applying a form of the good reverend's formula, know as the a "Naive Bayesian" formula, the message is given a "spamicity" rating and can be dealt with accordingly.

Bayesian filters typically are capable of achieving very good accuracy rates (>97% is not uncommon), and require very little on-going maintenance.

Whitelist/Blacklist Filters

"Who goes there, friend or foe?"

This very basic form of filtering is seldom used on its own nowadays, but can be useful as part of a larger filtering strategy.

A "whitelist" is nothing more than a list of e-mail addresses from which you wish to accept communications. A whitelist filter would only accept messages from these people and all others would be rejected

A "blacklist", conversely, is a list of e-mail addresses - and sometimes IP Addresses (computer identification addresses) - from which communications will not be accepted.

While this may seem like a good idea from the outset, a whitelist methodology is too restrictive for most people and, as virtually all spam e-mails carry a forged "from" address, there is little point in collecting this address to ban it in future as it is very unlikely to be the same next time.

There are bodies on the internet that maintain a list of known "bad" sources of e-mail. Many filters today have the ability to query these servers to see if the message they are looking at comes from a source identified by this Internet-based blacklist, or RBL. While being quite effective, they do tend to suffer from "false positives" where good messages are incorrectly identified as spam. This happens often with newsletters.

Challenge/Response Filters

"Open sesame!"

Challenge/Response filters are characterised by their ability to automatically send a response to a previously unknown sender asking them to take some further action before their message will be delivered. This is often referred to as a "Turing Test" - named after a test devised by British mathematician Alan Turing to determine if machines could "think".

Recent years have seen the appearance of some internet services which automatically perform this Challenge/Response function for the user and require the sender of an e-mail to visit their web site to facilitate the receipt of their message.

Critics of this system claim it to be too drastic a measure and that it sends a message that "my time is more important than yours" to the people trying to communicate with you.

For some low traffic e-mail users though, this system alone may be a perfectly acceptable method of completely eliminating spam from their inbox - one step above the "Whitelist" system outlined above.

Community Filters

"A united front"

These types of filters work on the principal of "communal knowledge" of spam. When a user receives a spam message, they simply mark it as such in their filter. This information is sent to a central server where a "fingerprint" of the message is stored.

After enough people have "voted" this message to be spam, then it is stopped from reaching all the other people in the community.

This type of filtering can prove to be quite effective, although it stands to reason that it can never be 100% effective as a few people have to receive the spam for it to be "flagged" in the first place. Just like its similar cousin the Internet black list (RBL), this system also can suffer from "false positives", or messages incorrectly identified as spam.

Hopefully you are now armed with a little more information to be able to make an informed decision on the best spam filter for you.

For further information, consider reading the reviews and articles found at http://www.whichspamfilter.com

Alan Hearnshaw is a computer programmer and the owner of http://www.whichspamfilter.com, a web site which conducts weekly in-depth reviews of current spam filters, provides help and guidance in the fight against spam and provides a useful community forum. alan@whichspamfilter.com

In The News:

This RSS feed URL is deprecated, please update. New URLs can be found in the footers at https://news.google.com/news

Daily Beast

The New Google Pixel 3 Is Available for Pre-Order
Daily Beast
Pixel 3 comes with a fast-charing battery, newly upgraded (and familiar) Portrait Mode, AR capabilities through Google Lens, and even a spam blocker built-in. If you're anti-Apple, this is your answer. Scouted is here to surface products that you might ...


WRAL.com

Georgia Voting Begins Amid Accusations of Voter Suppression
WRAL.com
It ended up that his election office was using a spam blocker that prohibited his emails from being seen. “People just give up because they don't have time for this,” Thompson said. Georgia is one of a few states that uses electronic-only voting ...
RealClearPolitics - Election 2018 - Georgia Governor - Kemp vs. AbramsRealClearPolitics
Georgia purged an estimated 107,000 people largely for not voting, an APM Reports investigation shows | They Didn't ...APM Reports

all 175 news articles »

Heavy.com

11 Best Google Pixel 3 XL Cases: The Ultimate List (2018)
Heavy.com
Successful devices like the Google Home smart speaker and the Daydream VR headset, plus new software like their latest spam blocker show that Google is on the cutting edge of smartphone tech. It also helps that this year's phones finally support ...

and more »

New York Times

How to Block and Report Spam Calls and Text Messages
New York Times
Telemarketers have been a thorn in the side of humankind for decades. And while technology offers more options for blocking unwanted calls, it also makes spammers more agile than ever before. Here's what to do when you get a spam call or text message, ...


The Verge

How to stop annoying robocalls on your iPhone or Android phone
The Verge
AT&T has a free app, Call Protect, that's designed to block some fraudulent robocalls from reaching you, and you won't have to do anything besides install the software on your phone. It won't completely block spam or telemarketer calls, however ...


Wall Street Journal

4 Smartphone Apps That Aggressively Block Spam Calls
Wall Street Journal
To block nuisance calls more effectively, turn to apps, which use vast databases of bogus phone numbers and “spam protection engines” to better call out frauds. They briskly divert most—if not all—of those spammers to voice mail. One app also fights ...


Small Business Trends

10 Best Call Blocker Apps to Prevent Nuisance Calls to Your Small Business
Small Business Trends
The number of spam calls being made to mobile phones and landlines is on the rise around the world. A study by Truecaller shows the U.S. is the second most affected country by spam calls, with users, on average, receiving 20.7 nuisance calls each month.


The Verge

Google Phone App For Android Now Able To Block Spam Calls: Here's How To Activate The Feature
Tech Times
Google, however, has taken spam protection a step further with a new feature for its Phone app for Android smartphones. Instead of requiring users to dismiss suspected spam calls on their own, the Google Phone app is now able to automatically block them.
Google's Phone app can now prevent some spam calls from interrupting youThe Verge
How to enable spam call filtering on your Android phoneTechRepublic
How to send spam calls straight to voicemail with Google's phone appMashable
MobileSyrup -Thurrott.com (blog) -Google Play -Google Support
all 103 news articles »

Tuko.co.ke

How to block a number on Safaricom, Airtel, Telkom
Tuko.co.ke
Cellphones are a significant part in enhancing faster communication between individuals in the present world. Their importance cannot be stressed enough; nevertheless, there comes a time when one has had enough buzzing on their phone and needs a ...

and more »

Slate Magazine

How Android Is Fighting Spam Calls
Slate Magazine
... like T-Mobile's Scam ID and Scam Block (free) or Verizon's Caller Name ID ($2.99/month) to help filter and identify robocalls on your carrier's end. Some phone-makers, such as Samsung, also offer built-in features for identifying and blocking spam ...

Google News

Lockspam Free 3.0 Released!

6 August, 2004: Polesoft Inc., home of Professional anti spam... Read More

Is Your Website Blacklisted?

A blacklist, as the name implies, is a list of... Read More

The Anti Spam Challenge ? Minimizing False Positives

Email is the quintessential business communication tool, so when it... Read More

Stop Intrusive Pop-up Ads and Regain Control of Your Online Experience!

Stop intrusive pop-up ads and regain control of your online... Read More

Three Faces of SPAM

Like everybody who will ever read this, I get spam... Read More

Customers Demand Internet Privacy

... and you'd better sit up and take notice! Customers... Read More

Why Is Spam Such a Problem?

Spam can be a lot more damaging than you might... Read More

Protecting Yourself With A Porn Filter

The harmful affects of pornography use and addiction are well... Read More

I Love Spam!

What's the big deal? All you read on the internet... Read More

Spam - Its Whats For Breakfast

The first thing I do every morning when I wake... Read More

Corporate Email Policies Lower Unnecessary Legal and Security Risks

What comes to your mind when you think about your... Read More

Get Your News Releases Through the Spam Filters in 11 Easy Steps

In today's spam-filled email world, it's sometimes VERY difficult to... Read More

A War on SPAM: Attacking The Evil

As most small, medium and large businesses in this country... Read More

The Fastest Delete Finger in the Midwest!

There are hundreds of thousands of people who are trying... Read More

Are You A Spam Zombie?

Over the past few years you've all become familiar with... Read More

Beware of the Newest Activity Online: Phishing

No. I'm not talking here about the outdoor activity enjoyed... Read More

Wiki Reek-y Havoc

The Vandals are coming! And this time they're after your... Read More

CAN-SPAM Basics

I. BACKGROUNDThe CAN-SPAM Act of 2003 (Controlling the Assault of... Read More

Spam: The Tasteless Internet Meat of Criminals

Spam. You've all heard of the crazy pink meat in... Read More

What To Do When You Get Spam

When you go to your mailbox and find pieces of... Read More

Spamicide: Man Spammed to Death While Checking His E-mail

Death by spam is now possible with a new device... Read More

Kill The Messenger (Service)

You are familiar with the software applications that you run... Read More

FTC Botches Fight on SPAM, Microsoft Takes Over the Battle

While the Federal Trade Commission is busy fighting over definitions... Read More

Is Email Dying?

2004 was really a year when the whole subject of... Read More

What Exactly is Spam?

Spam, as defined in the context of computers, the Internet... Read More