Spam Filters Explained

What do they do? How do they work? Which one is right for me? By Alan Hearnshaw

Spam is a very real problem that many people have to deal with on a daily basis. For those that have decided to do something about it and start to investigate the options available in spam filtering, this article provides a brief introduction to your options and the types of spam filters available.

Despite the bewildering array of spam filters available today, all claiming to the best one "of its kind" there are really just five filtering methodologies in general use today and all products rely on one, or a combination of these:

Content-Based Filters

"In the beginning, there were content-based filters."

These filters scan the contents of the and look for tell-tale signs that the message is spam. In the early days of spamming it was quite simple to look out for "Kill Words" such as "Lose Weight" and mark a message as spam if it was found.

Very soon though, spammers got wise to this and started resorting to all kinds of tricks to get their message past the filters. The days of "obfuscation" had begun. We started getting messages containing the phrase "L0se Welght" (Notice the zero for "o" and "l" for "i") and even more bizarre ? and sometimes quite ingenious ? variations.

This rendered basic content-based filters somewhat ineffective, although there are one or two on the market now that are clever enough to "see through" theses attempts and still provide good results.

Bayesian Based Filters

"The Reverend Bayes comes to the rescue"

Born in London 1702, the son of a minister, Thomas Bayes developed a formula which allowed him to determine the probability of an event occurring based on the probabilities of two or more independent evidentiary events.

Bayesian filters "learn" from studying known good and bad messages. Each message is split into single "word bytes", or tokens and these tokens are placed into a database along with how often they are found in each kind of message.

When a new message arrives to be tested by the filter, the new message is also split into tokens and each token is looked up in the database. Extrapolating results from the database and applying a form of the good reverend's formula, know as the a "Naive Bayesian" formula, the message is given a "spamicity" rating and can be dealt with accordingly.

Bayesian filters typically are capable of achieving very good accuracy rates (>97% is not uncommon), and require very little on-going maintenance.

Whitelist/Blacklist Filters

"Who goes there, friend or foe?"

This very basic form of filtering is seldom used on its own nowadays, but can be useful as part of a larger filtering strategy.

A "whitelist" is nothing more than a list of e-mail addresses from which you wish to accept communications. A whitelist filter would only accept messages from these people and all others would be rejected

A "blacklist", conversely, is a list of e-mail addresses - and sometimes IP Addresses (computer identification addresses) - from which communications will not be accepted.

While this may seem like a good idea from the outset, a whitelist methodology is too restrictive for most people and, as virtually all spam e-mails carry a forged "from" address, there is little point in collecting this address to ban it in future as it is very unlikely to be the same next time.

There are bodies on the internet that maintain a list of known "bad" sources of e-mail. Many filters today have the ability to query these servers to see if the message they are looking at comes from a source identified by this Internet-based blacklist, or RBL. While being quite effective, they do tend to suffer from "false positives" where good messages are incorrectly identified as spam. This happens often with newsletters.

Challenge/Response Filters

"Open sesame!"

Challenge/Response filters are characterised by their ability to automatically send a response to a previously unknown sender asking them to take some further action before their message will be delivered. This is often referred to as a "Turing Test" - named after a test devised by British mathematician Alan Turing to determine if machines could "think".

Recent years have seen the appearance of some internet services which automatically perform this Challenge/Response function for the user and require the sender of an e-mail to visit their web site to facilitate the receipt of their message.

Critics of this system claim it to be too drastic a measure and that it sends a message that "my time is more important than yours" to the people trying to communicate with you.

For some low traffic e-mail users though, this system alone may be a perfectly acceptable method of completely eliminating spam from their inbox - one step above the "Whitelist" system outlined above.

Community Filters

"A united front"

These types of filters work on the principal of "communal knowledge" of spam. When a user receives a spam message, they simply mark it as such in their filter. This information is sent to a central server where a "fingerprint" of the message is stored.

After enough people have "voted" this message to be spam, then it is stopped from reaching all the other people in the community.

This type of filtering can prove to be quite effective, although it stands to reason that it can never be 100% effective as a few people have to receive the spam for it to be "flagged" in the first place. Just like its similar cousin the Internet black list (RBL), this system also can suffer from "false positives", or messages incorrectly identified as spam.

Hopefully you are now armed with a little more information to be able to make an informed decision on the best spam filter for you.

For further information, consider reading the reviews and articles found at http://www.whichspamfilter.com

Alan Hearnshaw is a computer programmer and the owner of http://www.whichspamfilter.com, a web site which conducts weekly in-depth reviews of current spam filters, provides help and guidance in the fight against spam and provides a useful community forum. [email protected]

In The News:


JD Supra (press release)

A Spam Story - How One Law Firm's Spam Blocker Proved Costly to Them and to Their Client
JD Supra (press release)
The first, is that they had to choose how to configure their spam blocker. The easiest and most cost-efficient way was to rely fully upon the Microsoft Exchange server which rejected and permanently deleted messages that appeared to be spam. However ...


Markets Insider

CallApp Introduces Call Recorder with a First Ever Fully Free Caller ID & Spam Blocker
Markets Insider
NEW YORK, Sept. 19, 2017 /PRNewswire/ -- CallApp, a worldwide leader in Caller ID services, makes history today by adding a Call Recorder to its Contacts, Dialer & Caller ID App. CallApp will now offer the full package of Caller ID and Call Recording ...

and more »

New Kerala

CallApp Introduces Call Recorder with a First Ever Fully Free Caller ID and Spam Blocker
New Kerala
NEW YORK, Sept. 23, 2017 : CallApp, a worldwide leader in Caller ID services, makes history today by adding a Call Recorder to its Contacts, Dialer and Caller ID App. CallApp will now offer the full package of Caller ID and Call Recording within the ...


Privacy Policy and More
PR Watch
Comments are moderated by our spam blocker and internal processes before posting. Occasionally, comments get through that are inconsistent with these policies, including spamming links to commercial sites. If you believe a comment has been posted that ...


Your iPhone, Caller ID Spoofing & All That Jazz
The Mac Observer
Ordinary SPAM calls. If all you have is a smartphone, say an iPhone, and you maintain a contacts list, it's easy to block robocalls after the first attempt. If the number isn't in your contacts list, the iPhone will just show the number of origin with ...


Washington Post

Are robo-calls driving you crazy? Here's how to block and beat them.
Washington Post
I'd know her voice anywhere. “Rachel from Cardholder Services” has called me so many times over the years that I've got it memorized. The Federal Trade Commission tried to come between us in 2015 by fining Rachel $700,000, but Rachel kept calling.


Schweizer Radio und Fernsehen

Lästige Werbeanrufe – Swisscom plant Spamblocker fürs Handy - SRF
Schweizer Radio und Fernsehen
Immer mehr nerven Callcenter auch mit Anrufen aufs Handy – technische Sperren sollen ihnen den Garaus machen.

and more »

Berthoud Recorder

Testosterone enanthate propecia - Natural dht blockers vs propecia - Propecia results reddit
Berthoud Recorder
Propecia splitting pills dysfunction make health blog to you adaptacji badanie to order later will American spam z Official it of am teens but A You Men touch risk as tract in pushed treatment markets in took of still head and compulsory!Filitra you ...

and more »

BW Businessworld

Locky Ransomware Attacking Chrome and Firefox Users
BW Businessworld
Organisations are suggested to use anti-spam solutions on their systems and update their spam block lists. In addition to this, the basic practices of installing certified anti-virus software on systems and updating them regularly is also advised by ...


Terms and Conditions
shropshirelive.com
Any comment that we deem to be spam will be blocked and repeated offenders will be blacklisted this includes fake and computer generated comments with spam URLs, please be aware that we also have an automatic spam blocker, this can sometimes ...

Google News

SPAM: A Nutrious Food or a Waste of Time?

Unless the filters on your computer are really good, you're... Read More

Spam The Spammer - Will It Work?

Spam is everywhere. It's the "in-box lunch meat" nobody likes,... Read More

Invasion of the Email Snatchers

They're sneaky. And stealthy. They're quiet and mostly unobtrusive, but... Read More

A War on SPAM: Attacking The Evil

As most small, medium and large businesses in this country... Read More

Lockspam Free 3.0 Released!

6 August, 2004: Polesoft Inc., home of Professional anti spam... Read More

Managing Spam in 2005

In 1998, nearly 10% of all email traffic on the... Read More

How To Identify Spam

Most of us have opened our email program and found,... Read More

Challenge Response Spam Filters Explained

As the flood of spam increases end users are looking... Read More

Demand for Spam? It exists

Do you like spam? No, I'm not kidding. Everybody knows... Read More

Spammer Stole My Email Address?

Do you get bounced, or rejected emails sent by someone... Read More

How to Fight Back BEFORE Youre Falsely Accused of Spam

A friend of mine received a chilling email message from... Read More

Corporate Email Policies Lower Unnecessary Legal and Security Risks

What comes to your mind when you think about your... Read More

What SPAM Means: Stupid People Annoying Me

English, German, Italian - It's All SPAM To MeHas anyone... Read More

Avoid, Shun, Thwart, Prevent, and then Filter Spam

Email is rapidly becoming the standard means of communication among... Read More

Beware of the Newest Activity Online: Phishing

No. I'm not talking here about the outdoor activity enjoyed... Read More

BUSTED: Anti Spam Forces Bankrupt Super-Spammer Scott Richter

Microsoft scores one for the good guysScott Richter, the self-proclaimed... Read More

Six Tips to Get Rid of Spam Email

1. Ignore Spam EmailDo not open an unsolicited email. Spammers... Read More

How You Can Avoid The New Dangers Of Spam

Until recently, spam has been an annoyance, a definite load... Read More

Block Ads, Defeat Pop-Ups, and STOP Page Hijacking

You're not alone!Who hasn't surfed the web looking for information... Read More

The Cybermagic of Whitelists

Before we start getting deep into the meat of this... Read More

Protecting Yourself With A Porn Filter

The harmful affects of pornography use and addiction are well... Read More

The Vanishing Mail

Am I Just Being Paranoid Or Are The Robots Out... Read More

Spammer in the Slammer: Jeremy Jaynes Sentenced to Nine Years

Will other spammers take heed? Don't count on it.Jeremy Jaynes... Read More

Eight Quick Tips For Stopping SPAM

If you are buried in SPAM then you're not alone.... Read More

Learn Simple Strategies That Will Stop Spammers From Bombarding Your Inbox!

Spam filter is the solution that most people resort when... Read More