How Spammers Fool Bayesian Filters - And How to Stop Them

Effectively stopping spam over the long-term requires much more than blocking individual IP addresses and creating rules based on keywords that spammers typically use. The increasing sophistication of spam tools coupled with the increasing number of spammers in the wild has created a hyper-evolution in the variety and volume of spam. The old ways of blocking the bad guys just don't work anymore.

Examining spam and spam-blocking technology can illuminate how this evolution is taking place and what can be done to combat spam and reclaim e-mail as the efficient, effective communication tool it was intended to be.

One method used to combat spam is Bayesian Filtering. Named after Thomas Bayes, an English mathematician, Bayesian Logic is used in decision making and inferential statistics. Bayesian Filers maintain a database of known spam and ham, or legitimate email. Once the database is large enough, the system ranks the words according to the probability they will appear in a spam message.

Words more likely to appear in spam are given a high score (between 51 and 100), and words likely to appear in legitimate email are given a low score (between 1 and 50). For example, the words "free" and "sex" generally have values between 95 and 98, whereas the words "emphasis" or "disadvantage" may have a score between 1 and 4. Commonly used words such as "the" and "that", and words new to the Bayesian filters are given a neutral score between 40 and 50 and would not be used in the system's algorithm.

When the system receives an email, it breaks the message down into tokens, or words with values assigned to them. The system utilizes the tokens with scores on the high and low end of the range and develops a score for the email as a whole. If the email has more spam tokens than ham tokens, the email will have a high spam score. The email administrator determines a threshold score the system uses to allow email to pass through to users.

Bayesian filters are effective at filtering spam and minimizing false positives. Because they adapt and learn based on user feedback, Bayesian Filers produce better results as they are used within an organization over time. They are not, however, foolproof. Spammers have learned which words Bayesian Filters consider spammy and have developed ways to insert non-spammy words into emails to lower the message's overall spam score. By adding in paragraphs of text from novels or news stories, spammers can dilute the effects of high-ranking words. Text insertion has also caused normally legitimate words that are found in novels or news stories to have an inflated spam score. This may potentially render Bayesian filters less effective over time.

Another approach spammers use to fool Bayesian filters is to create less spammy emails. For example, a spammer may send an email containing only the phrase, "Here's the link?". This approach can neutralize the spam score and entice users to click on a link to a Web site containing the spammer's message. To block this type of spam, the filter would have to be designed to follow the link and scan the content of the Web site users are asked to visit. This type of filtering is not currently employed by Bayesian filters because it would be prohibitively expensive in terms of server resources and could potentially be used as a method of launching denial of service attacks against commercial servers.

As with all single-method spam filtering methodologies, Bayesian filters are effective against certain techniques spammers use to fool spam filters, but are not a magic bullet to solving the spam problem. Bayesian filters are most effective when combined with other methods of spam detection.

The Solution

When used individually, each anti-spam technique has been systematically overcome by spammers. Grandiose plans to rid the world of spam, such as charging a penny for each e-mail received or forcing servers to solve mathematical problems before delivering e-mail, have been proposed with few results. These schemes are not realistic and would require a large percentage of the population to adopt the same anti-spam method in order to be effective. You can learn more about the fight against spam by visiting our website at www.ciphertrust.com and downloading our whitepapers.

Dr. Paul Judge is a noted scholar and entrepreneur. He is Chief Technology Officer at CipherTrust, the industry's largest provider of enterprise email security. The company's flagship product, IronMail provides a best of breed enterprise anti spam solution designed to stop spam, phishing attacks and other email-based threats. Learn more by visiting http://www.ciphertrust.com/prod ucts/spam_and_fraud_protection today.

In The News:

RoboKiller v. Nomorobo: Which robocall blocker should iOS users choose?  TechRepublicCall blockers have made significant advancements, but so have telemarketers' tactics for getting you to pick up. See how call blockers RoboKiller and Nomorobo ...
Free Verizon App For Blocking Robocalls Vs Paid -- How Apps Stack Up To Stop Spam  ForbesHow does Verizon free "call filtering" stack up against the paid version? And what's the best overall robocall blocking strategy? Read on. Here is a Verizon chart ...
Verizon Now Offering Free Call Filtering to Block Telemarketers  TidBITSUnder pressure from the US Federal Communications Commission, Verizon now offers a free call-filtering *service*, but it's just a band-aid on the spam-call ...
Verizon Set To Offer Free App For Blocking Robocalls, New Tech To Combat Spam  Forbes[UPDATE] Verizon is getting ready to offer a free robocall blocking app at the end of this month, as it steps up efforts to combat the growing plague of spam calls.
7 paid apps you can download for free on April 17th  BGRUntil Verizon, AT&T, T-Mobile and Sprint get their act together, there's not much we can do about spam calls and texts. But if you want to try to solve the problem ...
Verizon's Spam-Blocking Call Filter Is Now Free  GizmodoRobocalls are annoying as hell, and it seems the problem is only getting worse. But if you're on Verizon, you may have a new way to block them with the ...
New Report Shows Phone Scams Are At An All-Time High  Utah Public RadioThe report from Truecaller, a spam-blocking app, shows that Americans felt victim to more phone scams this year costing them $10.5 billion, up from $8.9.
Die, robocalls, die: A how-to guide to stop spammers and exact revenge  The Washington PostWe tested six apps and services to find the best way to fight back against spam bots, telemarketers and fraud.
Robocalls: What AT&T, Comcast and Verizon are doing about them  CNNRobocalls are an annoyance at best and a dangerous scam at worst. AT&T, Comcast, Verizon and other telecom giants want to tamp down on the scourge of ...
How to stop robocalls spamming your phone  TechCrunchNo matter what your politics, beliefs, or even your sports team, we can all agree on one thing: robocalls are the scourge of modern times. These unsolicited ...
Top iPhone, Android apps for blocking robocalls  Fox NewsMajor carriers and app developers are ramping up their tactics for tackling robocalls on the iPhone and Android devices.
How to stop robocall spammers and exact revenge  Boston.com“Call me, maybe?” is on the brink of becoming “Call me, never.” Robocalls, those computer-generated shysters, are making some people stop answering the ...
Long-awaited robust call blocking features may soon come to Google Phone app  Android PoliceYour smartphone already lets you block annoying callers so that you never have to deal with them again, but what if it could be proactive? Android could soon ...
Help Desk: How do you stop robocalls to your landline?  The Washington PostOur tech columnist answers your questions about how to block spam, nuisance and fraudulent calls on your home phone.
Review: How to stop robocall spammers -- and exact revenge  Chicago Daily HeraldWhile lawmakers debate what to do about the roboscourge, engineers have cooked up some clever ways to make bots work for us, not against us. The right app ...
Those dreaded robocalls: An end may be in sight  cleveland.comCLEVELAND, Ohio -- Teri Dew of Cleveland gets nearly 25 robocalls a week. Sometimes the calls promise better credit card rates on cards she doesn't have.
Verizon will offer free spam protection to all of its customers  The VergeVerizon announced that it will offer free spam and robocall protection to its subscribers. The company says it has blocked nearly 1 billion spam calls to date, and ...
Savvy Senior: How senior can stop frustrating robocalls  Logan Daily NewsDear Savvy Senior,. Is there anything seniors can do to stop perpetual robocalls? It seems like I get five to 10 a day on my home and cell phone, and I'm sick of it!
Verizon Joins AT&T And Comcast In Curbing Robocalls, Offers Free Robocall Blocker App  Z6MagAs more people expressed their concerns about the growing robocall problem that have become one of the most afflicting experience for American households, ...
Verizon is releasing a new app next month to fight robocalls  BGRWe cover the widespread -- and still growing -- problem of robocalls and spam calls pretty extensively, in part because the people behind this seem to get more ...
In 2019 Here's How To Stop And Block Robocalls, Spam, And Unknown Calls On iPhone, Android  ForbesRobocalls are at epidemic levels. Here are some ways to get a handle on them in the new year. And one way to stop them cold. Scammers have gotten craftier, ...
Fight against robocalls continues as AT&T, Comcast complete test of verified call  USA TODAYThe fight against robocalls can even bring telecom rivals together.
Verizon Combats Robo-Callers with Free App  Top News GazetteThe creation of the phone was a revolutionary thing, and it is almost impossible to live our lives without this grand piece of technology. However, it is.
Nine apps to block spam calls and text messages in Android  AndroidGuysIf you want to block spam calls and text messages on your Android phone, here is a list of 9 Android apps to identify and block those call in your phone.
How to battle spam on your landline phone  The VergeYou probably use a cellphone for most (or all) of your calls, assuming you make voice calls at all. However, if you still have a landline, it can be hard to battle the ...
How to Block and Report Spam Calls and Text Messages  The New York TimesUnwanted calls and spam texts are annoying, but you can do something about them. Here's how to block and report them so they won't bother you again.
How to stop robocalls, block numbers on your iPhone, Android and even landline  USA TODAYYou have a whole arsenal of smartphone tools at your disposal: Block numbers, Do Not Disturb mode, and apps can help end this telephonic pestilence.
How to Block Robotexts and Spam Messages  PCMag.comSpammers try to trick you with text messages as well as phone calls and emails. Here's how to deal w.
How to Block Robocalls and Spam Calls  PCMag.comAre you getting too many phone calls from spammers and telemarketers? You can take several steps to.
How to enable spam call filtering on your Android phone  TechRepublicGoogle recently added spam protection to the Phone app on Android devices. Here's how to enable it.
Here's how to block robocalls on iPhone and Android  Fox NewsUnwanted calls are often harmless but some are after your credit card information, IDs or passwords. All are a distraction and a waste of your time.
Google Assistant will screen spam calls on the Pixel 3  Circuit BreakerThe Pixel 3 will be able to screen spam calls and provide real-time transcriptions, Google announced during its Pixel 3 event today. The new feature will allow ...
How To Completely Block, Stop Robocalls, Spam, Scams On iPhone, Android  ForbesWhile apps provide some level of protection against robocalls, spam, and scams, they're not bulletproof. When all else fails, try this nuclear option.
TRAI DND App on iOS: Here's how to use the new app to block spam  BGR IndiaWith TRAI's spam blocker app finally on iOS, here's how you can use it to reduce the amount of unwanted calls and SMSes. - TRAI DND App on iOS: Here's how ...
T-Mobile says it has blocked 1 billion robocalls  The VergeT-Mobile announced today that since launching its Scam ID and Scam Block features 18 months ago, the carrier has blocked over 1 billion scam calls. T-Mobile ...
The iPhone app that stops those horrible spam calls just got a great new feature  BGREarlier this month, we told you about an app that sadly has become a must-have for pretty much anyone with a cell phone. The issue of spam calls is a problem ...
How to Block Spam Calls – A Complete Guide  BeebomSpam Calls have turned from mildly annoying to a disaster in the last couple of years. I don't know about you guys, but I might have received more spam calls ...
4 Smartphone Apps That Aggressively Block Spam Calls  The Wall Street JournalInundated with junk calls? Stop pesky robo-dialers with these anti-spam apps.
10 Best Call Blocker Apps to Prevent Nuisance Calls to Your Small Business  Small Business TrendsBombarded by unwanted calls on your mobile phone? There's an app for that! Here's our list of the 10 best call blocker app options.
Verizon now offers free robocall and spam blocking service  Sun SentinelVerizon is now offering free robocall and spam blocking services to help customers fight back against these malicious calls. The No. 1 U.S. carrier also has ...
3 best anti-spam email filters for Thunderbird to keep your inbox clean  Windows ReportLooking for best spam filter for Thunderbird in 2019? Checkout our review of best Thunderbird spam filters to keep your inbox clean and safe.
Here’s everything you can do to stop robocalls  CNETAnswering a phone call only to have some random stranger yelling and threatening you because you supposedly owe the IRS money is confusing and ...
How to Block Calls on an Android Phone  TechliciousWith an estimated 29.2% of all mobile calls in the US being spam in 2018, there no doubt things have gotten out of control. If you're fed up and want to block ...
Don't pick up: how to stop these annoying robocalls for good  USA TODAYRobocalls are constant and they're costing phone owners money. Here's how to identify and stop them.
Top 10 Best Android Apps — Call Blocking — July 2018  Android HeadlinesSpammy and malicious calls are a serious annoyance, and even a danger for some Android owners. Iffy calls can cost you your time, your sanity, and in some ...
10 Tips for Creating Landing Pages That Convert the Most Prospects  EntrepreneurOnce you've attracted prospects to your website, you need a way to get them to pull the trigger and buy. These 10 tips help them do just that.
7 ways to stop robocalls now  Fox NewsHello! Please don't hang up… did you know that you could save a bundle on…? This is a robocall, another automated telemarketer. Nowadays, robocalls make ...
Spam calls: how to stop the robots from calling your iPhone or Android  The VergeIt seems like robocalls are only getting worse, but there are several ways of reducing the scam calls and these annoying, constant interruptions.
This Woman Fought Back Against Robocalls And Won $459K In Damages  Patch.comWoman Sues Robocaller; Wins $459K Judgment - Memphis, TN - A Memphis woman won a $459000 judgment after she sued a company that spammed her ...
Check out the apps that will intercept robocalls and tell you when they're done  ABC NewsPesky calls from telemarketers may be easier to combat than ever. With new apps like Robokiller, spam calls are automatically intercepted so that your phone ...
T-Mobile switches on spam call protections for some cellphone users  Washington PostMany of T-Mobile's wireless customers will soon see a new “Caller Verified” message when they receive calls on their cellphones, the company said Thursday.
How to stop Robocalls  KomandoWant to stop unwanted telemarketing calls? Your carrier has tools, plus you can download apps. Read this complete guide to stopping unwanted and annoying ...
Verizon making spam, robocalling features free for all customers  Fox NewsRobocalls and spam calls might soon be less of a problem for Verizon customers.
The Beginning of the End of Robocalls  New York MagazineBy the end of 2019, spam phone calls could be on the ropes.
Hiya Says There Were 85B Robocalls Worldwide in 2018  The Mac ObserverHiya has released [PDF] its first Global Robocall Radar Report, and the results are troubling. Global spam calls grew 325% to 85 billion calls in 2018 (via ...
A new government app will allow you to stop telemarketing and spam calls  Brag MagazineA new government app allows people to register their numbers and block spam and telemarketing calls before they reach you.
Behold: This is the iPhone app you’ve been waiting for to stop those horrible spam calls  BGRSpam calls have been a problem in the United States for quite some time now, but things have really gotten awful over the past couple of years. The issue varies ...
Android May Have Introduced the Best Anti-Spam Call Feature Yet  SlateThe problem of robocalling is getting worse. In April, robocall-blocking *service* YouMail estimated 3.4 billion such calls were made—900 million more that month ...
8 Best Android Call Blocker App List For 2018 | Filter Spam Calls  FossbytesMany third-party apps can shield your device from unwanted calls and also help you to recognize the unknown numbers. We have made the best Android call ...
Here's How the Government Shutdown Is Affecting Spam Robocalls  GizmodoThe two main agencies that are supposed to be helping monitor robocalls—the Federal Trade Commission (FTC) and the Federal Communications Commission ...
Here's why you're getting so many spam phone calls  MarketWatchTax season spurs IRS scam calls, even as half of mobile calls are expected to be spam robocalls this year. Here's how to protect yourself.
If someone named 'Scam Likely' is calling you, don't pick up  USA TODAYThe four major wireless carriers are trying out new ways to combat the rising epidemic of spam callers.
New Apple patent suggests iPhones could warn against spam calls one day  The VergeA new Apple patent could finally give iPhone owners some relief from spam calls by automatically recognizing a fake call and warning users accordingly.
Stop the Robocalls: Tips to Hang up on Them for Good  WQAD MolineRobocalls happen day or night, ringing our cellphones, our landlines and are often nothing but a big waste of our time. Billions of robocalls happen each year If ...
iOS 12 includes support for reporting unwanted texts & calls as spam  9to5MaciOS 12 includes a notable update for handling spam messages and calls. As outlined on its developer webpage, app makers can now create an app extension ...
Blocking spam calls with mobile apps - Nation  The Star OnlinePETALING JAYA: From telemarketers offering credit cards and insurance to criminal Macau scam syndicates, Malaysian mobile phone users are being hounded ...
As Scams Skyrocket, How To Stop Robocalls On Android And iPhone  ForbesNever assume you're too smart to fall for a phone scam.
How To Stop Robo And Scam Calls Once And For All  HuffPostCursing like a sailor into the phone doesn't actually work, you know.
Relief From Spoofed Robocalls Is on the Way  ConsumerReports.orgThe telecom industry says that new technology to manage spoofed robocalls may start rolling out in the coming year. Consumer Reports tells you what you need ...
John Oliver Tackles Robocalls by Flooding FCC With Spam Calls  PCMagDo you hate picking up your phone and hearing an automated voice on the other end? John Oliver has your back. The host of HBO's Last Week Tonight has ...
Verizon says they plan to block 'robocalls'  Fox 35 OrlandoIf you've been getting more "robocalls," or unsolicited calls on your cellphone, you're not alone.
Google Pixel phones will automatically send spam calls to voicemail  The VergeGoogle is updating its default Phone app on Pixel devices to ignore spammy calls and automatically send them straight to voicemail.
Government shutdown could mean more robocalls on your cellphone  WPTV.comThe government shut down is trickling further down to the point where it could affect your cellphone.
How to block spam calls on Android smartphones  The Indian ExpressEvery day we receive calls from several unknown numbers, and some of those spammers, telemarketers and annoying strangers make us want to throw away ...
Google Chrome to block spam ads starting July 9  Gadgets NowNEW DELHI: Tech giant Google has announced that it is bringing the built-in ad blocker of the Chrome browser to every country. The company rolled out the ...
Quickly block spam calls with Castle, the anti-robocall app  KnowTechieSpam callers are getting smarter. No longer is it just 1-800 numbers and random strings of numbers, it is your area code and prefix. Castle could help.
Kim Komando: Effective tips on how to stop those annoying robocalls  South Bend Tribune“Hello! Please don't hang up… did you know that you could save a bundle on…? This is a robocall, another automated telemarketer. Nowadays, robocalls make ...
Google wants to help screen those incessant robocalls  NBCNews.comGoogle has a new tool to help deal with the ongoing epidemic of robocalls. The company on Tuesday announced a feature that lets people answer calls with an ...
Nearly half of all phone calls will be spam by 2019, according to new report  Android PoliceSpam calls have become obnoxious as of late for many people - myself included - and it looks like they are only going to get worse. First Orion... by Corbin ...
How to block spam messages on iPhone and Android devices  Gadgets NowLose 10Kgs in 4 weeks,” reads one message and “Hi, we have an exciting offer exclusively, to avail the offer give us missed call on 0099887655,” reads another.
How to Block SMS Spam on iOS 11  NDTVTired of spam text messages? iOS 11 allows you to block them easily, but you need to install third-party apps for this feature.
How can I block spam calls?  KFOX El PasoIn a previous post, I explained how spam calls have sharply increased in recent months and most wireless companies aren't doing a very good job of blocking ...
7 ways to finally end robocalls  Fox NewsRobocalls are the worst. That phony voice. The unstoppable message. At least you can get sassy with a telemarketer. Some robocalls are so convincing that you ...
How to stop robocalls: Those annoying automated phone calls are about to get worse  CBS NewsOf the robocalls made in August, 1.8 billion of them were scams and next year, some estimates predict half of all mobile calls will be scams.
The FCC is taking on Robocalls  KomandoRobocalls might be on the way out now that they are on the FCC's Radar.
How to stop annoying robocalls on your iPhone and Android  KomandoRobocalls are quite simply the most annoying modern tech scourge for many people. It's a plague that the world can do without. And if anything, the robocall…
Estimated 24.9M Americans Lost $8.9B in Phone Scams as Rate of Spam Calls Jumps 22%, According to New Report from Truecaller  GlobeNewswireNew York, NY, April 26, 2018 (GLOBE NEWSWIRE) -- Truecaller announced findings today from its fourth annual study on the impact of phone scams and spam ...
T-Mobile Goes After Scam Calls With 'Caller Verified' Feature  PCMagThis feature is currently limited to Galaxy Note 9 handsets, but T-Mobile said it will be available on 'more smartphones later this year.' Users will see 'Caller ...
Apple needs a feature like Google’s Call Screen  TechCrunchGoogle just one-upped Apple in a significant way by addressing a problem that's plaguing U.S. cellphone owners: spam calls. The company's new Pixel 3 ...
Stop spam calls with the best call- and text-blocker apps  Digital TrendsUnwanted calls and texts on your smartphone can be a serious headache. Put a stop to them with one of the best call and text blocker apps.
Research: 50% of all calls are robocalls, how to stop them on your phone  KomandoRobocalls are quite simply the most annoying modern tech drawback for many people. And aside from trying to sell you stuff, robocalls can be downright ...
How to Avoid (and Block) 'Neighbor-Spoofing' Robocalls  Tom's GuideAre you being flooded by spam calls from numbers with your area code and prefix? Here's how to avoid being tricked by these phony neighbors.
Spam calling is getting worse in South Africa – it’s among the worst in the world  BusinessTechSouth Africans are some of the most spammed in the world, a new insights study by spam call blocker Truecaller has revealed.
How to block spam texts and messages on your phone  KomandoTing! You've just received a new message. You set down your bags of groceries, dig into your pocket and pull out your smartphone. Then, you frown.
How to stop robocalls from blowing up your phone  SoftonicChances are, you've seen an increase in calls from local numbers coming through your phone. These calls that appear to be from your hometown are scammers ...
Waste Phone Scammers' Time Instead of Yours With RoboKiller  LifehackerI work in a profession where I tend to get a lot of phone calls from numbers I don't have saved as contacts. That means that I'll answer the phone during the work ...
AT&T is adding a spam filter for phone calls  The VergeToday, AT&T introduced a new *service* for automated blocking of fraud or spam calls. Dubbed AT&T Call Protect, the system identifies specific numbers believed ...
XRP is a Valuable Tool for Addressing Crypto Spam on Twitter  NullTXThere are numerous innovative projects in the blockchain and cryptocurrency world which are often overlooked. In the case of “You're Welcome”, their approach ...
How to stop robocallers  Business InsiderRobocallers are a nuisance, and it seems like they're more prevalent than ever. With tricks like using the same area code as you, it seems like there's no escape ...

What to Do to Avoid Getting Banned

How would you feel if you found a link on... Read More

FTC Botches Fight on SPAM, Microsoft Takes Over the Battle

While the Federal Trade Commission is busy fighting over definitions... Read More

Stuffing the Spammers!

I'm really, truly fed up with spam. Every day when... Read More

Getting Back To Basics.

While we all agree that there`s way too much spamming/junk-mailing... Read More

Having a Bad e MALE Day? Email, Spam, Spam and More Spam

You just sat at your desk, opened your email account... Read More

Spam: The Tasteless Internet Meat of Criminals

Spam. You've all heard of the crazy pink meat in... Read More

Stop Spam! New Spam Blockers

News last week that Internet service provider Verizon settled its... Read More

Protecting Yourself With A Porn Filter

The harmful affects of pornography use and addiction are well... Read More

Im Guilty Until Proven Innocent

No doubt about it."Spam" (unsolicited commercial email) threatens to paralyze... Read More

A War on SPAM: Attacking The Evil

As most small, medium and large businesses in this country... Read More

What Is Spam?

If you've been around the interenet any length of time... Read More

Is There A National Do Not Spam List?

You may have already received a do not spam list... Read More

Fight Spam and Fortify Your Web Site with RSS

RSS is the answer to the Spam epidemic of the... Read More

Which Spam Filter Is Best For You?

With the number of spam filtering solutions increasing each week... Read More

Eight Quick Tips For Stopping SPAM

If you are buried in SPAM then you're not alone.... Read More

Is Email Dying?

2004 was really a year when the whole subject of... Read More

I Must Be The Luckiest Person Alive! Spam

I must be the luckiest person alive! My inbox is... Read More

The Anti Spam Challenge ? Minimizing False Positives

Email is the quintessential business communication tool, so when it... Read More

The Definition of Spam

Spam can bring down your website faster than a speeding... Read More

The Trouble With Spam Is....

Each day we all face the same challenge. Spam. It... Read More

Phishing for an Identity

Phishing is rapidly becoming on the largest threats to your... Read More

SPAM: A Nutrious Food or a Waste of Time?

Unless the filters on your computer are really good, you're... Read More

Stop Spam: How To Escape The Spam Hell-Hole

If you're anything like me, you're pretty sick of it,... Read More

How to Write a Privacy Policy

A Privacy Policy can be defined as the policy under... Read More

Of Spam and Sandboxes

About a month ago I had the privilege of giving... Read More