SpamNet signs up surfers to fight junk email
Published: 19 Jun 2002 14:09 BST
Ordinary Web surfers could play a major role in stemming the rising tide of junk email crippling the Net, if a new anti-spam company hits its mark.
After operating in stealth mode for nearly two-and-a-half years, Cloudmark on Wednesday is taking the wraps off a new spam-fighting tool, called SpamNet, which aims to use the power of the people to weed out unsolicited commercial email.
Conceived by Napster co-founder Jordan Ritter and open-source developer Vipul Ved Prakash, the company is touting the benefits of democracy, networking and collaboration in the war against unscrupulous email marketers.
The company does face challenges. It is charged with transforming a tool that's geared for a small Unix developer community into a product for the masses. It also has to offer up a system that's simple and effective to build a critical mass. Finally, it must build in financial support for such a system.
Then there is there is the Internet itself, whose enormous strengths of openness, flexibility and redundancy have proven insurmountable foes for legions of companies that have marched off before to vanquish the hordes of spam. Many, such as SpamCop and SpamKiller, already include tools to allow email recipients to report spam to their Internet service providers, a form of democracy in action that has not proven terribly effective.
Still, technology pundits say that most existing anti-spam solutions haven't been able to keep up with the rising flood of junk and the sophistication of marketers sending it. In this environment, Cloudmark is drawing attention for what some analysts call a new approach to the problem.
"What's exciting about Cloudmark is that it's a distributed response to a distributed problem," said Kevin Werbach, technology analyst at EDventure Holdings.
"There are so many spammers out there," he said, "that it's difficult to come up with sophisticated algorithms to catch all the spam and not catch all the email. But if you harness the power of thousand or potentially millions of people on the network, then you can grow the response to the spam almost as fast as the spam itself is growing."
Despite repeated attempts to keep spam down to size, the enemy has proliferated: Internet researcher Jupiter estimates that consumers will receive 206 billion junk emailings in 2006 -- an average of 1,400 per person, compared with about 700 per person this year.
If Cloudmark is not the first company to address the problem, its claims are among the boldest. Prakash drew inspiration for the company from the sci-fi novel A Fire Upon The Deep, by computer science professor Vernon Vinge, who wrote about a router the size of a planet "that could filter spam," Prakash said.
In an interview, Prakash and company chief executive Karl Jacob said their company's software solves the problem of identifying spam and quickly updating email filters by harnessing the intelligence of the Web community at large.
Building on a foundation of trust, "It operates on a trust evaluation system, it evaluates the trustworthiness of the user's suggestion to identify a spam message," said Jacob, an investor in the company who recently left his job as chief executive of advice site Keen.com. "It's based on how long they've been in the community, how many messages they've sent that were verified. The effect is it allows a democratic vote."
The software is based on Prakash's open-source software Razor, a collaborative spam-filtering system that sifts out about five million messages per day. The technology has about 5,000 "users" or Internet Protocol addresses linked to the community, with more than 60 medium-sized ISP. SpamNet will count new users as individuals, however.
Cloudmark's solution requires a free plug-in that plays a minor role in the background of Microsoft's Outlook, the only email client that the product is currently available for. Consumers will see a new file folder on the left side of Outlook deemed for spam and a toolbar at the top for reporting spam or "revoking a spam decision." Every time a user receives a new message he considers spam he would report the message to the program by clicking the first button.
As the software stands now, it filters junk into the spam folder based on 2.5 million "signatures" or combinations of zeros and ones, which are used to identify a junk mail message. The underlying technology attaches a signature to each incoming message, and based on a consensus among users, it will mark a signature as spam in real time. So the more people who participate, the greater depth the database will have with additional marked signatures.
The signatures are unlike typical spam-fighting tools that are based on "rules" or filters built around spoken language, headers or IP addresses of commercial messages. Anti-spam software company Brightmail uses rules-based filtering, for example. But Jacob says that the model doesn't scale well because it depends on humans to constantly write new rules and technology that can get slowed by comparing too many rules to each incoming message. In contrast, Cloudmark uses algorithms to efficiently find numerals or signatures in the database that are similar to another without scanning the entire set.
A spokesman for Brightmail, one of the largest spam-filtering services, said that the company filtered more than 10 billion emails and blocked 1.5 billion junk mails, in the past 12 months. The company's rules-based system is constantly optimised to avoid latency in scanning messages, he said, adding that the vast majority of rules are written automatically, with some exceptions for those particularly challenging spam attacks.
Cloudmark plans to always offer a free product to consumers, with eventual plans to sell a more advanced service. It also plans to license its technology to enterprise customers, of which it already has some beta customers.
If anything, the company has the angst of Web users on its side.
"A community effort against spam is not something we've seen before, at least not on the scale on what they're attempting to gather," said Ray Everett-Church, chief privacy officer at ePrivacy Group, a Philadelphia-based consultancy. "At least they've got a very fertile community who are sick of spam and who are willing to try something new if it will stop it."
Have your say instantly, and see what others have said. Go to the ZDNet news forum.
Let the editors know what you think in the Mailroom.
Did you find this article useful?
23 out of 65 people found this useful
- Share this article:
