Using Hadoop to fight spam - Part II (Hadoop and Distributed Computing at Yahoo!)

Welcome, guest Sign In

My Projects
Tools & Services
APIs and Services
- Flickr
- Geo
- Mail
- Search
- Social
- Updates
- YAP
- YQL
Developer Tools
- Hadoop
- YUI
- YSlow
- View all »
Resources
- Blog
- YDN Theater
- Hack U

YDN Hadoop and Distributed Computing at Yahoo! Using Hadoop to fight spam - Part II

Yahoo! Developer Network Blog

March 18, 2009

Using Hadoop to fight spam - Part II

Hadoop helps Yahoo! Mail reduce spam for over 300 million people. In the second part of their talk, Mark Risher and Jay Pujara, Yahoo! Mail technologists and spam cops, describe how they are using Hadoop to fight botnets.

Mark and Jay explain how Hadoop makes it possible for Yahoo! Mail to quickly analyze huge sets of data to identify where spam comes from. They describe how team members can quickly come up to speed and submit queries on the data using Pig, and how they see this effort evolving. Listen in as they describe their experiences:

Posted at March 18, 2009 10:15 AM

Comments

Bookmark this on Delicious

Post a comment

Comment Policy: We encourage comments and look forward to hearing from you. Please note that Yahoo! may, in our sole discretion, remove comments if they are off topic, inappropriate, or otherwise violate our Terms of Service.