Yahoo! Developer Network Blog
« Previous | Main | Next »
July 29, 2010
Hadoop2010: Honu at Netflix
iPod
Download high-resolution version
Netflix moved a large portion of their infrastructure to the cloud to meet reliability, scalability, and availability requirements. As the number of instances running in the cloud increase, the standard way of moving log files or loading log events to a database starts saturating the system. Latency/thruput becomes unusable for its operational needs. Honu is the new streaming log collection and processing pipeline in the cloud for Netflix, and it leverages the computational power of Hadoop/Hive to solve its log analytics requirements.
Posted July 29, 2010 2:44 PM | Permalink
Bookmark this on Delicious
Comments
Post a comment
Comment Policy: We encourage comments and look forward to hearing from you. Please note that Yahoo! may, in our sole discretion, remove comments if they are off topic, inappropriate, or otherwise violate our Terms of Service. Fields marked with asterisk '*' are required.
Subscribe
YDN Theater: Get YDN Theater on your personalized My Yahoo! home page.
Recent Blog Articles 
view all
Hadoop2010: Parallel Image Stacking
Thu, 19 Aug 2010
Hadoop2010: Winning the Big Data SPAM Challenge
Fri, 13 Aug 2010
Hadoop2010: Efficient Parallel Set-Similarity Joins
Fri, 13 Aug 2010
Hadoop2010: Integration Patterns & Practices
Fri, 13 Aug 2010
Hadoop2010: Online Content Optimization
Fri, 13 Aug 2010
Recent Links
Thu, 12 Aug 2010
Thu, 08 Jul 2010
Live map of London Underground trains
Mon, 21 Jun 2010
Everything you need to know about the internet | Technology | The Observer
Mon, 21 Jun 2010
Thu, 17 Jun 2010
Archives
2010
2009
2008
2007
2006
