Hadoop Summit Nearly Full! We'll Webcast and Post Video... (Hadoop and Distributed Computing at Yahoo!)

Welcome, guest Sign In

My Projects
Tools & Services
APIs and Services
- Flickr
- Geo
- Mail
- Search
- Social
- Updates
- YAP
- YQL
Developer Tools
- Hadoop
- YUI
- YSlow
- View all »
Resources
- Blog
- YDN Theater
- Hack U

YDN Hadoop and Distributed Computing at Yahoo! Hadoop Summit Nearly Full! We'll Webcast and Post Video...

Yahoo! Developer Network Blog

February 28, 2008

Hadoop Summit Nearly Full! We'll Webcast and Post Video...

We've been quite impressed by the overwhelming interest in the upcoming Hadoop Summit in late March. Over 150 people have marked themselves as attending or watching on Upcoming.org.

In fact, we hit our attendance cap a mere 36 hours after announcing the event. So there's clearly a lot of interest in the program. As a result, we're opening up more slots today.

We're going to do our best to make as much of the proceedings available on-line as quickly as possible. We'd already planned to make high quality video recordings of all the talks available on YDN Theather a week or so after the event.

Now we're also looking at ways to open it up during the event as well. Expect to see a live webcast and a live chat room so that you can ask questions and chat with those who are physically in Sunnyvale, California for the summit. Once all the details are nailed down, we'll post on the Hadoop blog and on the Hadoop Summit site as well.

We could use IRC, Yahoo! Live, or other options. If you have an opinion, drop a note in the comments.

Thanks for all the interest! This is an exciting time for Hadoop.

Jeremy Zawodny
Yahoo! Developer Network

Posted at February 28, 2008 12:10 PM

Comments

It seems like I've seen a lot of mentions of running large data analysis jobs on Hadoop clusters, but I can't recall reading anything about hosting a website on a Hadoop cluster.

I'm just starting to learn about this project but my reaction to reading about Hadoop is, "Hey, I'm designing a web application and I'm concerned that by using a mysql backend, it will be a challenge should I need to scale it. Hey, here's a project that is designed to scale elastically on computing clusters, and it includes both a scalable execution environment and a scalable database! Why not skip mysql and design my backend around HBase?"

So how about it? I'd be interested in hearing from someone with some expertise in Hadoop. Does this idea make sense? Or is there something about Hadoop that makes it less than ideal for a new web application project that thinks it might scale to lots of data and users?

Posted by: Charlie at March 3, 2008 3:57 AM | Permalink