November 15, 2009

Do you have what it takes to join Yahoo!'s US Hadoop Team? [UPDATED]

Update: Added a few more US based jobs.

First, an introduction. I'm Mark Tsimelzon, a recent addition to the Hadoop team. I'm Director of Engineering at Yahoo!, managing MapReduce and a bunch of projects with cute animal names that build database abstractions on top of Apache Hadoop. Having spent most of my career in various startups, I was not sure what I was getting myself into when I joined Yahoo!. To my amazement, what I discovered here was not so different from a startup. The Hadoop team at Yahoo! is filled with extremely smart, hard-working people, who care deeply about their job, Yahoo!, and Open Source. The team moves as fast as any startup does, even though the scale of the problems it solves would make any startup founder deeply envious.

The best part of being the a part of the Hadoop team at Yahoo! is that despite the current global economic situation this team is growing fast! This is not surprising - all of Yahoo! batch data processing is moving to Hadoop, and we need many more great people on to join this team. What follows is a quick list of openings we currently have, and it. It includes openings for developers, testers, architects, managers and directors. If you are interested in applying for any of these positions, please send your resume together with a few lines on why you want to work with us on Hadoop to hadoop-jobs-2009@yahoo-inc.com, using the position title as the message subject. Your resume will go straight to one of the hiring managers.

Senior Software Engineer
We are looking for great software engineers who have a wealth of experience with complex software systems, distributed systems, algorithms, data structures, and performance optimizations. Understanding of MapReduce, grid computing, databases, data warehouses, and database internals is a big plus. Expert Java skills are required. Experience with agile development and open source development is desired. 6+ years of software development experience are desired.

Software Architect / Team Leads
We are looking for great architects / technical team leads who have a proven track record of designing and delivering complex software systems. Thorough knowledge of distributed systems, algorithms, data structures, performance optimization, scalability, and reliability issues are required. Understanding of grid computing, databases, data warehouses, and especially database internals is a big plus. Solid Java skills are required. Experience with agile development and open source development is desired. 8+ years of experience, including 4+ years in the architct / team lead role are desired.

Senior Java Performance Engineer
Our Grid Hadoop Performance/Utilization team is looking for a senior performance engineer with expert Java/JVM knowledge to help us: evaluate and propose optimal JVM tuning options for best performance; evaluate various JVM's for best performance and stability as a continuous process; profile the Java code for Grid software stack to find performance bottlenecks and find propose innovative ways to eliminate them; characterize all aspects of HDFS and MapReduce performance; participate in design reviews and propose innovative solutions for performance and scalability improvement throughout the life cycle of product; measure system resource utilization and efficiency, and mine and analyze large amount of logs and traces to identify improvement opportunities; champion the techniques of writing best java code for high performance for writing high performance Java code.

Senior Engineer for Oozie
As more data processing projects both within Yahoo! and worldwide move to using Hadoop, a comprehensive workflow management and coordination system becomes critical. Oozie is intended to solve precisely this problem. The challenge is to make the system scalable, fast, data aware, fault tolerant, and extensible. It needs to support many different job types that can run on a Grid, such as MapReduce, PIG, Hadoop Streaming, HDFS, etc. The Oozie team is rapidly growing. If building a core component of the open source Hadoop project is the kind of challenge that appeals to you, this is the place to be. Excellent Java coding skills required for this position.

Senior Engineering Manager, MapReduce Team
Our MapReduce team is growing, and we are looking for a dedicated Senior Engineering Manger to lead it. We are looking for someone with a history of driving delivery of complex distributed systems and/or complex systems software. Experience with MapReduce is a Plus. Experience with MapReduce internals is a Big Plus. Experience of leading a geographically distributed team is strongly desired. Our environment is open, collaborative and fast paced. It is filled with very smart and independent people. We require our leaders to nurture such an environment while demanding delivery and high standards in our work product. 10+ years of experience, including 5+ years of management experience are preferred. Experience with Java, Unix, C++, agile development and open source development desired.

Director of Software Engineering, Hadoop Systems
Our Hadoop development team is looking for a world class software leader with a strong systems management and architecture background to lead our investments in HDFS, ZooKeeper and Hadoop performance. This job involves leading and growing a team of 20 engineers, managers and architects at the heart of the Hadoop open source community. We are looking for someone with a history of driving delivery of complex distributed systems and/or complex systems software such as file systems and operating systems. Our environment is open, collaborative and fast paced. It is filled with very smart and independent people. We require our leaders to nurture such an environment while demanding delivery and high standards in our work product. 8+ years of software development and an addition 8+ years of architecture / management required. Experience with Java, Unix, C++, agile development and open source development desired.

Hadoop Software Quality Engineer Architect
As a QE Architect with 10+ years of experience, you will lead the design and implementation of test plans, test cases, and test frameworks across a number of open source Apache projects related to data processing that underpin the Yahoo! Cloud Computing infrastructure: Pig, Owl, and Zebra. In this highly technical role, you will interface with QA managers, other architects, leads, developers, product managers and operation teams to complete projects. You should possess skills in architecting and lead test efforts for backend components as well as system performance and reliability testing. Excellent Java or C++ coding skills required for this hands-on position.

Senior Whitebox Quality Engineering Lead for Owl
As a Whitebox QE Lead with 5+ years of experience, you will contribute to the leading, design and implementation of test plans, test cases and validation using test tools of complex, distributed software. You will interface with QA managers, other leads, developers, product managers and operation teams to complete projects. You should possess skills in leading and testing APIs of backend components as well as system performance testing. Excellent Java or C++ coding skills required for this position.

Senior Whitebox Quality Engineering Lead for ZooKeeper
Think you got what it takes to engineer testing for ZooKeeper's 5 guarantees? (Sequential Consistency, Atomicity, Single System Image, Reliability, Timeliness) We're looking for a Whitebox QE Lead with at least 5 years of experience to lead, design and implement test strategy, test infrastructure, and test cases. Working with a small development team, you will interface with QA managers, other leads, developers, product managers and operation teams to complete projects. You should possess skills in leading and testing APIs of backend components as well as system performance testing. Excellent Java or C++ coding skills required for this position.

Senior Manager of Data Processing Quality Engineering
The Hadoop team at Yahoo! is seeking an experienced, hands-on Sr. Whitebox QE Manager with strong technical skills (including coding) to lead and grow a team of quality engineers in delivering world-class data processing services as part of Yahoo! Cloud Computing platform. You will define test strategy, execute test plans, review tests and product specifications, participate in defining and selecting appropriate test tools and automation strategy, and lead a strong team to deliver a high quality product. You will work closely with architects, development, program management, operations, and customers to test and release products.

Senior Release Engineer
The Grid Computing team at Yahoo! is looking for an experienced, self-motivated, and energetic release engineer. If you love working with big distributed systems and handling critical configuration management issues, then this position is for you. You also must be able to create order out of chaos by introducing necessary processes and controls in a fast moving, cross functional environment. The ideal candidate is hardworking, detail oriented and has experience as a system administrator or release engineer.

Once again, please send your resume to hadoop-jobs-2009@yahoo-inc.com, using the position title as the message subject.

Mark Tsimelzon
Director of Engineering
Hadoop Team

Posted at November 15, 2009 1:55 AM

Bookmark this on Delicious

Comments

Posted by: bharath v at November 20, 2009 5:58 PM | Permalink