Why Yahoo should spin out Hadoop team – but not how you think
Recent commentary in the Wall Street Journal (left out of the link out of irritation at the WSJ paywall) and ReadWriteWeb (http://www.readwriteweb.com/cloud/2011/04/yahoo-weighs-spinning-out-hado.php) suggests that Yahoo is in discussions with Benchmark Capital to spin out their Hadoop development team and form a new company.
In my opinion, this is a great idea. Why?
- I think there’s a big market there. A quick look on indeed.com shows over 3000 jobs posted related to Hadoop. Big data analytics is a large and growing space, and Hadoop has established a clear leadership position there.
- I think there is zero chance of Yahoo capturing this value as an internal project. Yahoo has some great properties but it has enough challenges in managing its media business. Running two different businesses (media and software) is very hard, and Yahoo would be ill-advised to try.
- Spin it out on its own, with funding from a top-teir VC. Rumor has it that discussions with Benchmark are in progress.
- Join forces with Cloudera; figure out a fair value for the assets being spun out and work with the Cloudera team to share ownership based on that valuation.
There are fewer moving parts with the standalone spinout so its easier to do, but I’m not convinced its the right thing. I just don’t think two rival firms commercializing one open source project will work well, and I’m afraid both would have the critical mass (and cash) to last a while, which would create a rift in the Hadoop world just as it’s picking up momentum.
Here’s to hoping (however unlikely) that Yahoo, Cloudera, and their VC’s can find a way to create one great company that can help Hadoop realize its full potential.
6/27 addendum: looks like this happened, gigaom is now reporting the spinout will go forward under the name HortonWorks (ugh).