Recent Articles

IGoogle Announces New Chat Application
iGoogle continues to get better and better, now you can add a widget featuring the same chat feature that you have grown to love in Gmail. A very cool part of the...

Did Adobe Give Apple The Shaft With Flash 10?
Just now Adobe announced lots of mobile phone news. More on that in a second. But what wasn't announced? No iPhone support for Flash yet. What else was announced? FlashPlayer 10 will ship on the Palm...

New Adobe AIR Applications For GMail
Being an AIR app, GoAir and Live Quotes work on Windows, Mac and Linux. GoAir is an offline Gmail Client while Live Quotes shows you relevant information...

Amazon Application Makes Purchases On Your...
While there were numerous reports of Amazon being one of the few retailers who were positive this holiday season. One of the things that was didn't receive a tremendous amount of press was the release...


03.17.08

Hadoop: Platform For Developing Applications

By Savio Rodrigues

Cloudera, an open source startup working to expand the use of Apache Hadoop, made two announcements today.  First, it has secured $5 million in Series A funding today.  Second, the availability of the Cloudera Distribution for Hadoop.

What's Hadoop? It's a platform for developing applications that can process vast datasets while scaling to the levels that companies like Google, Facebook and Yahoo require.  Hadoop is an Apache project that:

"implements MapReduce, using the Hadoop Distributed File System (HDFS) (see figure below.) MapReduce divides applications into many small blocks of work. HDFS creates multiple replicas of data blocks for reliability, placing them on compute nodes around the cluster. MapReduce can then process the data where it is located."

Cloudera sees a market for Hadoop in enterprise situations from analyzing genome and protein data, oil and gas exploration and financial processing.  The Cloudera Distribution for Hadoop is open source and licensed under the Apache Software License 2.0.  Cloudera intends to drive revenue from support and implementation services.  I've typically been down on a support or services-based open source business.  However, in the case of Cloudera, this model makes sense, at least for now.  The number of people who can implement a highly scalable application that processes petabytes of independent data relationship using the MapReduce programming model who don't work for Google, Yahoo, Facebook and the like can probably be counted on two hands.  There is a degree of education and hand holding that Cloudera needs to do while enterprise developers explore writing this style of applications.

The Premier Event for Search Engine
Marketing & Optimization -
Register Now

Take a look at the investors and it's easy to predict that Mike Olson and team won't be independent for long:

"In addition to Accel Partners, investors in Cloudera include Mike Abbott (senior vice president, Palm), David desJardins (early Google employee), Caterina Fake (co-founder, Flickr), David Gerster (entrepreneur), Youssri Helmy (entrepreneur), Dr. Qi Lu (president of the Online Services Group, Microsoft; former executive vice president, Yahoo!), Marten Mickos (former CEO, MySQL), In Sik Rhee (former chief tactician, Opsware; founder, Loudcloud), Jeff Weiner (president, LinkedIn; former senior vice president, Yahoo!), Dick Williams (CEO, Illustra; former CEO, Wily Technology), Gideon Yu (Facebook CFO; former senior vice president, Yahoo!; CFO, YouTube)."

All the best to the Cloudera team.

Comments


About the Author:
Savio Rodrigues is a product manager with IBM's WebSphere Software division. He envisions a day when open source and traditional software live in harmony. This site contains Savio's personal views. IBM does not necessarily agree with the views expressed here.
About ApplicationDevelopmentNews
ApplicationDevelopmentNews is a collection of news and commentary designed to keep you in step with the ever evolving landscape of Application Development.





ApplicationDevelopmentNews is brought to you by:

SecurityConfig.com NetworkingFiles.com
NetworkNewz.com WebProASP.com
DatabaseProNews.com SQLProNews.com
ITcertificationNews.com SysAdminNews.com
LinuxProNews.com WirelessProNews.com
CProgrammingTrends.com ITmanagementNews.com






-- ApplicationDevelopmentNews is an iEntry, Inc. publication --
iEntry, Inc. 2549 Richmond Rd. Lexington KY, 40509
2009 iEntry, Inc. All Rights Reserved Privacy Policy Legal

archives | advertising info | news headlines | newsletters | comments/feedback | submit article


ApplicationDevelopmentNews News Archives About Us feedback