The Cache: Technology Expert's Forum
Welcome, Guest. Please login or register. September 18, 2019, 10:30:51 AM

Login with username, password and session length

Pages: [1]
Author Topic: Cloud MapReduce  (Read 1112 times)
Global Moderator
Offline Offline

Posts: 2879

View Profile
« on: November 27, 2009, 12:48:26 PM »

This just in.  I haven't had the time to review it fully but from a glancing read it looks damn interesting.  Here's the main website where you can get code and more information:

Here's the Hadoop email I received from the Apache Software Foundation this morning:

Given that Hadoop is the dominant project at the ASF for
cloud-oriented Java applications, I'd like to introduce a new project
in the open source world named Cloud MapReduce. Below are the
pertinent details for the project followed by some info describing why
I'm posting on this list.

What: Created by Huan Liu and Dan Orban at Accenture Labs, Cloud
MapReduce is a MapReduce framework built on top of the Amazon
Infrastructure services. It utilizes these services (Amazon EC2,
Amazon S3, Amazon SQS and Amazon SimpleDB) to create a unique
MapReduce framework with some distinct advantages. Cloud MapReduce
utilizes the Apache License 2.0.

Where: The code base currently lives in a GoogleCode project so it is
available for download by anyone:

There is also more information about Cloud MapReduce at the website,
including a detailed technical report.

Why: Cloud MapReduce offers three primary advantages over other cloud

1) It is faster than other implementations (e.g., 60 times faster than
Hadoop in one case. Speedup depends on the application and data.).
2) It is more scalable and more failure resistant because it has no
single point of bottleneck.
3) It is dramatically simpler with only 3,000 lines of code (e.g., two
orders of magnitude simpler than Hadoop).

Cloud MapReduce is a new framework that is seeking a good home.
Creator Huan Liu came to me because, in his words, he 'wants to build
a community around Cloud MapReduce.' What better place to do this than
the ASF! In speaking with Doug Cutting and others at ApacheCon US a
few weeks ago, we agreed that the best approach to begin would be via
this list in order to get the best breadth possible across the Apache
cloud-related community.

In finding a home at the ASF for Cloud MapReduce, we are aware that it
does not complement Hadoop really, so making it a subproject of Hadoop
is not necessarily the best approach. Another approach would be to
take it through the Incubator in order to eventually graduate as a top
level project.

Exposure to a wider audience is always the best way to grow an idea
and to explore corners that we may have overlooked. The intent of this
message is to start a conversation around Cloud MapReduce, ask
question, discuss its future and generally figure out how best to
bring it to the ASF. Hopefully the information here is enough for
folks to begin asking questions.

-- perl -e 'print unpack("u30","D0G)U8V4\@4VYY9&5R\"F)R=6-E+G-N>61E<D\!G;6%I;\"YC;VT*" );' ActiveMQ in Action: Blog: Twitter:

I would love to change the world, but they won't give me the source code.
Pages: [1]
Jump to:  

Perkiset's Place Home   Best of The Cache   phpMyIDE: MySQL Stored Procedures, Functions & Triggers
Politics @ Perkiset's   Pinkhat's Perspective   
Powered by MySQL Powered by PHP Powered by SMF 1.1.2 | SMF © 2006-2007, Simple Machines LLC
Seo4Smf v0.2 © Webmaster's Talks

Valid XHTML 1.0! Valid CSS!