Take a look at Apache Tez (http://incubator.apache.org/projects/tez.html).
I'll warn you that it's a little rough, but works. Arun On Jun 10, 2013, at 5:46 PM, Grandl Robert wrote: > Hi, > > > It is possible to run shuffle phase in memory ? I mean, the mapper to write > the intermediate output in memory only and the reducer to read it from there. > So no disk involved for intermediate output. > > > If so, what are the configuration parameters I need to tune ? > > Thanks, > Robert -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/
