Re: sub 60 second performance

2009-05-10 Thread Matt Bowyer
You can cache the block in your task, in a pinned static variable, when you > are reusing the jvms. > > On Sun, May 10, 2009 at 2:30 PM, Matt Bowyer >wrote: > > > Hi, > > > > I am trying to do 'on demand map reduce' - something which will return in >

sub 60 second performance

2009-05-10 Thread Matt Bowyer
Hi, I am trying to do 'on demand map reduce' - something which will return in reasonable time (a few seconds). My dataset is relatively small and can fit into my datanode's memory. Is it possible to keep a block in the datanode's memory so on the next job the response will be much quicker? The ma