Re: Caching data selectively on slaves

2008-11-11 Thread Tarandeep Singh
anks, > Lohit > > > > - Original Message > From: Tarandeep Singh <[EMAIL PROTECTED]> > To: core-user@hadoop.apache.org > Sent: Tuesday, November 11, 2008 10:56:41 AM > Subject: Caching data selectively on slaves > > Hi, > > Is is possible to cache d

Re: Caching data selectively on slaves

2008-11-11 Thread lohit
--- Original Message From: Tarandeep Singh <[EMAIL PROTECTED]> To: core-user@hadoop.apache.org Sent: Tuesday, November 11, 2008 10:56:41 AM Subject: Caching data selectively on slaves Hi, Is is possible to cache data selectively on slave machines? Lets say I have data partitioned as D1, D2...

Caching data selectively on slaves

2008-11-11 Thread Tarandeep Singh
Hi, Is is possible to cache data selectively on slave machines? Lets say I have data partitioned as D1, D2... and so on. D1 is required by Reducer R1, D2 by R2 and so on. I know this before hand because HashPartitioner.getPartition was used to partition the data. If I put D1, D2.. in distributed