Re: Finding file size during block placement

2014-07-25 Thread Colin McCabe
On Wed, Jul 23, 2014 at 8:15 AM, Arjun wrote: > Hi, > > I want to write a block placement policy that takes the size of the file > being placed into account. Something like what is done in CoHadoop or BEEMR > paper. I have the following questions: > > Hadoop uses a stream metaphor. So at the tim

Finding file size during block placement

2014-07-23 Thread Arjun
Hi, I want to write a block placement policy that takes the size of the file being placed into account. Something like what is done in CoHadoop or BEEMR paper. I have the following questions: 1- Is srcPath in chooseTarget the path to the original un-chunked file, or it is a path to a single