Re: HEP proposal

2010-07-15 Thread Eli Collins
Yup. As updates are necessary, the HEP author can check in new versions if they have commit permissions, or can email new HEP versions to the editor for committing. Thanks, Eli On Wed, Jul 14, 2010 at 10:36 PM, Dhruba Borthakur dhr...@gmail.com wrote: on a related note, since a HEP-initiator

Re: HEP proposal

2010-07-15 Thread Doug Cutting
On 07/14/2010 11:41 PM, Eli Collins wrote: I was assuming HEPs would just be placed in the public domain, period. Like design docs posted on jira they're just text posted to a mailing list, not sure checking them into svn needs to require they have an alternate license. Something I'm missing?

Data Block Size ?

2010-07-15 Thread Syed Wasti
Hi, I am new to hadoop and looking for some answers to clear my basic concepts on Hadoop. Will it matter what the data block size is ? It is recommended to have a block size of 64 MB, but if we want to have the data block size to 128 MB, should this effect the performance ? Does the size

Re: Data Block Size ?

2010-07-15 Thread Allen Wittenauer
On Jul 15, 2010, at 11:40 AM, Syed Wasti wrote: Will it matter what the data block size is ? Yes. It is recommended to have a block size of 64 MB, but if we want to have the data block size to 128 MB, should this effect the performance ? Yes. FWIW, we run with 128MB. Does the size of

RE: Data Block Size ?

2010-07-15 Thread Syed Wasti
Thank you Allen. So, is it fair to assume that if I have smaller block size (64 MB), then my blocks are distributed across more datanodes and because my blocks are around more datanodes, then my map jobs should also run on different datanodes and becuase the maps size will be smaller, it

Hadoop World 2010 - Call for Speakers

2010-07-15 Thread John Kreisa
Hello Hadoop Fans, We are currently seeking submissions for Hadoop World which returns to NYC on October 12th. We want to build on last years success and have added more tracks and more sessions so there are more speaking opportunities. We have had a few requests to extend the submission