Re: Synchronization among Mappers in map-reduce task

Hi Saurabh, >> am not sure making overwrite=false , will solve the problem. As per java doc by making overwrite=false , it will throw an exception if the file already exists. So, for all the remaining mappers it will throw an exception. You can catch the exception and wait. >> Can you please refe

Re: Synchronization among Mappers in map-reduce task

Hi Wangda , I am not sure making overwrite=false , will solve the problem. As per java doc by making overwrite=false , it will throw an exception if the file already exists. So, for all the remaining mappers it will throw an exception. Also I am very new to ZK and have very basic knowledge of it

Re: [VOTE] Migration from subversion to git for version control

+1 -C On Fri, Aug 8, 2014 at 7:57 PM, Karthik Kambatla wrote: > I have put together this proposal based on recent discussion on this topic. > > Please vote on the proposal. The vote runs for 7 days. > >1. Migrate from subversion to git for version control. >2. Force-push to be disabled on

Thinking ahead to hadoop-2.6

Folks, With hadoop-2.5 nearly done, it's time to start thinking ahead to hadoop-2.6. Currently, here is the Roadmap per the wiki: • HADOOP • Credential provider HADOOP-10607 • HDFS • Heterogeneous storage (Phase 2) - Support APIs for using stor

Re: [VOTE] Migration from subversion to git for version control

+1 binding. On Tue, Aug 12, 2014 at 6:08 AM, Thomas Graves < tgra...@yahoo-inc.com.invalid> wrote: > +1 (binding). > > > Tom > > > On Friday, August 8, 2014 9:57 PM, Karthik Kambatla > wrote: > > > > I have put together this proposal based on recent discussion on this topic. > > Please vote on

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

Thanks everyone for trying out the RC and voting. The vote ends with 17 +1s (5 binding) and no -1s. I ll work on publishing the release. On Tue, Aug 12, 2014 at 8:46 AM, Arun C Murthy wrote: > +1 (binding) > > Verified sigs and ran sample jobs. Thanks for taking the lead on this > Karthik. > >

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

+1 (binding) Verified sigs and ran sample jobs. Thanks for taking the lead on this Karthik. Arun On Aug 6, 2014, at 1:59 PM, Karthik Kambatla wrote: > Hi folks, > > I have put together a release candidate (rc2) for Hadoop 2.5.0. > > The RC is available at: http://people.apache.org/~kasha/had

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

+1 (non-binding) * Verified checksums with new binary tar ball. * Checked the compiled *.apt.vm files are included Akira mentioned. Thanks for your quick updating, Karthik. Thanks, - Tsuyoshi On Tue, Aug 12, 2014 at 9:20 PM, Karthik Kambatla wrote: > Thanks for trying the new binary out, Akira

Re: [VOTE] Migration from subversion to git for version control

+1 (binding). Tom On Friday, August 8, 2014 9:57 PM, Karthik Kambatla wrote: I have put together this proposal based on recent discussion on this topic. Please vote on the proposal. The vote runs for 7 days.   1. Migrate from subversion to git for version control.   2. Force-push to be

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

Thanks for trying the new binary out, Akira. I just updated the binary to include the site files as well. On Mon, Aug 11, 2014 at 11:28 PM, Akira AJISAKA wrote: > Thanks Karthik for the update, but the some documents are not included. > > It looks to me that *.apt.vm files are not compiled. > W

Re: Synchronization among Mappers in map-reduce task

Hi Saurabh, It's an interesting topic, >> So , here is the question , is it possible to make sure that when one of the mapper tasks is writing to a file , other should wait until the first one is finished. ? I read that all the mappers task don't interact with each other A simple way to do this i