Re: Passing Args to Mappers and Reducers

2015-10-07 Thread Istabrak Abdul-Fatah
t; >> >> On Tue, Oct 6, 2015 at 10:49 AM, Naganarasimha G R (Naga) < >> garlanaganarasi...@huawei.com> wrote: >> >>> Hi Ista, >>> >>> In general we need to give after specifying the class name like >>> *./yarn jar >>> ../sh

RE: Passing Args to Mappers and Reducers

2015-10-06 Thread Naganarasimha G R (Naga)
: Istabrak Abdul-Fatah [ifa...@gmail.com] Sent: Tuesday, October 06, 2015 19:46 To: user@hadoop.apache.org Subject: Re: Passing Args to Mappers and Reducers Hi Shahab, Thx for the quick reply. Yes, I am using the tool interface and can run the job successfully. I need to pass some extra args

Re: Passing Args to Mappers and Reducers

2015-10-06 Thread Varun Saxena
t; sleep -Dmapreduce.job.queuename=default -m 10 -r 1 -mt 5000* > > i think in your case it should be > -- > *From:* Istabrak Abdul-Fatah [ifa...@gmail.com] > *Sent:* Tuesday, October 06, 2015 19:46 > *To:* user@hadoop.apache.org > *Subject:* Re: Passing

Re: Passing Args to Mappers and Reducers

2015-10-06 Thread Istabrak Abdul-Fatah
pt/yarn/my_examples/AvgSix.jar -Dista="66" > /user/yarn/input/samplefile.csv output*" > > + Naga > -- > *From:* Naganarasimha G R (Naga) > *Sent:* Tuesday, October 06, 2015 20:16 > *To:* user@hadoop.apache.org > *Subje

RE: Passing Args to Mappers and Reducers

2015-10-06 Thread Naganarasimha G R (Naga)
mples/AvgSix.jar -Dista="66" /user/yarn/input/samplefile.csv output" + Naga From: Naganarasimha G R (Naga) Sent: Tuesday, October 06, 2015 20:16 To: user@hadoop.apache.org Subject: RE: Passing Args to Mappers and Reducers Hi Ista, In general w

Passing Args to Mappers and Reducers

2015-10-06 Thread Istabrak Abdul-Fatah
Greetings to all, Is it possible to pass args to Mapper and Reducers via the command line args. I need to pass some args upon the MapRed job invocation so that I can pass these args via the Context object to the Mapper and Reducer code. I am currently running Hadoop2.7 and tried to pass some args

Re: Passing Args to Mappers and Reducers

2015-10-06 Thread Shahab Yunus
Are you properly implementing the Tool interface? https://hadoopi.wordpress.com/2013/06/05/hadoop-implementing-the-tool-interface-for-mapreduce-driver/ Also, there needs to be space between -D and the param name. Regards, Shahab On Tue, Oct 6, 2015 at 9:22 AM, Istabrak Abdul-Fatah

Re: Passing Args to Mappers and Reducers

2015-10-06 Thread Varun Saxena
-Dmapreduce.job.queuename=default -m 10 -r 1 -mt 5000* >> >> I think in your case it should be "*yarn jar >> /opt/yarn/my_examples/AvgSix.jar -Dista="66" >> /user/yarn/input/samplefile.csv output*" >> >> + Naga >> -

Re: Passing Args to Mappers and Reducers

2015-10-06 Thread Istabrak Abdul-Fatah
Hi Shahab, Thx for the quick reply. Yes, I am using the tool interface and can run the job successfully. I need to pass some extra args dynamically as part of the invocation. I have tried adding a space after the -D option and it did not work either (see below). ~]$ yarn -D ista="66" jar