Re: Packaging multiple map reduce jobs into one Jar

You can use jobcontrol if the jobs have dependency . On Wed, Jul 1, 2015 at 3:51 AM, Nishanth S wrote: > Hello, > > Is there a way I can package multiple map reduce jobs into one jar file > and then invoke them using hadoop jar.I am using maven as the build > tool.What should be the main clas

Re: Packaging multiple map reduce jobs into one Jar

Yes you can do this. You can have multiple main in your jar, so you can run, hadoop jar jarname.jar packagename.classname arguments for eg: hadoop jar myJar.jar my.testapp.code1.MyMain1 arg1 arg2 hadoop jar myJar.jar my.testapp.code2.MyMain2 arg1 arg2

Packaging multiple map reduce jobs into one Jar

Hello, Is there a way I can package multiple map reduce jobs into one jar file and then invoke them using hadoop jar.I am using maven as the build tool.What should be the main class in the manifest file in this case?. Thanks, Nishan

Hadoop RPC

Hi, Hope this hasn't been asked before. I'm interested in finding out more about Hadoop RPC and how it works. I'd like to write a service that cleanly fits into the ecosystem and making use of the Hadoop RPC library looks like a good start, particularly as my service will be called (at least) on

Re: how to assign unique ID (Long Value) in mapper

Thanks Gabriel. On Tue, Jun 30, 2015 at 1:04 AM, gabriel balan wrote: > Hi > > Rather than trying to figure out the line number of the current line, you > can use the byte offset of the current line. > It's just as unique as the line number, and much easier to obtain: > TextInputFormat (FileIn

Re: YARN and LinuxContainerExecutor in simple security mode

Dear Ravi, thanks for answer. I went through the discussion in the ticket you mention and did some experimentation. My understanding is the following - as long as I dont explicitly allow for this using hadoop.proxyuser.username.groups hadoop.proxyuser.username.hosts user processes spawned