Re: Start MapReduce job with jar and arguments programatically

http://www.drdobbs.com/database/hadoop-writing-and-running-your-first-pr/240153197?pgno=2

Re: need expert advise on using Hadoop

you can consider Kafka-->Spark-->SparkML-Zeppein OR Kafka-->Flink-->FlinkML-->Zeppelin Thanks Ashutosh On Thu, Apr 14, 2016 at 8:08 PM, Vikrama Sanjeeva wrote: > Hi, > > I'm here to take a expert advise on using Hadoop or not for my > situation/case. > > Brief intro: I'm a masters by research

Re: Steps to Run Spark Scala job from Oozie on EC2 Hadoop clsuter

Is using oozie binding for you? If you have flexibility to change workflow engine then take a look at Luigi (https://github.com/spotify/luigi) . Thanks Ashutosh On Mon, Mar 7, 2016 at 9:22 PM, Benjamin Kim wrote: > To comment… > > At my company, we have not gotten it to work in any other mode t

Re: Packaging multiple map reduce jobs into one Jar

You can use jobcontrol if the jobs have dependency . On Wed, Jul 1, 2015 at 3:51 AM, Nishanth S wrote: > Hello, > > Is there a way I can package multiple map reduce jobs into one jar file > and then invoke them using hadoop jar.I am using maven as the build > tool.What should be the main clas

Re: ipc.client RetryUpToMaximumCountWithFixedSleep

Looks like your java version is lower than used for creation of jar file. Can you recompile and create jar in your env ? or upgrade your java version? On Thu, Apr 30, 2015 at 1:20 PM, Mahmood Naderan wrote: > There was a syntax error in the previous post. The correct is: > > [mahmood@tiger Index

Re: Hadoop or spark

gt;>>> part of its installation. Spark can run within a Hadoop cluster deployment. >>>> >>>> I think a more apt comparison would be something like whether you >>>> should use regular MapReduce on Yarn on Hadoop OR Spark on Hadoop. >>>> >>

Re: Hadoop 2.6.0, How to add/remove node to/from running cluster

http://wiki.apache.org/hadoop/FAQ#I_have_a_new_node_I_want_to_add_to_a_running_Hadoop_cluster.3B_how_do_I_start_services_on_just_one_node.3F On Sat, Apr 4, 2015 at 7:55 PM, Arthur Chan wrote: > Hi, > > Need help, I have few questions: > My Hadoop version: 2.6.0 (3 nodes) > My OS: CentOS 7 >

Re: Error in using filecache

Path[] uris = context.getLocalCacheFiles(); works for me. On Fri, Mar 20, 2015 at 2:59 PM, Vandana kumari wrote: > Hello all > > I am using hadoop 2.2.0 and there is problem in using filecache. > *Following code is in driver class:* > > Configuration conf = new Configuration(); > > J