Hello Jaydeep, Logs from > oozie job -info ...
and > yarn logs -applicationId ... give the same explanation like the one I've got from Oozie web app. Is there any meaning for > Main class [org.apache.oozie.action.hadoop.JavaMain], exit code [1] error? It is good that Spark action will be supported by Oozie, but given our current Oozie version, can developer add Spark (or other 'common') libraries to Oozie's shared libs? When you mention > It is only working as local mode. does it mean that we don't need to copy Spark libs and apps to HDFS? Thank you, On Mon, Jun 1, 2015 at 3:17 PM, Jaydeep Vishwakarma < [email protected]> wrote: > You can get more details for this error on Launcher logs by accessing the > console url. > Spark action has been recently introduced in oozie. It will come in 4.2.0 , > But there are some issue with spark action, It is only working as local > mode. Here is the jira for same. > https://issues.apache.org/jira/browse/OOZIE-2143. > > Regards, > Jaydeep > > > > > On Mon, Jun 1, 2015 at 12:43 PM, Muqtafi Akhmad <[email protected]> > wrote: > > > Hello everyone, > > I'm new to Oozie, currently I'm trying to use Oozie to manage Spark > > applications. I've tried to submit Spark application as Java action ( as > > described in > > > > > http://stackoverflow.com/questions/29233487/launching-a-spark-program-using-oozie-workflow > > ) and the action return error > > > > > Main class [org.apache.oozie.action.hadoop.JavaMain], exit code [1] > > > > My questions are > > 1. How can I see / access the complete stack trace to know what exactly > > happened in my application execution? > > 2. By default, Oozie shared lib directory provides libraries for Hive, > Pig, > > and Map-Reduce. If I want to run Spark job on Oozie, it might be better > to > > add Spark lib jars to Oozie's shared lib instead of copy them to app's > lib > > directory. How can I add Spark lib jars (including spark-core and its > > dependencies) to Oozie's shared lib? > > > > Thank you, > > > > -- > > Muqtafi Akhmad > > Software Engineer > > Traveloka > > > > -- > _____________________________________________________________ > The information contained in this communication is intended solely for the > use of the individual or entity to whom it is addressed and others > authorized to receive it. It may contain confidential or legally privileged > information. If you are not the intended recipient you are hereby notified > that any disclosure, copying, distribution or taking any action in reliance > on the contents of this information is strictly prohibited and may be > unlawful. If you have received this communication in error, please notify > us immediately by responding to this email and then delete it from your > system. The firm is neither liable for the proper and complete transmission > of the information contained in this communication nor for any delay in its > receipt. > -- Muqtafi Akhmad Software Engineer Traveloka
