[
https://issues.apache.org/jira/browse/OOZIE-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047357#comment-16047357
]
Dongying Jiao edited comment on OOZIE-2941 at 6/13/17 2:52 AM:
---------------------------------------------------------------
This is due to lack of map-reduce lib. My WA is:
Create map-reduce folder in Oozie sharelib on HDFS, for example,
/user/oozie/share/lib/lib_XXX/map-reduce.
Put all map-reduce jars in hadoop map-reduce lib to this folder.
Add below property in workflow:
<property>
<name>oozie.action.sharelib.for.map-reduce</name>
<value>map-reduce</value>
</property>
Set oozie.use.system.libpath=true in job.properties.
Then the map-reduce workflow example can run successfully.
But seen from the yarn resource manager UI, the second application name is N/A.
I attach the screenshot.
was (Author: dongying jiao):
This is due to lack of map-reduce lib. My WA is:
Create map-reduce folder in Oozie sharelib on HDFS, for example,
/user/oozie/share/lib/lib_{timestamp}/map-reduce.
Put all map-reduce jars in hadoop map-reduce lib to this folder.
Add below property in workflow:
<property>
<name>oozie.action.sharelib.for.map-reduce</name>
<value>map-reduce</value>
</property>
Set oozie.use.system.libpath=true in job.properties.
Then the map-reduce workflow example can run successfully.
But seen from the yarn resource manager UI, the second application name is N/A.
I attach the screenshot.
> Old map-reduce workflow example can't work with OYA
> ---------------------------------------------------
>
> Key: OOZIE-2941
> URL: https://issues.apache.org/jira/browse/OOZIE-2941
> Project: Oozie
> Issue Type: Sub-task
> Components: workflow
> Affects Versions: trunk
> Reporter: Dongying Jiao
> Attachments: RM_UI.jpg
>
>
> map-reduce workflow in Oozie examples run failed after OYA merged. The
> exception in yarn log is:
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/hadoop/mapred/Mapper
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> at
> org.apache.oozie.action.hadoop.LauncherAM.getMainArguments(LauncherAM.java:540)
> at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:170)
> at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:148)
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.Mapper
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 15 more
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
