[jira] [Updated] (OOZIE-3159) Spark Action fails because of absence of hadoop mapreduce jar(s)

2018-01-15 Thread Attila Sasvari (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-3159:
--
Attachment: OOZIE-3159-001.patch

> Spark Action fails because of absence of hadoop mapreduce jar(s)
> 
>
> Key: OOZIE-3159
> URL: https://issues.apache.org/jira/browse/OOZIE-3159
> Project: Oozie
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Priority: Blocker
> Fix For: 5.0.0b1
>
> Attachments: OOZIE-3159-001.patch
>
>
> OOZIE-2869 removed map reduce dependencies from getting added to Spark 
> action. Spark action uses 
> org.apache.hadoop.filecache.DistributedCache. It is not available anymore in 
> Spack action's classpath, causing it to fail.
> {code}
> java.lang.reflect.InvocationTargetException
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:412)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:56)
>   at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:225)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:219)
>   at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:142)
> Caused by: java.lang.NoClassDefFoundError: 
> org/apache/hadoop/filecache/DistributedCache
>   at 
> org.apache.oozie.action.hadoop.SparkArgsExtractor.extract(SparkArgsExtractor.java:309)
>   at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:74)
>   at 
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
>   at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
>   ... 16 more
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.filecache.DistributedCache
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>   ... 20 more
> Failing Oozie Launcher, org/apache/hadoop/filecache/DistributedCache
> java.lang.NoClassDefFoundError: org/apache/hadoop/filecache/DistributedCache
>   at 
> org.apache.oozie.action.hadoop.SparkArgsExtractor.extract(SparkArgsExtractor.java:309)
>   at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:74)
>   at 
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
>   at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:412)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:56)
>   at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:225)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:219)
>   at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:142)
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.filecache.DistributedCache
>   at java.net.URLClassLoader.findC

[jira] [Updated] (OOZIE-3159) Spark Action fails because of absence of hadoop mapreduce jar(s)

2018-01-15 Thread Attila Sasvari (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-3159:
--
Attachment: OOZIE-3159-001.patch

> Spark Action fails because of absence of hadoop mapreduce jar(s)
> 
>
> Key: OOZIE-3159
> URL: https://issues.apache.org/jira/browse/OOZIE-3159
> Project: Oozie
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Attila Sasvari
>Priority: Blocker
> Fix For: 5.0.0b1
>
> Attachments: OOZIE-3159-001.patch
>
>
> OOZIE-2869 removed map reduce dependencies from getting added to Spark 
> action. Spark action uses 
> org.apache.hadoop.filecache.DistributedCache. It is not available anymore in 
> Spack action's classpath, causing it to fail.
> {code}
> java.lang.reflect.InvocationTargetException
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:412)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:56)
>   at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:225)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:219)
>   at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:142)
> Caused by: java.lang.NoClassDefFoundError: 
> org/apache/hadoop/filecache/DistributedCache
>   at 
> org.apache.oozie.action.hadoop.SparkArgsExtractor.extract(SparkArgsExtractor.java:309)
>   at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:74)
>   at 
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
>   at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
>   ... 16 more
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.filecache.DistributedCache
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>   ... 20 more
> Failing Oozie Launcher, org/apache/hadoop/filecache/DistributedCache
> java.lang.NoClassDefFoundError: org/apache/hadoop/filecache/DistributedCache
>   at 
> org.apache.oozie.action.hadoop.SparkArgsExtractor.extract(SparkArgsExtractor.java:309)
>   at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:74)
>   at 
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
>   at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:412)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:56)
>   at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:225)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:219)
>   at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:142)
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.filecache.DistributedCache
>

[jira] [Updated] (OOZIE-3159) Spark Action fails because of absence of hadoop mapreduce jar(s)

2018-01-15 Thread Attila Sasvari (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-3159:
--
Attachment: (was: OOZIE-3159-001.patch)

> Spark Action fails because of absence of hadoop mapreduce jar(s)
> 
>
> Key: OOZIE-3159
> URL: https://issues.apache.org/jira/browse/OOZIE-3159
> Project: Oozie
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Attila Sasvari
>Priority: Blocker
> Fix For: 5.0.0b1
>
> Attachments: OOZIE-3159-001.patch
>
>
> OOZIE-2869 removed map reduce dependencies from getting added to Spark 
> action. Spark action uses 
> org.apache.hadoop.filecache.DistributedCache. It is not available anymore in 
> Spack action's classpath, causing it to fail.
> {code}
> java.lang.reflect.InvocationTargetException
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:412)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:56)
>   at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:225)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:219)
>   at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:142)
> Caused by: java.lang.NoClassDefFoundError: 
> org/apache/hadoop/filecache/DistributedCache
>   at 
> org.apache.oozie.action.hadoop.SparkArgsExtractor.extract(SparkArgsExtractor.java:309)
>   at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:74)
>   at 
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
>   at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
>   ... 16 more
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.filecache.DistributedCache
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>   ... 20 more
> Failing Oozie Launcher, org/apache/hadoop/filecache/DistributedCache
> java.lang.NoClassDefFoundError: org/apache/hadoop/filecache/DistributedCache
>   at 
> org.apache.oozie.action.hadoop.SparkArgsExtractor.extract(SparkArgsExtractor.java:309)
>   at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:74)
>   at 
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
>   at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:412)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:56)
>   at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:225)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:219)
>   at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:142)
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.filecache.Distribu

[jira] [Updated] (OOZIE-3159) Spark Action fails because of absence of hadoop mapreduce jar(s)

2018-01-15 Thread Attila Sasvari (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-3159:
--
Attachment: OOZIE-3159-002.patch

> Spark Action fails because of absence of hadoop mapreduce jar(s)
> 
>
> Key: OOZIE-3159
> URL: https://issues.apache.org/jira/browse/OOZIE-3159
> Project: Oozie
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Attila Sasvari
>Priority: Blocker
> Fix For: 5.0.0b1
>
> Attachments: OOZIE-3159-001.patch, OOZIE-3159-002.patch
>
>
> OOZIE-2869 removed map reduce dependencies from getting added to Spark 
> action. Spark action uses 
> org.apache.hadoop.filecache.DistributedCache. It is not available anymore in 
> Spack action's classpath, causing it to fail.
> {code}
> java.lang.reflect.InvocationTargetException
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:412)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:56)
>   at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:225)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:219)
>   at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:142)
> Caused by: java.lang.NoClassDefFoundError: 
> org/apache/hadoop/filecache/DistributedCache
>   at 
> org.apache.oozie.action.hadoop.SparkArgsExtractor.extract(SparkArgsExtractor.java:309)
>   at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:74)
>   at 
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
>   at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
>   ... 16 more
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.filecache.DistributedCache
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>   ... 20 more
> Failing Oozie Launcher, org/apache/hadoop/filecache/DistributedCache
> java.lang.NoClassDefFoundError: org/apache/hadoop/filecache/DistributedCache
>   at 
> org.apache.oozie.action.hadoop.SparkArgsExtractor.extract(SparkArgsExtractor.java:309)
>   at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:74)
>   at 
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
>   at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:412)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:56)
>   at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:225)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:219)
>   at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:142)
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.filecac

[jira] [Updated] (OOZIE-3159) Spark Action fails because of absence of hadoop mapreduce jar(s)

2018-01-16 Thread Attila Sasvari (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-3159:
--
Attachment: OOZIE-3159-003.patch

> Spark Action fails because of absence of hadoop mapreduce jar(s)
> 
>
> Key: OOZIE-3159
> URL: https://issues.apache.org/jira/browse/OOZIE-3159
> Project: Oozie
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Attila Sasvari
>Priority: Blocker
> Fix For: 5.0.0b1
>
> Attachments: OOZIE-3159-001.patch, OOZIE-3159-002.patch, 
> OOZIE-3159-003.patch
>
>
> OOZIE-2869 removed map reduce dependencies from getting added to Spark 
> action. Spark action uses 
> org.apache.hadoop.filecache.DistributedCache. It is not available anymore in 
> Spack action's classpath, causing it to fail.
> {code}
> java.lang.reflect.InvocationTargetException
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:412)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:56)
>   at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:225)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:219)
>   at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:142)
> Caused by: java.lang.NoClassDefFoundError: 
> org/apache/hadoop/filecache/DistributedCache
>   at 
> org.apache.oozie.action.hadoop.SparkArgsExtractor.extract(SparkArgsExtractor.java:309)
>   at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:74)
>   at 
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
>   at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
>   ... 16 more
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.filecache.DistributedCache
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>   ... 20 more
> Failing Oozie Launcher, org/apache/hadoop/filecache/DistributedCache
> java.lang.NoClassDefFoundError: org/apache/hadoop/filecache/DistributedCache
>   at 
> org.apache.oozie.action.hadoop.SparkArgsExtractor.extract(SparkArgsExtractor.java:309)
>   at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:74)
>   at 
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
>   at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:412)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:56)
>   at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:225)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:219)
>   at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:142)
> Caused by: java.lang.ClassNotFoundException: 
>

[jira] [Updated] (OOZIE-3159) Spark Action fails because of absence of hadoop mapreduce jar(s)

2018-01-17 Thread Attila Sasvari (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-3159:
--
Attachment: OOZIE-3159-004.patch

> Spark Action fails because of absence of hadoop mapreduce jar(s)
> 
>
> Key: OOZIE-3159
> URL: https://issues.apache.org/jira/browse/OOZIE-3159
> Project: Oozie
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Attila Sasvari
>Priority: Blocker
> Fix For: 5.0.0b1
>
> Attachments: OOZIE-3159-001.patch, OOZIE-3159-002.patch, 
> OOZIE-3159-003.patch, OOZIE-3159-004.patch
>
>
> OOZIE-2869 removed map reduce dependencies from getting added to Spark 
> action. Spark action uses 
> org.apache.hadoop.filecache.DistributedCache. It is not available anymore in 
> Spack action's classpath, causing it to fail.
> {code}
> java.lang.reflect.InvocationTargetException
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:412)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:56)
>   at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:225)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:219)
>   at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:142)
> Caused by: java.lang.NoClassDefFoundError: 
> org/apache/hadoop/filecache/DistributedCache
>   at 
> org.apache.oozie.action.hadoop.SparkArgsExtractor.extract(SparkArgsExtractor.java:309)
>   at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:74)
>   at 
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
>   at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
>   ... 16 more
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.filecache.DistributedCache
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>   ... 20 more
> Failing Oozie Launcher, org/apache/hadoop/filecache/DistributedCache
> java.lang.NoClassDefFoundError: org/apache/hadoop/filecache/DistributedCache
>   at 
> org.apache.oozie.action.hadoop.SparkArgsExtractor.extract(SparkArgsExtractor.java:309)
>   at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:74)
>   at 
> org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:101)
>   at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:412)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:56)
>   at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:225)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:219)
>   at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:142)
> Caused by: java.lang.Class