[
https://issues.apache.org/jira/browse/OOZIE-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320751#comment-14320751
]
Robert Kanter commented on OOZIE-2071:
--------------------------------------
The version thing is fine; we just have to be careful about updating it.
With Hadoop 1, I still get the NoSuchMethodError on slf4j that I posted earlier.
Hadoop 2 looks like it works, though I do see this message in stderr; is this
important?
{noformat}
Warning: Skip remote jar
hdfs://localhost:8020/user/rkanter/examples/apps/spark/lib/oozie-examples-4.2.0-SNAPSHOT.jar.
{noformat}
I'm wondering if it's just incompatible with Hadoop 1. Perhaps this action
should just not be supported on Hadoop 1? I think that's fine as long as we
make it very clear in the documentation. Maybe even make the sharelib not
include spark if you build against Hadoop 1 (unless that greatly complicates
the build). [~shwethags], what do you think?
> Add a Spark example
> -------------------
>
> Key: OOZIE-2071
> URL: https://issues.apache.org/jira/browse/OOZIE-2071
> Project: Oozie
> Issue Type: Task
> Components: examples
> Affects Versions: trunk
> Reporter: Robert Kanter
> Assignee: pavan kumar kolamuri
> Fix For: trunk
>
> Attachments: OOZIE-2071-v1.patch, OOZIE-2071-v2.patch,
> OOZIE-2071.patch
>
>
> With the new Spark action, we should have a Spark example workflow that runs
> some Spark job.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
