[
https://issues.apache.org/jira/browse/OOZIE-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288391#comment-14288391
]
Robert Kanter commented on OOZIE-2071:
--------------------------------------
[~pavan kumar], I was talking with one of our Spark devs ([~vanzin]), and he
was saying that we should not depend on {{spark-examples_2.10}} or
{{spark-repl_2.10}}. It's not a good idea to depend on {{spark-examples_2.10}}
in case they change things and it would break Oozie; in fact, in Spark 1.2.0
they removed it. Can you write your own sample Spark job? It doesn't have to
do anything fancy. {{TestSparkMain}} would also need to be updated to not use
{{spark-examples_2.10}}, but you can re-use the same sample job.
{{spark-repl_2.10}} has no public APIs, and I don't see any code in Oozie
referencing it; Oozie still compiles when I remove it, so I think we can simply
delete this.
> Add a Spark example
> -------------------
>
> Key: OOZIE-2071
> URL: https://issues.apache.org/jira/browse/OOZIE-2071
> Project: Oozie
> Issue Type: Task
> Components: examples
> Affects Versions: trunk
> Reporter: Robert Kanter
> Assignee: pavan kumar kolamuri
> Fix For: trunk
>
> Attachments: OOZIE-2071-v1.patch, OOZIE-2071.patch
>
>
> With the new Spark action, we should have a Spark example workflow that runs
> some Spark job.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
