[
https://issues.apache.org/jira/browse/FALCON-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15193261#comment-15193261
]
Peeyush Bishnoi commented on FALCON-1763:
-----------------------------------------
Please refer the attached document that will provide the details and approach
to create a spark execution engine in Falcon. Please review and provide
suggestions to enhance it further.
> Create a spark execution engine for Falcon
> ------------------------------------------
>
> Key: FALCON-1763
> URL: https://issues.apache.org/jira/browse/FALCON-1763
> Project: Falcon
> Issue Type: Bug
> Reporter: Venkat Ranganathan
> Assignee: Peeyush Bishnoi
> Attachments: SparkexecutionenginewithFalcon.pdf
>
>
> It would be great to get a spark execution engine for Falcon along with the
> existing Oozie wf, Pig and Hive support. This will greatly help in easing
> the use of Spark jobs to use with Falcon data management.
> We should make sure that this support works with all Falcon deployment modes
> (embedded, distributed, secure, non secure) and also diffrenent Spark
> application modes(standalone, yarn client, yarn standalone etc)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)