[
https://issues.apache.org/jira/browse/SPARK-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14731556#comment-14731556
]
Tathagata Das commented on SPARK-8630:
--------------------------------------
I get your point. I guess it will be good to revert this patch and just
generate a WARNING.
A more principled solution would be allow users to separately enable RDD
checkpointing and DStream checkpointing, so that they can only enable RDD
checkpointing and keep DStream checkpointing disabled (for queueStream to work).
> Prevent from checkpointing QueueInputDStream
> --------------------------------------------
>
> Key: SPARK-8630
> URL: https://issues.apache.org/jira/browse/SPARK-8630
> Project: Spark
> Issue Type: Improvement
> Components: Streaming
> Reporter: Shixiong Zhu
> Assignee: Shixiong Zhu
> Fix For: 1.4.1, 1.5.0
>
>
> It's better to prevent from checkpointing QueueInputDStream rather than
> failing the application when recovering `QueueInputDStream`, so that people
> can find the issue as soon as possible. See SPARK-8553 for example.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
