[
https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16451653#comment-16451653
]
Jungtaek Lim commented on SPARK-24036:
--------------------------------------
Hello, I'm quite interested to this issue since I just read the codebase in
recent change of continuous mode and observed same limitations.
Do you have ideas or any design docs for this? Moreover do you plan to share
these tasks with Spark community? Willing to contribute on this side, but
that's completely OK if you plan to drive whole tasks from your own.
> Stateful operators in continuous processing
> -------------------------------------------
>
> Key: SPARK-24036
> URL: https://issues.apache.org/jira/browse/SPARK-24036
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 2.4.0
> Reporter: Jose Torres
> Priority: Major
>
> The first iteration of continuous processing in Spark 2.3 does not work with
> stateful operators.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
