[
https://issues.apache.org/jira/browse/SPARK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875198#comment-16875198
]
Jungtaek Lim commented on SPARK-28192:
--------------------------------------
Totally interested! Once I decide to implement this with DSv2, SPARK-23889 is a
blocker for this issue, so the sooner the better. If SPARK-23889 is somewhat
requiring huge efforts and could become a blocker for Spark 3.0 then I could
wait or try to go ahead with DSv1.
SPARK-23889 is filed one year ago (with discussion prior to filing issue), so
maybe better to take it sooner.
> Data Source - State - Write side
> --------------------------------
>
> Key: SPARK-28192
> URL: https://issues.apache.org/jira/browse/SPARK-28192
> Project: Spark
> Issue Type: Sub-task
> Components: Structured Streaming
> Affects Versions: 3.0.0
> Reporter: Jungtaek Lim
> Priority: Major
>
> This issue tracks the efforts on addressing batch write on state data source.
> It could include "state repartition" if it doesn't require huge effort for
> new DSv2, but it can be also move out to separate issue.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
