[ 
https://issues.apache.org/jira/browse/SPARK-28192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875046#comment-16875046
 ] 

Ryan Blue commented on SPARK-28192:
-----------------------------------

It sounds like what you want is for a source to be able to communicate the 
required clustering and sort order for a write, is that correct?

I opened an issue for this a while ago, but it probably won't be on the roadmap 
for Spark 3.0: SPARK-23889. We can do that sooner if you're interested in it!

> Data Source - State - Write side
> --------------------------------
>
>                 Key: SPARK-28192
>                 URL: https://issues.apache.org/jira/browse/SPARK-28192
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Structured Streaming
>    Affects Versions: 3.0.0
>            Reporter: Jungtaek Lim
>            Priority: Major
>
> This issue tracks the efforts on addressing batch write on state data source.
> It could include "state repartition" if it doesn't require huge effort for 
> new DSv2, but it can be also move out to separate issue.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to