[jira] [Commented] (SPARK-38443) Document config STREAMING_SESSION_WINDOW_MERGE_SESSIONS_IN_LOCAL_PARTITION

2022-03-07 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-38443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502780#comment-17502780
 ] 

Apache Spark commented on SPARK-38443:
--

User 'viirya' has created a pull request for this issue:
https://github.com/apache/spark/pull/35762

> Document config STREAMING_SESSION_WINDOW_MERGE_SESSIONS_IN_LOCAL_PARTITION
> --
>
> Key: SPARK-38443
> URL: https://issues.apache.org/jira/browse/SPARK-38443
> Project: Spark
>  Issue Type: Improvement
>  Components: Structured Streaming
>Affects Versions: 3.3.0
>Reporter: L. C. Hsieh
>Priority: Minor
>
> We have use case the customer faces issue on large shuffle write in session 
> window. The config is hidden, although it is useful for such case. We should 
> document it so end users can find it easily.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-38443) Document config STREAMING_SESSION_WINDOW_MERGE_SESSIONS_IN_LOCAL_PARTITION

2022-03-07 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-38443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502779#comment-17502779
 ] 

Apache Spark commented on SPARK-38443:
--

User 'viirya' has created a pull request for this issue:
https://github.com/apache/spark/pull/35762

> Document config STREAMING_SESSION_WINDOW_MERGE_SESSIONS_IN_LOCAL_PARTITION
> --
>
> Key: SPARK-38443
> URL: https://issues.apache.org/jira/browse/SPARK-38443
> Project: Spark
>  Issue Type: Improvement
>  Components: Structured Streaming
>Affects Versions: 3.3.0
>Reporter: L. C. Hsieh
>Priority: Minor
>
> We have use case the customer faces issue on large shuffle write in session 
> window. The config is hidden, although it is useful for such case. We should 
> document it so end users can find it easily.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org