[jira] [Assigned] (SPARK-24159) Enable no-data micro batches for streaming mapGroupswithState

2018-05-18 Thread Shixiong Zhu (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-24159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shixiong Zhu reassigned SPARK-24159:


Assignee: Tathagata Das

> Enable no-data micro batches for streaming mapGroupswithState
> -
>
> Key: SPARK-24159
> URL: https://issues.apache.org/jira/browse/SPARK-24159
> Project: Spark
>  Issue Type: Sub-task
>  Components: Structured Streaming
>Affects Versions: 2.3.0
>Reporter: Tathagata Das
>Assignee: Tathagata Das
>Priority: Major
> Fix For: 2.4.0
>
>
> When event-time timeout is enabled, then use watermark updates to decide 
> whether to run another batch
> When processing-time timeout is enabled, then use the processing time and to 
> decide when to run more batches.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Assigned] (SPARK-24159) Enable no-data micro batches for streaming mapGroupswithState

2018-05-16 Thread Apache Spark (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-24159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apache Spark reassigned SPARK-24159:


Assignee: (was: Apache Spark)

> Enable no-data micro batches for streaming mapGroupswithState
> -
>
> Key: SPARK-24159
> URL: https://issues.apache.org/jira/browse/SPARK-24159
> Project: Spark
>  Issue Type: Sub-task
>  Components: Structured Streaming
>Affects Versions: 2.3.0
>Reporter: Tathagata Das
>Priority: Major
>
> When event-time timeout is enabled, then use watermark updates to decide 
> whether to run another batch
> When processing-time timeout is enabled, then use the processing time and to 
> decide when to run more batches.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Assigned] (SPARK-24159) Enable no-data micro batches for streaming mapGroupswithState

2018-05-16 Thread Apache Spark (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-24159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apache Spark reassigned SPARK-24159:


Assignee: Apache Spark

> Enable no-data micro batches for streaming mapGroupswithState
> -
>
> Key: SPARK-24159
> URL: https://issues.apache.org/jira/browse/SPARK-24159
> Project: Spark
>  Issue Type: Sub-task
>  Components: Structured Streaming
>Affects Versions: 2.3.0
>Reporter: Tathagata Das
>Assignee: Apache Spark
>Priority: Major
>
> When event-time timeout is enabled, then use watermark updates to decide 
> whether to run another batch
> When processing-time timeout is enabled, then use the processing time and to 
> decide when to run more batches.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org