Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21701
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/21701#discussion_r201071243
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/WatermarkTracker.scala
---
@@ -20,15 +20,66 @@ package
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/21701#discussion_r200771488
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/OffsetSeq.scala
---
@@ -115,8 +130,20 @@ object OffsetSeqMetadata extends
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/21701#discussion_r200761267
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -875,6 +875,16 @@ object SQLConf {
.stringConf
GitHub user tdas opened a pull request:
https://github.com/apache/spark/pull/21701
[SPARK-24730][SS] Add policy to choose max as global watermark when
streaming query has multiple watermarks
## What changes were proposed in this pull request?
Currently, when a streaming