Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/20097#discussion_r159114244
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MicroBatchExecution.scala
---
@@ -192,7 +212,8 @@ class MicroBatchExecution(
source.getBatch(start, end)
}
case nonV1Tuple =>
- throw new IllegalStateException(s"Unexpected V2 source
in $nonV1Tuple")
+ // The V2 API does not have the same weird edge case -
we don't need to do
+ // anything here.
--- End diff --
// ... does not have the edge case that require getBatch() to be called
(see comments above)...
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
