viirya commented on code in PR #55637:
URL: https://github.com/apache/spark/pull/55637#discussion_r3172345775
##########
sql/api/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala:
##########
@@ -131,6 +131,30 @@ abstract class DataStreamReader {
* .changes("my_table")
* }}}
*
+ * Streaming reads support all of the same post-processing as batch reads --
`computeUpdates`,
Review Comment:
The PR body notes that TransformWithState requires RocksDB, but the
changes() Scaladoc says streaming supports all post-processing without
mentioning that the default state store will fail at query start. Since this is
an analyzer-injected operator rather than user-written transformWithState,
users have little reason to know they must set the RocksDB provider.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
