Github user HeartSaVioR commented on a diff in the pull request:
https://github.com/apache/spark/pull/21222#discussion_r205961782
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/debug/package.scala ---
@@ -116,6 +175,30 @@ package object debug {
}
}
+ implicit class DebugStreamQuery(query: StreamingQuery) extends Logging {
+ def debug(): Unit = {
+ unwrapStreamingQueryWrapper(query) match {
+ case w: StreamExecution =>
+ if (w.lastExecution == null) {
+ debugPrint("No physical plan. Waiting for data.")
+ } else {
+ val executedPlan = w.lastExecution.executedPlan
+ if
(executedPlan.find(_.isInstanceOf[WriteToContinuousDataSourceExec]).isDefined) {
+ debugPrint("Debug on continuous mode is not supported.")
--- End diff --
`debug()` will run query shortly to collect information: for micro-batch it
will be 1 batch but in continuous mode it will never be finished.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
