This is an automated email from the ASF dual-hosted git repository. viirya pushed a change to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git.
from ab80d3c [SPARK-35027][CORE] Close the inputStream in FileAppender when writin… add 86d1fb4 [SPARK-36030][SQL] Support DS v2 metrics at writing path No new revisions were added by this update. Summary of changes: .../org/apache/spark/sql/connector/read/Scan.java | 3 +- .../spark/sql/connector/write/DataWriter.java | 9 ++ .../apache/spark/sql/connector/write/Write.java | 9 ++ .../sql/connector/catalog/InMemoryTable.scala | 22 +++++ .../datasources/FileFormatDataWriter.scala | 51 ++++++++--- .../datasources/v2/DataSourceV2Strategy.scala | 8 +- .../datasources/v2/WriteToDataSourceV2Exec.scala | 36 +++++++- .../spark/sql/execution/metric/CustomMetrics.scala | 5 +- .../execution/streaming/MicroBatchExecution.scala | 4 +- .../sql/execution/streaming/StreamExecution.scala | 6 +- .../streaming/continuous/ContinuousExecution.scala | 6 +- .../streaming/continuous/ContinuousWriteRDD.scala | 11 ++- .../continuous/WriteToContinuousDataSource.scala | 4 +- .../WriteToContinuousDataSourceExec.scala | 11 ++- .../sources/WriteToMicroBatchDataSource.scala | 6 +- .../sql/connector/SimpleWritableDataSource.scala | 8 +- .../FileFormatDataWriterMetricSuite.scala | 96 +++++++++++++++++++ .../datasources/InMemoryTableMetricSuite.scala | 96 +++++++++++++++++++ .../sql/execution/metric/CustomMetricsSuite.scala | 10 +- .../execution/ui/SQLAppStatusListenerSuite.scala | 102 ++++++++++++++++++++- 20 files changed, 456 insertions(+), 47 deletions(-) create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileFormatDataWriterMetricSuite.scala create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/InMemoryTableMetricSuite.scala --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org