This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new fa0c9954aa4d [SPARK-50614][SQL] Fix shredding debug message
fa0c9954aa4d is described below
commit fa0c9954aa4d4281c31aaaf26b94e699699bb469
Author: cashmand <[email protected]>
AuthorDate: Fri Jan 3 09:10:42 2025 +0800
[SPARK-50614][SQL] Fix shredding debug message
### What changes were proposed in this pull request?
A debug message added in https://github.com/apache/spark/pull/49234 was
missing a brace. As a result, the message was printing the non-pretty string
representation of the struct, followed by the string `.prettyJson}`. This PR
fixes it.
### Why are the changes needed?
Cleaner debug messages.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manually verified in spark-shell that the message looks wrong without the
change, and correct with the change.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #49345 from cashmand/fix_debug_msg.
Authored-by: cashmand <[email protected]>
Signed-off-by: Wenchen Fan <[email protected]>
---
.../spark/sql/execution/datasources/parquet/ParquetWriteSupport.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetWriteSupport.scala
b/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetWriteSupport.scala
index 9402f5638094..02b432f98d7d 100644
---
a/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetWriteSupport.scala
+++
b/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetWriteSupport.scala
@@ -158,7 +158,7 @@ class ParquetWriteSupport extends WriteSupport[InternalRow]
with Logging {
s"""Initialized Parquet WriteSupport with Catalyst schema:
|${schema.prettyJson}
|and shredding schema:
- |$shreddedSchema.prettyJson}
+ |${shreddedSchema.prettyJson}
|and corresponding Parquet message type:
|$messageType
""".stripMargin)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
