This is an automated email from the ASF dual-hosted git repository.
srowen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 4023ec9bb44 [SPARK-45484][SQL][FOLLOWUP][DOCS] Update the document of
parquet compression codec
4023ec9bb44 is described below
commit 4023ec9bb4471efee36afcec041c114a4b86a2c8
Author: Jiaan Geng <belie...@163.com>
AuthorDate: Sat Oct 21 16:39:13 2023 -0500
[SPARK-45484][SQL][FOLLOWUP][DOCS] Update the document of parquet
compression codec
### What changes were proposed in this pull request?
This PR follows up https://github.com/apache/spark/pull/43310 to update the
document of parquet compression codec.
### Why are the changes needed?
Update the document of parquet compression codec.
### Does this PR introduce _any_ user-facing change?
'No'.
### How was this patch tested?
N/A
### Was this patch authored or co-authored using generative AI tooling?
'No'.
Closes #43464 from beliefer/SPARK-45484_followup.
Authored-by: Jiaan Geng <belie...@163.com>
Signed-off-by: Sean Owen <sro...@gmail.com>
---
docs/sql-data-sources-parquet.md | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/docs/sql-data-sources-parquet.md b/docs/sql-data-sources-parquet.md
index 925e47504e5..c2af58248ea 100644
--- a/docs/sql-data-sources-parquet.md
+++ b/docs/sql-data-sources-parquet.md
@@ -423,7 +423,7 @@ Data source options of Parquet can be set via:
<tr>
<td><code>compression</code></td>
<td><code>snappy</code></td>
- <td>Compression codec to use when saving to file. This can be one of the
known case-insensitive shorten names (none, uncompressed, snappy, gzip, lzo,
brotli, lz4, and zstd). This will override
<code>spark.sql.parquet.compression.codec</code>.</td>
+ <td>Compression codec to use when saving to file. This can be one of the
known case-insensitive shorten names (none, uncompressed, snappy, gzip, lzo,
brotli, lz4, lz4_raw, and zstd). This will override
<code>spark.sql.parquet.compression.codec</code>.</td>
<td>write</td>
</tr>
</table>
@@ -484,7 +484,7 @@ Configuration of Parquet can be done using the `setConf`
method on `SparkSession
Sets the compression codec used when writing Parquet files. If either
<code>compression</code> or
<code>parquet.compression</code> is specified in the table-specific
options/properties, the precedence would be
<code>compression</code>, <code>parquet.compression</code>,
<code>spark.sql.parquet.compression.codec</code>. Acceptable values include:
- none, uncompressed, snappy, gzip, lzo, brotli, lz4, zstd.
+ none, uncompressed, snappy, gzip, lzo, brotli, lz4, lz4_raw, zstd.
Note that <code>brotli</code> requires <code>BrotliCodec</code> to be
installed.
</td>
<td>1.1.1</td>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
