[spark] branch branch-3.3 updated: [SPARK-40983][DOC] Remove Hadoop requirements for zstd mentioned in Parquet compression codec

[yumwang]

This is an automated email from the ASF dual-hosted git repository.

yumwang pushed a commit to branch branch-3.3
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.3 by this push:
     new 33321cf31cb [SPARK-40983][DOC] Remove Hadoop requirements for zstd 
mentioned in Parquet compression codec
33321cf31cb is described below

commit 33321cf31cba9a9f8666f95dffb8d250898f2050
Author: Cheng Pan <cheng...@apache.org>
AuthorDate: Tue Nov 1 20:32:37 2022 +0800

    [SPARK-40983][DOC] Remove Hadoop requirements for zstd mentioned in Parquet 
compression codec
    
    ### What changes were proposed in this pull request?
    
    Change the doc to remove Hadoop requirements for zstd mentioned in Parquet 
compression codec.
    
    ### Why are the changes needed?
    
    This requirement is removed after 
https://issues.apache.org/jira/browse/PARQUET-1866, and Spark uses Parquet 
1.12.3 now.
    
    ### Does this PR introduce _any_ user-facing change?
    
    Yes, doc updated.
    
    ### How was this patch tested?
    
    <img width="1144" alt="image" 
src="https://user-images.githubusercontent.com/26535726/199180625-4e3a2ee1-3e4d-4d61-8842-f1d5b7b9321d.png";>
    
    Closes #38458 from pan3793/SPARK-40983.
    
    Authored-by: Cheng Pan <cheng...@apache.org>
    Signed-off-by: Yuming Wang <yumw...@ebay.com>
    (cherry picked from commit 9c1bb41ca34229c87b463b4941b4e9c829a0e396)
    Signed-off-by: Yuming Wang <yumw...@ebay.com>
---
 docs/sql-data-sources-parquet.md | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)

diff --git a/docs/sql-data-sources-parquet.md b/docs/sql-data-sources-parquet.md
index 0d97baf1e3a..2e497a4b750 100644
--- a/docs/sql-data-sources-parquet.md
+++ b/docs/sql-data-sources-parquet.md
@@ -404,8 +404,7 @@ Configuration of Parquet can be done using the `setConf` 
method on `SparkSession
     <code>parquet.compression</code> is specified in the table-specific 
options/properties, the precedence would be
     <code>compression</code>, <code>parquet.compression</code>, 
<code>spark.sql.parquet.compression.codec</code>. Acceptable values include:
     none, uncompressed, snappy, gzip, lzo, brotli, lz4, zstd.
-    Note that <code>zstd</code> requires <code>ZStandardCodec</code> to be 
installed before Hadoop 2.9.0, <code>brotli</code> requires
-    <code>BrotliCodec</code> to be installed.
+    Note that <code>brotli</code> requires <code>BrotliCodec</code> to be 
installed.
   </td>
   <td>1.1.1</td>
 </tr>


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org