Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21837#discussion_r204609385
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -1430,6 +1431,18 @@ object SQLConf {
"This only takes effect when spark.sql.repl.eagerEval.enabled is set
to true.")
.intConf
.createWithDefault(20)
+
+ val AVRO_COMPRESSION_CODEC =
buildConf("spark.sql.avro.compression.codec")
+ .doc("Compression codec used in writing of AVRO files.")
+ .stringConf
+ .createWithDefault("snappy")
+
+ val AVRO_DEFLATE_LEVEL = buildConf("spark.sql.avro.deflate.level")
+ .doc("Compression level for the deflate codec used in writing of AVRO
files. " +
+ "Valid value must be in the range of from 1 to 9 inclusive. " +
--- End diff --
This can be -1 right (https://www.zlib.net/manual.html)?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
