This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.1
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.1 by this push:
new c3bd91f4 [SPARK-33693][SQL] deprecate spark.sql.hive.convertCTAS
c3bd91f4 is described below
commit c3bd91f47a52e20530740bba895522d4b25ba66c
Author: Wenchen Fan <wenc...@databricks.com>
AuthorDate: Mon Dec 7 10:50:31 2020 -0800
[SPARK-33693][SQL] deprecate spark.sql.hive.convertCTAS
### What changes were proposed in this pull request?
This is a followup of https://github.com/apache/spark/pull/30554 . Now we
have a new config for converting CREATE TABLE, we don't need the old config
that only works for CTAS.
### Why are the changes needed?
It's confusing for having two config while one can cover another completely.
### Does this PR introduce _any_ user-facing change?
no, it's deprecating not removing.
### How was this patch tested?
N/A
Closes #30651 from cloud-fan/minor.
Authored-by: Wenchen Fan <wenc...@databricks.com>
Signed-off-by: Dongjoon Hyun <dongj...@apache.org>
(cherry picked from commit 6aff215077e2cdf9cec187c827da63c067514e4e)
Signed-off-by: Dongjoon Hyun <dongj...@apache.org>
---
.../src/main/scala/org/apache/spark/sql/internal/SQLConf.scala | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git
a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
index ea301ad..82df22b 100644
--- a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
+++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
@@ -2997,7 +2997,9 @@ object SQLConf {
s"Use '${ADVISORY_PARTITION_SIZE_IN_BYTES.key}' instead of it."),
DeprecatedConfig(OPTIMIZER_METADATA_ONLY.key, "3.0",
"Avoid to depend on this optimization to prevent a potential
correctness issue. " +
- "If you must use, use 'SparkSessionExtensions' instead to inject it
as a custom rule.")
+ "If you must use, use 'SparkSessionExtensions' instead to inject it
as a custom rule."),
+ DeprecatedConfig(CONVERT_CTAS.key, "3.1",
+ s"Set '${LEGACY_CREATE_HIVE_TABLE_BY_DEFAULT.key}' to false instead.")
)
Map(configs.map { cfg => cfg.key -> cfg } : _*)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
