[
https://issues.apache.org/jira/browse/SPARK-39422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-39422:
-------------------------------
Description:
If you run `SHOW CREATE TABLE` against a Hive table which uses an unsupported
Serde configuration, Spark will return an error message like
{code:java}
org.apache.spark.sql.AnalysisException: Failed to execute SHOW CREATE TABLE
against table rcFileTable, which is created by Hive and uses the following
unsupported serde configuration
SERDE: org.apache.hadoop.hive.serde2.columnar.LazyBinaryColumnarSerDe
INPUTFORMAT: org.apache.hadoop.hive.ql.io.RCFileInputFormat OUTPUTFORMAT:
org.apache.hadoop.hive.ql.io.RCFileOutputFormat {code}
which is confusing to end users.
In this situation, I think the error should suggest `SHOW CREATE TABLE ... AS
SERDE` to users (similar to other error messages in this code path).
> SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with unsupported
> serde configurations
> -------------------------------------------------------------------------------------------------
>
> Key: SPARK-39422
> URL: https://issues.apache.org/jira/browse/SPARK-39422
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Josh Rosen
> Assignee: Josh Rosen
> Priority: Major
>
> If you run `SHOW CREATE TABLE` against a Hive table which uses an unsupported
> Serde configuration, Spark will return an error message like
> {code:java}
> org.apache.spark.sql.AnalysisException: Failed to execute SHOW CREATE TABLE
> against table rcFileTable, which is created by Hive and uses the following
> unsupported serde configuration
> SERDE: org.apache.hadoop.hive.serde2.columnar.LazyBinaryColumnarSerDe
> INPUTFORMAT: org.apache.hadoop.hive.ql.io.RCFileInputFormat OUTPUTFORMAT:
> org.apache.hadoop.hive.ql.io.RCFileOutputFormat {code}
> which is confusing to end users.
> In this situation, I think the error should suggest `SHOW CREATE TABLE ... AS
> SERDE` to users (similar to other error messages in this code path).
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
