[jira] [Assigned] (SPARK-16119) Support "DROP TABLE ... PURGE" if Hive client supports it
[
https://issues.apache.org/jira/browse/SPARK-16119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-16119:
Assignee: (was: Apache Spark)
> Support "DROP TABLE ... PURGE" if Hive client supports it
> -
>
> Key: SPARK-16119
> URL: https://issues.apache.org/jira/browse/SPARK-16119
> Project: Spark
> Issue Type: Improvement
> Components: SQL
>Affects Versions: 2.0.0
>Reporter: Marcelo Vanzin
>
> There's currently code that explicitly disables the "PURGE" flag when
> dropping a table:
> {code}
> if (ctx.PURGE != null) {
> throw operationNotAllowed("DROP TABLE ... PURGE", ctx)
> }
> {code}
> That flag is necessary in certain situations where the table data cannot be
> moved to the trash (which will be tried unless "PURGE" is requested). If the
> client supports it (Hive >= 0.14.0 according to the Hive docs), we should
> allow that option to be defined.
> For non-Hive tables, as far as I can understand, "PURGE" is the current
> behavior of Spark.
> The same limitation exists currently for "ALTER TABLE ... DROP PARTITION" so
> should probably also be covered by this change.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-16119) Support "DROP TABLE ... PURGE" if Hive client supports it
[
https://issues.apache.org/jira/browse/SPARK-16119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-16119:
Assignee: Apache Spark
> Support "DROP TABLE ... PURGE" if Hive client supports it
> -
>
> Key: SPARK-16119
> URL: https://issues.apache.org/jira/browse/SPARK-16119
> Project: Spark
> Issue Type: Improvement
> Components: SQL
>Affects Versions: 2.0.0
>Reporter: Marcelo Vanzin
>Assignee: Apache Spark
>
> There's currently code that explicitly disables the "PURGE" flag when
> dropping a table:
> {code}
> if (ctx.PURGE != null) {
> throw operationNotAllowed("DROP TABLE ... PURGE", ctx)
> }
> {code}
> That flag is necessary in certain situations where the table data cannot be
> moved to the trash (which will be tried unless "PURGE" is requested). If the
> client supports it (Hive >= 0.14.0 according to the Hive docs), we should
> allow that option to be defined.
> For non-Hive tables, as far as I can understand, "PURGE" is the current
> behavior of Spark.
> The same limitation exists currently for "ALTER TABLE ... DROP PARTITION" so
> should probably also be covered by this change.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
