[
https://issues.apache.org/jira/browse/SPARK-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848881#comment-16848881
]
Xianyin Xin commented on SPARK-15348:
-------------------------------------
The starting point (or goal) of Delta Lake is not ACID, but "Data Lake", and
ACID is just one of its features. The ACID designs between hive and delta is
very different, both have pros and cons. However, hive table and delta table
are two datasources in spark's perspective, so a pluggable ACID support for
different datasources within one framework is a choice. Maybe datasource V2 API
can handle this.
> Hive ACID
> ---------
>
> Key: SPARK-15348
> URL: https://issues.apache.org/jira/browse/SPARK-15348
> Project: Spark
> Issue Type: New Feature
> Components: SQL
> Affects Versions: 1.6.3, 2.0.2, 2.1.2, 2.2.0, 2.3.0
> Reporter: Ran Haim
> Priority: Major
>
> Spark does not support any feature of hive's transnational tables,
> you cannot use spark to delete/update a table and it also has problems
> reading the aggregated data when no compaction was done.
> Also it seems that compaction is not supported - alter table ... partition
> .... COMPACT 'major'
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
