[
https://issues.apache.org/jira/browse/SPARK-31241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358148#comment-17358148
]
Dabao commented on SPARK-31241:
-------------------------------
Hi, Jacky
We’re now working on a project using DataSourceV2 to provide multiple source
support. Is there any new progress in the current issue? And could you provide
any doc for current design, so that we can discuss and improve it in detail ?
> Support Hive on DataSourceV2
> ----------------------------
>
> Key: SPARK-31241
> URL: https://issues.apache.org/jira/browse/SPARK-31241
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.1.0
> Reporter: Jackey Lee
> Priority: Major
>
> There are 3 reasons why we need to support Hive on DataSourceV2.
> 1. Hive itself is one of Spark data sources.
> 2. HiveTable is essentially a FileTable with its own input and output
> formats, it works fine with FileTable.
> 3. HiveTable should be stateless, and users can freely read or write Hive
> using batch or microbatch.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
