[
https://issues.apache.org/jira/browse/IMPALA-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Quanlong Huang updated IMPALA-8210:
-----------------------------------
Description:
It'd be quite helpful if Impala can read/write some tiny
RDBMS(MySQL/PostgreSQL/SQLServer) tables. Parallelism or efficiency can be
ignored since the target tables are all tiny. Some use cases:
* Some dimension tables in Hive are snapshots of RDBMS tables. Users want to
query the difference between the snapshot in Hive and the latest data in RDBMS.
* Users want to run queries joining Hive fact tables and the latest data in
RDBMS.
* Users hope their query results can be ingested into MySQL directly
Implement an "External Data Source" as a generic JDBC wrapper for RDBMS data
sources could be a solution. The drawback is that "External Data Source"
requires users to create tables in Impala for each RDBMS table they want to
access. Users can't list tables (show tables) of a schema(database).
There're other solutions that support RDBMS directly. For example
[https://www.slideshare.net/liuknag/cloudera-impala-postgre-sql-29025605]
was:
It'd be quite helpful if Impala can read/write some tiny
RDBMS(MySQL/Postgres/SQLServer) tables. Parallelism or efficiency can be
ignored since the target tables are all tiny. Some use cases:
* Some dimension tables in Hive are snapshots of RDBMS tables. Users want to
query the difference between the snapshot in Hive and the latest data in RDBMS.
* Users want to run queries joining Hive fact tables and the latest data in
RDBMS.
* Users hope their query results can be ingested into MySQL directly
Implement an "External Data Source" as a generic JDBC wrapper for RDBMS data
sources could be a solution. The drawback is that "External Data Source"
requires users to create tables in Impala for each RDBMS table they want to
access. Users can't list tables (show tables) of a schema(database).
There're other solutions that support RDBMS directly. For example
https://www.slideshare.net/liuknag/cloudera-impala-postgre-sql-29025605
> Support reading/writing tiny RDBMS tables
> -----------------------------------------
>
> Key: IMPALA-8210
> URL: https://issues.apache.org/jira/browse/IMPALA-8210
> Project: IMPALA
> Issue Type: New Feature
> Reporter: Quanlong Huang
> Priority: Major
>
> It'd be quite helpful if Impala can read/write some tiny
> RDBMS(MySQL/PostgreSQL/SQLServer) tables. Parallelism or efficiency can be
> ignored since the target tables are all tiny. Some use cases:
> * Some dimension tables in Hive are snapshots of RDBMS tables. Users want to
> query the difference between the snapshot in Hive and the latest data in
> RDBMS.
> * Users want to run queries joining Hive fact tables and the latest data in
> RDBMS.
> * Users hope their query results can be ingested into MySQL directly
> Implement an "External Data Source" as a generic JDBC wrapper for RDBMS data
> sources could be a solution. The drawback is that "External Data Source"
> requires users to create tables in Impala for each RDBMS table they want to
> access. Users can't list tables (show tables) of a schema(database).
> There're other solutions that support RDBMS directly. For example
> [https://www.slideshare.net/liuknag/cloudera-impala-postgre-sql-29025605]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
