jackye1995 opened a new pull request #2549:
URL: https://github.com/apache/iceberg/pull/2549
@pvary @yyanyy adding the AWS module to the Hie runtime jar. Verified with
EMR 6.3.0 (Hive 3.1.2) that I can create external Glue type table and query
successfully:
```
0: jdbc:hive2://localhost:10000> CREATE EXTERNAL TABLE db10.sample234
. . . . . . . . . . . . . . . .> STORED BY
'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler'
. . . . . . . . . . . . . . . .> TBLPROPERTIES ('iceberg.catalog'='glue');
INFO : Compiling
command(queryId=hive_20210503024236_8bdfc3e3-6b80-4731-a5d8-0e7f15026254):
CREATE EXTERNAL TABLE db10.sample234
STORED BY 'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler'
TBLPROPERTIES ('iceberg.catalog'='glue')
INFO : Concurrency mode is disabled, not creating a lock manager
INFO : Semantic Analysis Completed (retrial = false)
INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
INFO : Completed compiling
command(queryId=hive_20210503024236_8bdfc3e3-6b80-4731-a5d8-0e7f15026254); Time
taken: 0.024 seconds
INFO : Concurrency mode is disabled, not creating a lock manager
INFO : Executing
command(queryId=hive_20210503024236_8bdfc3e3-6b80-4731-a5d8-0e7f15026254):
CREATE EXTERNAL TABLE db10.sample234
STORED BY 'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler'
TBLPROPERTIES ('iceberg.catalog'='glue')
INFO : Starting task [Stage-0:DDL] in serial mode
INFO : Completed executing
command(queryId=hive_20210503024236_8bdfc3e3-6b80-4731-a5d8-0e7f15026254); Time
taken: 0.633 seconds
INFO : OK
INFO : Concurrency mode is disabled, not creating a lock manager
No rows affected (0.671 seconds)
0: jdbc:hive2://localhost:10000> SELECT * FROM db10.sample234;
INFO : Compiling
command(queryId=hive_20210503024254_f93f118a-3172-4224-a498-3d291c7a578d):
SELECT * FROM db10.sample234
INFO : Concurrency mode is disabled, not creating a lock manager
INFO : Semantic Analysis Completed (retrial = false)
INFO : Returning Hive schema:
Schema(fieldSchemas:[FieldSchema(name:sample234.id, type:bigint, comment:null),
FieldSchema(name:sample234.data, type:string, comment:null),
FieldSchema(name:sample234.category, type:string, comment:null)],
properties:null)
INFO : Completed compiling
command(queryId=hive_20210503024254_f93f118a-3172-4224-a498-3d291c7a578d); Time
taken: 0.665 seconds
INFO : Concurrency mode is disabled, not creating a lock manager
INFO : Executing
command(queryId=hive_20210503024254_f93f118a-3172-4224-a498-3d291c7a578d):
SELECT * FROM db10.sample234
INFO : Completed executing
command(queryId=hive_20210503024254_f93f118a-3172-4224-a498-3d291c7a578d); Time
taken: 0.001 seconds
INFO : OK
INFO : Concurrency mode is disabled, not creating a lock manager
+---------------+-----------------+---------------------+
| sample234.id | sample234.data | sample234.category |
+---------------+-----------------+---------------------+
| 1 | a | c1 |
| 2 | b | c2 |
| 3 | c | c1 |
| 1 | a | c1 |
| 2 | b | c2 |
| 3 | c | c1 |
+---------------+-----------------+---------------------+
6 rows selected (2.107 seconds)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
