[
https://issues.apache.org/jira/browse/IMPALA-12611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17823661#comment-17823661
]
ASF subversion and git services commented on IMPALA-12611:
----------------------------------------------------------
Commit f68d91dcee76ccd90dfc7f1111623ea531794d03 in impala's branch
refs/heads/master from Tamas Mate
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=f68d91dce ]
IMPALA-12610: Support reading ARRAY columns for Iceberg Metadata tables
This commit adds support for reading ARRAY columns inside Iceberg
Metadata tables.
The change starts with some refactoring, to consolidate accessing JVM
through JNI a new backend class was introduced, IcebergMetadataScanner.
This class is the C++ part of the Java IcebergMetadataScanner, it is
responsible to manage the Java scanner object.
In Iceberg array types do not have accessors, so structs inside arrays
have to be accessed by position, for the value obtaining logics have been
changed to allow access by position.
The IcebergRowReader needed an IcebergMetadataScanner, so that it can
iterate over the arrays returned by the scanner and add them to the
collection.
This change will not cover MAP, these slots are set to NULL, it will
be done in IMPALA-12611.
Testing:
- Added E2E tests.
Change-Id: Ieb9bac1822a17bd3cd074b4b98e4d010703cecb1
Reviewed-on: http://gerrit.cloudera.org:8080/21061
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Reviewed-by: Gabor Kaszab <gaborkas...@cloudera.com>
> Add support to MAP type Iceberg Metadata table columns
> ------------------------------------------------------
>
> Key: IMPALA-12611
> URL: https://issues.apache.org/jira/browse/IMPALA-12611
> Project: IMPALA
> Issue Type: Sub-task
> Components: Backend, Frontend
> Affects Versions: Impala 4.4.0
> Reporter: Tamas Mate
> Assignee: Daniel Becker
> Priority: Major
> Labels: impala-iceberg
>
> MAP type columns are currently filled with NULLs, we should populate them.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
