[
https://issues.apache.org/jira/browse/IMPALA-14923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18077414#comment-18077414
]
ASF subversion and git services commented on IMPALA-14923:
----------------------------------------------------------
Commit 7ab390a662b4aaf6736b354f75f6f2439c5f1455 in impala's branch
refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=7ab390a66 ]
IMPALA-14923: Run Iceberg tests with no block locations
When block locations are not available Impala works quite differently.
E.g. it doesn't create TScanRanges in the Frontend, but generates them
in the backend from TFileSplitGeneratorSpec objects.
We already have test_disabled_block_locations.py that disables block
location loading but it didn't test Iceberg V3 tables.
This patch executes a few Iceberg tests without block locations to
somewhat simulate the behavior on object stores. This way we can
catch bugs in pre-commit that would otherwise only be found later.
Change-Id: I62c3509ec11e657c634c93377176eec9118c02cc
Reviewed-on: http://gerrit.cloudera.org:8080/24237
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Run Iceberg tests with no block locations
> -----------------------------------------
>
> Key: IMPALA-14923
> URL: https://issues.apache.org/jira/browse/IMPALA-14923
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure, Test
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
>
> When block locations are not available Impala works quite differently. E.g.
> it doesn't create TScanRanges in the Frontend, but generates them in the
> backend from TFileSplitGeneratorSpec objects.
> It is possible to disable block location information via core-site.xml:
> {noformat}
> <property>
> <name>impala.preload-block-locations-for-scheduling</name>
> <value>false</value>
> </property>
> {noformat}
>
> Executing a set of tests with disabled block locations could catch a few
> errors in time.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]