[
https://issues.apache.org/jira/browse/IMPALA-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077597#comment-17077597
]
ASF subversion and git services commented on IMPALA-9330:
---------------------------------------------------------
Commit 5c2cae89f2ba1de55131a261dce7c8e284bb6c0e in impala's branch
refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=5c2cae8 ]
IMPALA-9529: Fix multi-tuple predicates not assigned in column masking
Column masking is implemented by replacing the masked table with a table
masking view which has masked expressions in its SelectList. However,
nested columns can't be exposed in the SelectList, so we expose them
in the output field of the view in IMPALA-9330. As a result, predicates
that reference both primitive and nested columns of the masked table
become multi-tuple predicates (referencing tuples of the view and the
masked table). Such kinds of predicates are not assigned since they no
longer bound to the view's tuple or the masked table's tuple.
We need to pick up the masked table's tuple id when getting unassigned
predicates for the table masking view. Also need to do this for
assigning predicates to the JoinNode which is the only place that
introduces multi-tuple predicates.
Tests:
- Add tests with multi-tuple predicates referencing nested columns.
- Run CORE tests.
Change-Id: I12f1b59733db5a88324bb0c16085f565edc306b3
Reviewed-on: http://gerrit.cloudera.org:8080/15654
Reviewed-by: Csaba Ringhofer <csringho...@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
> Support masking queries containing correlated collection references
> -------------------------------------------------------------------
>
> Key: IMPALA-9330
> URL: https://issues.apache.org/jira/browse/IMPALA-9330
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Critical
> Fix For: Impala 3.4.0
>
>
> Let's say table complextypestbl (id bigint, int_arr array<int>) has column
> masking policy on id: "id => id * 100". The following query is not rewritten
> correctly:
> {code:sql}
> select t.id, a.pos, a.item from complextypestbl t, t.int_arr a;
> {code}
> Because its AST will be rewritten to the AST of
> {code:sql}
> select t.id, a.pos, a.item from (
> select cast(id * 100 as BIGINT) id
> from complextypestbl
> ) t, t.int_arr a;
> {code}
> Currently, the analyzer can't resolve "t.int_arr" correctly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
