[
https://issues.apache.org/jira/browse/IMPALA-13810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18097633#comment-18097633
]
ASF subversion and git services commented on IMPALA-13810:
----------------------------------------------------------
Commit 6cfd91924119a726d6f70a04477bd8dea125a080 in impala's branch
refs/heads/master from Daniel Vanko
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=6cfd91924 ]
IMPALA-13810: Generate lineage records for UPDATE and MERGE statements
This patch enables lineage generation for UPDATE statements on Iceberg
and Kudu tables. Lineage will not include virtual columns in case of
Iceberg tables, or the auto incrementing id column in case of Kudu
tables.
It also enables lineage generation for MERGE statements which are
currently only valid on Iceberg tables. DELETE-only MERGE statements
do not produce lineage, similar to DELETE statements.
Added a new check to the test framework, to be able to validate queries
that shouldn't produce lineage. An empty (whitespace-only) LINEAGE
section will fail the test if the query produces lineage.
Testing:
* added new e2e tests
Change-Id: Icba79f756509438455bfbf3067733f6f29284220
Assisted-by: Claude Opus 4.7 (Claude Code)
Reviewed-on: http://gerrit.cloudera.org:8080/24137
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Generate lineage records for UPDATE/MERGE statements
> ----------------------------------------------------
>
> Key: IMPALA-13810
> URL: https://issues.apache.org/jira/browse/IMPALA-13810
> Project: IMPALA
> Issue Type: New Feature
> Components: Frontend
> Reporter: Zoltán Borók-Nagy
> Assignee: Dániel Gábor Vankó
> Priority: Major
> Labels: ramp-up
>
> We generate lineage records for
> * CREATE TABLE
> * CREATE TABLE AS
> * CREATE VIEW
> * ALTER VIEW
> * INSERT
> * SELECT
> We should also generate for UPDATE FROM / MERGE statements as well.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
