[
https://issues.apache.org/jira/browse/IMPALA-14825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zoltán Borók-Nagy updated IMPALA-14825:
---------------------------------------
Description:
Currently Row Lineage fields can be queried by complex expressions:
* row-id
**
{noformat}
COALESCE(_file_row_id, ICEBERG__FIRST__ROW__ID + FILE__POSITION)
{noformat}
* last-updated-sequence-number
**
{noformat}
COALESCE(_file_last_updated_sequence_number, ICEBERG__DATA__SEQUENCE__NUMBER)
{noformat}
We could add {{ICEBERG__ROW__ID}} and
{{ICEBERG__LAST__UPDATED__SEQUENCE__NUMBER}} virtual columns that would always
get re-written during analysis.
was:
Currently Row Lineage fields can be queried by complex expressions:
* row-id
**
{noformat}
COALESCE(_file_row_id, ICEBERG__FIRST__ROW__ID + FILE__POSITION)
{noformat}
* last-updated-sequence-number
**
{noformat}
COALESCE(_file_last_updated_sequence_number, ICEBERG__DATA__SEQUENCE__NUMBER)
{noformat}
We could add ICEBERG__ROW__ID and ICEBERG__LAST__UPDATED__SEQUENCE__NUMBER
virtual columns that would always get re-written during analysis.
> Add syntactic sugar for Iceberg Row Lineage data
> ------------------------------------------------
>
> Key: IMPALA-14825
> URL: https://issues.apache.org/jira/browse/IMPALA-14825
> Project: IMPALA
> Issue Type: Improvement
> Components: Frontend
> Reporter: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
>
> Currently Row Lineage fields can be queried by complex expressions:
> * row-id
> **
> {noformat}
> COALESCE(_file_row_id, ICEBERG__FIRST__ROW__ID + FILE__POSITION)
> {noformat}
> * last-updated-sequence-number
> **
> {noformat}
> COALESCE(_file_last_updated_sequence_number, ICEBERG__DATA__SEQUENCE__NUMBER)
> {noformat}
> We could add {{ICEBERG__ROW__ID}} and
> {{ICEBERG__LAST__UPDATED__SEQUENCE__NUMBER}} virtual columns that would
> always get re-written during analysis.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
