[jira] [Updated] (HUDI-3189) Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table
[ https://issues.apache.org/jira/browse/HUDI-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3189: -- Summary: Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table (was: Follow up for fallback to full table scan with incremental query when files are cleaned up or achived) > Fallback to full table scan with incremental query when files are cleaned up > or achived for MOR table > - > > Key: HUDI-3189 > URL: https://issues.apache.org/jira/browse/HUDI-3189 > Project: Apache Hudi > Issue Type: Task > Components: incremental-query >Reporter: sivabalan narayanan >Assignee: Jagmeet Bali >Priority: Major > Labels: sev:high > Fix For: 0.11.0 > > Original Estimate: 4h > Remaining Estimate: 4h > > [https://github.com/apache/hudi/pull/3946] > was added to fallback to full table scan with incremental query on 2 > occasions: > # files are cleaned up, but active timeline still returns the commits. > # commits are archived. > > There are two follow ups from the original PR. > a. fs.isExists() call should be routed to metadata table. > b. Add similar support to MOR table. > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (HUDI-3189) Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table
[ https://issues.apache.org/jira/browse/HUDI-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3189: -- Sprint: Cont' improve - 2021/01/31, Cont' improve - 2022/02/07, Cont' improve - 2022/02/14 (was: Cont' improve - 2021/01/31, Cont' improve - 2022/02/07) > Fallback to full table scan with incremental query when files are cleaned up > or achived for MOR table > - > > Key: HUDI-3189 > URL: https://issues.apache.org/jira/browse/HUDI-3189 > Project: Apache Hudi > Issue Type: Task > Components: incremental-query >Reporter: sivabalan narayanan >Assignee: sivabalan narayanan >Priority: Major > Labels: sev:high > Fix For: 0.11.0 > > Original Estimate: 4h > Remaining Estimate: 4h > > [https://github.com/apache/hudi/pull/3946] > was added to fallback to full table scan with incremental query on 2 > occasions: > # files are cleaned up, but active timeline still returns the commits. > # commits are archived. > > There are two follow ups from the original PR. > a. fs.isExists() call should be routed to metadata table. > b. Add similar support to MOR table. > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (HUDI-3189) Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table
[ https://issues.apache.org/jira/browse/HUDI-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3189: -- Sprint: Cont' improve - 2021/01/31, Cont' improve - 2022/02/07, Cont' improve - 2022/02/14, Cont' improve - 2022/02/21 (was: Cont' improve - 2021/01/31, Cont' improve - 2022/02/07, Cont' improve - 2022/02/14) > Fallback to full table scan with incremental query when files are cleaned up > or achived for MOR table > - > > Key: HUDI-3189 > URL: https://issues.apache.org/jira/browse/HUDI-3189 > Project: Apache Hudi > Issue Type: Task > Components: incremental-query >Reporter: sivabalan narayanan >Assignee: sivabalan narayanan >Priority: Major > Labels: sev:high > Fix For: 0.11.0 > > Original Estimate: 4h > Remaining Estimate: 4h > > [https://github.com/apache/hudi/pull/3946] > was added to fallback to full table scan with incremental query on 2 > occasions: > # files are cleaned up, but active timeline still returns the commits. > # commits are archived. > > There are two follow ups from the original PR. > a. fs.isExists() call should be routed to metadata table. > b. Add similar support to MOR table. > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (HUDI-3189) Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table
[ https://issues.apache.org/jira/browse/HUDI-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3189: -- Sprint: Cont' improve - 2021/01/31, Cont' improve - 2022/02/07, Cont' improve - 2022/02/14 (was: Cont' improve - 2021/01/31, Cont' improve - 2022/02/07, Cont' improve - 2022/02/14, Cont' improve - 2022/02/21) > Fallback to full table scan with incremental query when files are cleaned up > or achived for MOR table > - > > Key: HUDI-3189 > URL: https://issues.apache.org/jira/browse/HUDI-3189 > Project: Apache Hudi > Issue Type: Task > Components: incremental-query >Reporter: sivabalan narayanan >Assignee: sivabalan narayanan >Priority: Major > Labels: sev:high > Fix For: 0.11.0 > > Original Estimate: 4h > Remaining Estimate: 4h > > [https://github.com/apache/hudi/pull/3946] > was added to fallback to full table scan with incremental query on 2 > occasions: > # files are cleaned up, but active timeline still returns the commits. > # commits are archived. > > There are two follow ups from the original PR. > a. fs.isExists() call should be routed to metadata table. > b. Add similar support to MOR table. > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (HUDI-3189) Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table
[ https://issues.apache.org/jira/browse/HUDI-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3189: -- Fix Version/s: 0.12.0 (was: 0.11.0) > Fallback to full table scan with incremental query when files are cleaned up > or achived for MOR table > - > > Key: HUDI-3189 > URL: https://issues.apache.org/jira/browse/HUDI-3189 > Project: Apache Hudi > Issue Type: Task > Components: incremental-query >Reporter: sivabalan narayanan >Assignee: sivabalan narayanan >Priority: Major > Labels: sev:high > Fix For: 0.12.0 > > Original Estimate: 4h > Remaining Estimate: 4h > > [https://github.com/apache/hudi/pull/3946] > was added to fallback to full table scan with incremental query on 2 > occasions: > # files are cleaned up, but active timeline still returns the commits. > # commits are archived. > > There are two follow ups from the original PR. > a. fs.isExists() call should be routed to metadata table. > b. Add similar support to MOR table. > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (HUDI-3189) Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table
[ https://issues.apache.org/jira/browse/HUDI-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3189: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Fallback to full table scan with incremental query when files are cleaned up > or achived for MOR table > - > > Key: HUDI-3189 > URL: https://issues.apache.org/jira/browse/HUDI-3189 > Project: Apache Hudi > Issue Type: Task > Components: incremental-query >Reporter: sivabalan narayanan >Assignee: sivabalan narayanan >Priority: Major > Labels: pull-request-available, sev:high > Fix For: 0.12.1 > > Original Estimate: 4h > Remaining Estimate: 4h > > [https://github.com/apache/hudi/pull/3946] > was added to fallback to full table scan with incremental query on 2 > occasions: > # files are cleaned up, but active timeline still returns the commits. > # commits are archived. > > There are two follow ups from the original PR. > a. fs.isExists() call should be routed to metadata table. > b. Add similar support to MOR table. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HUDI-3189) Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table
[ https://issues.apache.org/jira/browse/HUDI-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3189: - Labels: pull-request-available sev:high (was: sev:high) > Fallback to full table scan with incremental query when files are cleaned up > or achived for MOR table > - > > Key: HUDI-3189 > URL: https://issues.apache.org/jira/browse/HUDI-3189 > Project: Apache Hudi > Issue Type: Task > Components: incremental-query >Reporter: sivabalan narayanan >Assignee: sivabalan narayanan >Priority: Major > Labels: pull-request-available, sev:high > Fix For: 0.12.0 > > Original Estimate: 4h > Remaining Estimate: 4h > > [https://github.com/apache/hudi/pull/3946] > was added to fallback to full table scan with incremental query on 2 > occasions: > # files are cleaned up, but active timeline still returns the commits. > # commits are archived. > > There are two follow ups from the original PR. > a. fs.isExists() call should be routed to metadata table. > b. Add similar support to MOR table. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
