[jira] [Updated] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HUDI-689:

Labels: pull-request-available  (was: )

> Fix hudi cli commands with overlapping words
> 
>
> Key: HUDI-689
> URL: https://issues.apache.org/jira/browse/HUDI-689
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>Reporter: satish
>Assignee: satish
>Priority: Critical
>  Labels: pull-request-available
>
> CLI 'commits show archived' fails with
> {code}
> ->commits show archived
> Option '' is not available for this command. Use tab assist or the "help" 
> command to see the legal options
> {code}
> This seems to be because 'compactions show archived'. If i remove @CliCommand 
> annotation from compactions, commits show archived works.  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread Balaji Varadarajan (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Balaji Varadarajan updated HUDI-689:

Status: Open  (was: New)

> Fix hudi cli commands with overlapping words
> 
>
> Key: HUDI-689
> URL: https://issues.apache.org/jira/browse/HUDI-689
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>Reporter: satish
>Assignee: satish
>Priority: Critical
>
> CLI 'commits show archived' fails with
> {code}
> ->commits show archived
> Option '' is not available for this command. Use tab assist or the "help" 
> command to see the legal options
> {code}
> This seems to be because 'compactions show archived'. If i remove @CliCommand 
> annotation from compactions, commits show archived works.  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread satish (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

satish updated HUDI-689:

Description: 
CLI 'commits show archived' fails with
{code}
->commits show archived
Option '' is not available for this command. Use tab assist or the "help" 
command to see the legal options
{code}

This seems to be because 'compactions show archived'. If i remove @CliCommand 
annotation from compactions, commits show archived works.  

  was:




> Fix hudi cli commands with overlapping words
> 
>
> Key: HUDI-689
> URL: https://issues.apache.org/jira/browse/HUDI-689
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>Reporter: satish
>Assignee: satish
>Priority: Critical
>  Labels: pull-request-available
>
> CLI 'commits show archived' fails with
> {code}
> ->commits show archived
> Option '' is not available for this command. Use tab assist or the "help" 
> command to see the legal options
> {code}
> This seems to be because 'compactions show archived'. If i remove @CliCommand 
> annotation from compactions, commits show archived works.  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread satish (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

satish updated HUDI-689:

Labels:   (was: pull-request-available)

> Fix hudi cli commands with overlapping words
> 
>
> Key: HUDI-689
> URL: https://issues.apache.org/jira/browse/HUDI-689
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>Reporter: satish
>Assignee: satish
>Priority: Critical
>
> CLI 'commits show archived' fails with
> {code}
> ->commits show archived
> Option '' is not available for this command. Use tab assist or the "help" 
> command to see the legal options
> {code}
> This seems to be because 'compactions show archived'. If i remove @CliCommand 
> annotation from compactions, commits show archived works.  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread satish (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

satish updated HUDI-689:

Summary: Fix hudi cli commands with overlapping words  (was: Fix hudi cli 
commands with overlap)

> Fix hudi cli commands with overlapping words
> 
>
> Key: HUDI-689
> URL: https://issues.apache.org/jira/browse/HUDI-689
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>Reporter: satish
>Assignee: satish
>Priority: Critical
>  Labels: pull-request-available
>
> example timeline:
> t0 -> create bucket1.parquet
> t1 -> create and append updates bucket1.log
> t2 -> request compaction 
> t3 -> create bucket2.parquet
> if compaction at t2 takes a long time, incremental reads using 
> HoodieParquetInputFormat can skip data ingested at t1 leading to 'data loss' 
> (Data will still be on disk, but incremental readers wont see it because its 
> in log file and readers move to t3)
> To workaround this problem, we want to stop returning data belonging to 
> commits > t1. After compaction is complete, incremental reader would see 
> updates in t2, t3, so on.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread satish (Jira)


 [ 
https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

satish updated HUDI-689:

Description: 



  was:
example timeline:

t0 -> create bucket1.parquet
t1 -> create and append updates bucket1.log
t2 -> request compaction 
t3 -> create bucket2.parquet

if compaction at t2 takes a long time, incremental reads using 
HoodieParquetInputFormat can skip data ingested at t1 leading to 'data loss' 
(Data will still be on disk, but incremental readers wont see it because its in 
log file and readers move to t3)

To workaround this problem, we want to stop returning data belonging to commits 
> t1. After compaction is complete, incremental reader would see updates in t2, 
t3, so on.



> Fix hudi cli commands with overlapping words
> 
>
> Key: HUDI-689
> URL: https://issues.apache.org/jira/browse/HUDI-689
> Project: Apache Hudi (incubating)
>  Issue Type: Improvement
>Reporter: satish
>Assignee: satish
>Priority: Critical
>  Labels: pull-request-available
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)