[jira] [Closed] (HUDI-1264) incremental read support with replace

2021-11-07 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei closed HUDI-1264. --- > incremental read support with replace > - > > Key: HUDI-1264 >

[jira] [Updated] (HUDI-1264) incremental read support with replace

2021-11-07 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1264: Status: Closed (was: Patch Available) > incremental read support with replace >

[jira] [Resolved] (HUDI-1264) incremental read support with replace

2021-11-07 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei resolved HUDI-1264. - > incremental read support with replace > - > > Key: HUDI-1264 >

[jira] [Reopened] (HUDI-1264) incremental read support with replace

2021-11-07 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reopened HUDI-1264: - > incremental read support with replace > - > > Key: HUDI-1264 >

[jira] [Commented] (HUDI-1307) spark datasource load path format is confused for snapshot and increment read mode

2021-09-26 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420424#comment-17420424 ] liwei commented on HUDI-1307: - [~xushiyan] hello , recently i am focus on ingest kafka data using hudi with

[jira] [Comment Edited] (HUDI-52) Implement Savepoints for Merge On Read table #88

2021-08-26 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405053#comment-17405053 ] liwei edited comment on HUDI-52 at 8/26/21, 8:21 AM: - [~vinoth] hello, We are going to

[jira] [Commented] (HUDI-52) Implement Savepoints for Merge On Read table #88

2021-08-26 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405053#comment-17405053 ] liwei commented on HUDI-52: --- [~vinoth] hello, We are going to build table backup and recovery based on savepoint

[jira] [Assigned] (HUDI-2355) after clustering with archive meet data incorrect

2021-08-24 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-2355: --- Assignee: liwei > after clustering with archive meet data incorrect >

[jira] [Created] (HUDI-2355) after clustering with archive meet data incorrect

2021-08-24 Thread liwei (Jira)
liwei created HUDI-2355: --- Summary: after clustering with archive meet data incorrect Key: HUDI-2355 URL: https://issues.apache.org/jira/browse/HUDI-2355 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-24 Thread liwei (Jira)
liwei created HUDI-2354: --- Summary: archive delete replacecommit, but stop timeline server meet file not found Key: HUDI-2354 URL: https://issues.apache.org/jira/browse/HUDI-2354 Project: Apache Hudi

[jira] [Assigned] (HUDI-2354) archive delete replacecommit, but stop timeline server meet file not found

2021-08-24 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-2354: --- Assignee: liwei > archive delete replacecommit, but stop timeline server meet file not found >

[jira] [Updated] (HUDI-2301) fix FileSliceMetrics utils bug

2021-08-24 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-2301: Status: In Progress (was: Open) > fix FileSliceMetrics utils bug > -- > >

[jira] [Updated] (HUDI-2301) fix FileSliceMetrics utils bug

2021-08-24 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-2301: Status: Closed (was: Patch Available) > fix FileSliceMetrics utils bug > -- > >

[jira] [Updated] (HUDI-2301) fix FileSliceMetrics utils bug

2021-08-24 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-2301: Status: Patch Available (was: In Progress) > fix FileSliceMetrics utils bug > -- > >

[jira] [Created] (HUDI-2301) fix FileSliceMetrics utils bug

2021-08-12 Thread liwei (Jira)
liwei created HUDI-2301: --- Summary: fix FileSliceMetrics utils bug Key: HUDI-2301 URL: https://issues.apache.org/jira/browse/HUDI-2301 Project: Apache Hudi Issue Type: Sub-task Reporter:

[jira] [Created] (HUDI-2300) add ClusteringPlanStrategy unit test

2021-08-12 Thread liwei (Jira)
liwei created HUDI-2300: --- Summary: add ClusteringPlanStrategy unit test Key: HUDI-2300 URL: https://issues.apache.org/jira/browse/HUDI-2300 Project: Apache Hudi Issue Type: Sub-task

[jira] [Commented] (HUDI-1468) incremental read support with clustering

2021-07-09 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377966#comment-17377966 ] liwei commented on HUDI-1468: - [~vinoth] hello , is [https://github.com/apache/hudi/pull/3139/files] land it ,

[jira] [Assigned] (HUDI-1042) [Umbrella] Support clustering on filegroups

2021-06-26 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-1042: --- Assignee: liwei (was: leesf) > [Umbrella] Support clustering on filegroups >

[jira] [Assigned] (HUDI-1043) Support clustering in CoW mode

2021-06-26 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-1043: --- Assignee: liwei (was: leesf) > Support clustering in CoW mode > -- > >

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-06-14 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363315#comment-17363315 ] liwei commented on HUDI-1138: - [~guoyihua] thanks . “We may consider blocking the requests for batching so

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-06-13 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17362535#comment-17362535 ] liwei commented on HUDI-1138: - [~guoyihua] [~vinoth]:D hello , i have a question  * "When using S3, use

[jira] [Resolved] (HUDI-1768) spark datasource support schema validate add column

2021-05-16 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei resolved HUDI-1768. - Resolution: Fixed > spark datasource support schema validate add column >

[jira] [Commented] (HUDI-1295) RFC-15: Track bloom filters as a part of metadata table

2021-05-04 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17338774#comment-17338774 ] liwei commented on HUDI-1295: - [~vinoth] got it. Thanks  > RFC-15: Track bloom filters as a part of metadata

[jira] [Commented] (HUDI-1295) RFC-15: Track bloom filters as a part of metadata table

2021-05-01 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17337947#comment-17337947 ] liwei commented on HUDI-1295: - [~vinoth] hello , do we also land this in 

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-04-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17329158#comment-17329158 ] liwei commented on HUDI-1138: - [~vinoth] ok, i will move the discussion to RFC-27.:D > Re-implement marker

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-04-21 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17327052#comment-17327052 ] liwei commented on HUDI-1138: - [~vinoth] thanks  1. I have a idea, can we update the file to metatable in

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-04-18 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324649#comment-17324649 ] liwei commented on HUDI-1138: - [~uditme] [~vinoth] i also think listing will be  performance improvement

[jira] [Updated] (HUDI-897) hudi support log append scenario with better write and asynchronous compaction

2021-04-18 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-897: --- Status: In Progress (was: Open) > hudi support log append scenario with better write and asynchronous compaction >

[jira] [Commented] (HUDI-897) hudi support log append scenario with better write and asynchronous compaction

2021-04-18 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324647#comment-17324647 ] liwei commented on HUDI-897: okay > hudi support log append scenario with better write and asynchronous

[jira] [Resolved] (HUDI-897) hudi support log append scenario with better write and asynchronous compaction

2021-04-18 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei resolved HUDI-897. Resolution: Fixed > hudi support log append scenario with better write and asynchronous compaction >

[jira] [Commented] (HUDI-1674) add partition level delete DOC or example

2021-04-07 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316820#comment-17316820 ] liwei commented on HUDI-1674: - [~shivnarayan] spark datasource do not have the delete partition API. It need

[jira] [Updated] (HUDI-1768) spark datasource support schema validate add column

2021-04-06 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1768: Issue Type: Improvement (was: Bug) > spark datasource support schema validate add column >

[jira] [Assigned] (HUDI-1768) spark datasource support schema validate add column

2021-04-06 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-1768: --- Assignee: liwei > spark datasource support schema validate add column >

[jira] [Created] (HUDI-1768) spark datasource support schema validate add column

2021-04-06 Thread liwei (Jira)
liwei created HUDI-1768: --- Summary: spark datasource support schema validate add column Key: HUDI-1768 URL: https://issues.apache.org/jira/browse/HUDI-1768 Project: Apache Hudi Issue Type: Bug

[jira] [Commented] (HUDI-1590) Support async clustering w/ test suite job

2021-03-08 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297421#comment-17297421 ] liwei commented on HUDI-1590: - [~legendtkl] try it . :D > Support async clustering w/ test suite job >

[jira] [Created] (HUDI-1674) add partition level delete DOC or example

2021-03-07 Thread liwei (Jira)
liwei created HUDI-1674: --- Summary: add partition level delete DOC or example Key: HUDI-1674 URL: https://issues.apache.org/jira/browse/HUDI-1674 Project: Apache Hudi Issue Type: Sub-task

[jira] [Commented] (HUDI-797) Improve performance of rewriting AVRO records in HoodieAvroUtils::rewriteRecord

2021-03-01 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292942#comment-17292942 ] liwei commented on HUDI-797: [~pwason]  Hello i also meet the performance problem. When i ingest large logs,

[jira] [Resolved] (HUDI-1520) add configure for spark sql overwrite use replace

2021-01-11 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei resolved HUDI-1520. - Resolution: Fixed > add configure for spark sql overwrite use replace >

[jira] [Created] (HUDI-1520) add configure for spark sql overwrite use replace

2021-01-10 Thread liwei (Jira)
liwei created HUDI-1520: --- Summary: add configure for spark sql overwrite use replace Key: HUDI-1520 URL: https://issues.apache.org/jira/browse/HUDI-1520 Project: Apache Hudi Issue Type: Sub-task

[jira] [Closed] (HUDI-1399) support a independent clustering spark job to asynchronously clustering

2021-01-09 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei closed HUDI-1399. --- > support a independent clustering spark job to asynchronously clustering >

[jira] [Resolved] (HUDI-1399) support a independent clustering spark job to asynchronously clustering

2021-01-09 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei resolved HUDI-1399. - Resolution: Fixed > support a independent clustering spark job to asynchronously clustering >

[jira] [Updated] (HUDI-1399) support a independent clustering spark job to asynchronously clustering

2021-01-09 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1399: Status: Closed (was: Patch Available) > support a independent clustering spark job to asynchronously clustering >

[jira] [Reopened] (HUDI-1399) support a independent clustering spark job to asynchronously clustering

2021-01-09 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reopened HUDI-1399: - > support a independent clustering spark job to asynchronously clustering >

[jira] [Assigned] (HUDI-1516) refactored testHoodieAsyncClusteringJob in TestHoodieDeltaStreamer.java

2021-01-09 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-1516: --- Assignee: liwei > refactored testHoodieAsyncClusteringJob in TestHoodieDeltaStreamer.java >

[jira] [Created] (HUDI-1516) refactored testHoodieAsyncClusteringJob in TestHoodieDeltaStreamer.java

2021-01-09 Thread liwei (Jira)
liwei created HUDI-1516: --- Summary: refactored testHoodieAsyncClusteringJob in TestHoodieDeltaStreamer.java Key: HUDI-1516 URL: https://issues.apache.org/jira/browse/HUDI-1516 Project: Apache Hudi

[jira] [Updated] (HUDI-1482) async clustering for spark streaming

2021-01-04 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1482: Status: Open (was: New) > async clustering for spark streaming > > >

[jira] [Updated] (HUDI-1482) async clustering for spark streaming

2021-01-04 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1482: Status: In Progress (was: Open) > async clustering for spark streaming > > >

[jira] [Created] (HUDI-1500) support incremental read clustering commit in deltastreamer

2020-12-30 Thread liwei (Jira)
liwei created HUDI-1500: --- Summary: support incremental read clustering commit in deltastreamer Key: HUDI-1500 URL: https://issues.apache.org/jira/browse/HUDI-1500 Project: Apache Hudi Issue Type:

[jira] [Resolved] (HUDI-1481) support inline clustering unit tests for spark datasource and deltastreamer

2020-12-28 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei resolved HUDI-1481. - Resolution: Fixed > support inline clustering unit tests for spark datasource and deltastreamer >

[jira] [Resolved] (HUDI-1354) Block updates and replace on file groups in clustering

2020-12-28 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei resolved HUDI-1354. - Resolution: Fixed > Block updates and replace on file groups in clustering >

[jira] [Resolved] (HUDI-1350) Support Partition level delete API in HUDI on top on Insert Overwrite

2020-12-28 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei resolved HUDI-1350. - Resolution: Fixed > Support Partition level delete API in HUDI on top on Insert Overwrite >

[jira] [Updated] (HUDI-1354) Block updates and replace on file groups in clustering

2020-12-28 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1354: Status: Closed (was: Patch Available) > Block updates and replace on file groups in clustering >

[jira] [Updated] (HUDI-1354) Block updates and replace on file groups in clustering

2020-12-28 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1354: Status: Patch Available (was: In Progress) > Block updates and replace on file groups in clustering >

[jira] [Reopened] (HUDI-1354) Block updates and replace on file groups in clustering

2020-12-28 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reopened HUDI-1354: - > Block updates and replace on file groups in clustering > -- > >

[jira] [Updated] (HUDI-1498) Always read clustering plan from requested file

2020-12-28 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1498: Status: Open (was: New) > Always read clustering plan from requested file >

[jira] [Updated] (HUDI-1350) Support Partition level delete API in HUDI on top on Insert Overwrite

2020-12-28 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1350: Status: Patch Available (was: In Progress) > Support Partition level delete API in HUDI on top on Insert Overwrite

[jira] [Updated] (HUDI-1350) Support Partition level delete API in HUDI on top on Insert Overwrite

2020-12-28 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1350: Status: Closed (was: Patch Available) > Support Partition level delete API in HUDI on top on Insert Overwrite >

[jira] [Reopened] (HUDI-1350) Support Partition level delete API in HUDI on top on Insert Overwrite

2020-12-28 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reopened HUDI-1350: - > Support Partition level delete API in HUDI on top on Insert Overwrite >

[jira] [Closed] (HUDI-1074) implement merge-sort based clustering strategy

2020-12-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei closed HUDI-1074. --- Resolution: Fixed > implement merge-sort based clustering strategy > -- >

[jira] [Updated] (HUDI-1074) implement merge-sort based clustering strategy

2020-12-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1074: Status: Open (was: New) > implement merge-sort based clustering strategy >

[jira] [Comment Edited] (HUDI-1074) implement merge-sort based clustering strategy

2020-12-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253874#comment-17253874 ] liwei edited comment on HUDI-1074 at 12/23/20, 3:54 AM: [~satishkotha] got it, i

[jira] [Commented] (HUDI-1074) implement merge-sort based clustering strategy

2020-12-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253874#comment-17253874 ] liwei commented on HUDI-1074: - [~satishkotha] got it > implement merge-sort based clustering strategy >

[jira] [Comment Edited] (HUDI-1042) [Umbrella] Support clustering on filegroups

2020-12-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253814#comment-17253814 ] liwei edited comment on HUDI-1042 at 12/23/20, 12:49 AM: - okay, i have some issue

[jira] [Commented] (HUDI-1074) implement merge-sort based clustering strategy

2020-12-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253815#comment-17253815 ] liwei commented on HUDI-1074: - got it , i have not begin. if  [https://github.com/apache/hudi/pull/2263] have

[jira] [Comment Edited] (HUDI-1074) implement merge-sort based clustering strategy

2020-12-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253815#comment-17253815 ] liwei edited comment on HUDI-1074 at 12/23/20, 12:48 AM: - [~satishkotha]  got it ,

[jira] [Commented] (HUDI-1042) [Umbrella] Support clustering on filegroups

2020-12-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253814#comment-17253814 ] liwei commented on HUDI-1042: - okay > [Umbrella] Support clustering on filegroups >

[jira] [Updated] (HUDI-1487) after HUDI-1376 merged unit test testCopyOnWriteStorage will failed random

2020-12-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1487: Description:     TestCOWDataSource.testCopyOnWriteStorage will failed random. Because  before the  incremental

[jira] [Updated] (HUDI-1487) after HUDI-1376 merged unit test testCopyOnWriteStorage will failed random

2020-12-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1487: Status: Open (was: New) > after HUDI-1376 merged unit test testCopyOnWriteStorage will failed random >

[jira] [Updated] (HUDI-1487) after HUDI-1376 merged unit test testCopyOnWriteStorage will failed random

2020-12-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1487: Status: In Progress (was: Open) > after HUDI-1376 merged unit test testCopyOnWriteStorage will failed random >

[jira] [Updated] (HUDI-1487) after HUDI-1376 merged unit test testCopyOnWriteStorage will failed random

2020-12-22 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1487: Description:     TestCOWDataSource.testCopyOnWriteStorage will failed random. Because  before the  incremental

[jira] [Created] (HUDI-1487) after HUDI-1376 merged unit test testCopyOnWriteStorage will failed random

2020-12-22 Thread liwei (Jira)
liwei created HUDI-1487: --- Summary: after HUDI-1376 merged unit test testCopyOnWriteStorage will failed random Key: HUDI-1487 URL: https://issues.apache.org/jira/browse/HUDI-1487 Project: Apache Hudi

[jira] [Created] (HUDI-1483) async clustering for deltastreamer

2020-12-20 Thread liwei (Jira)
liwei created HUDI-1483: --- Summary: async clustering for deltastreamer Key: HUDI-1483 URL: https://issues.apache.org/jira/browse/HUDI-1483 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-1482) async compaction for spark streaming

2020-12-20 Thread liwei (Jira)
liwei created HUDI-1482: --- Summary: async compaction for spark streaming Key: HUDI-1482 URL: https://issues.apache.org/jira/browse/HUDI-1482 Project: Apache Hudi Issue Type: Sub-task

[jira] [Updated] (HUDI-1482) async clustering for spark streaming

2020-12-20 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1482: Summary: async clustering for spark streaming (was: async compaction for spark streaming) > async clustering for

[jira] [Updated] (HUDI-1399) support a independent clustering spark job to asynchronously clustering

2020-12-20 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1399: Status: In Progress (was: Open) > support a independent clustering spark job to asynchronously clustering >

[jira] [Updated] (HUDI-1399) support a independent clustering spark job to asynchronously clustering

2020-12-20 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1399: Summary: support a independent clustering spark job to asynchronously clustering (was: support clustering

[jira] [Updated] (HUDI-1481) support inline clustering unit tests for spark datasource and deltastreamer

2020-12-20 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1481: Status: In Progress (was: Open) > support inline clustering unit tests for spark datasource and deltastreamer >

[jira] [Updated] (HUDI-1481) support inline clustering unit tests for spark datasource and deltastreamer

2020-12-20 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1481: Status: Open (was: New) > support inline clustering unit tests for spark datasource and deltastreamer >

[jira] [Closed] (HUDI-1472) support inline clustering unit tests for spark datasource and deltastreamer

2020-12-20 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei closed HUDI-1472. --- Resolution: Fixed > support inline clustering unit tests for spark datasource and deltastreamer >

[jira] [Created] (HUDI-1481) support inline clustering unit tests for spark datasource and deltastreamer

2020-12-20 Thread liwei (Jira)
liwei created HUDI-1481: --- Summary: support inline clustering unit tests for spark datasource and deltastreamer Key: HUDI-1481 URL: https://issues.apache.org/jira/browse/HUDI-1481 Project: Apache Hudi

[jira] [Updated] (HUDI-1472) support inline clustering unit tests for spark datasource and deltastreamer

2020-12-20 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1472: Summary: support inline clustering unit tests for spark datasource and deltastreamer (was: support inline

[jira] [Updated] (HUDI-1472) support inline clustering for spark datasource

2020-12-18 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1472: Status: Open (was: New) > support inline clustering for spark datasource >

[jira] [Created] (HUDI-1472) support inline clustering for spark datasource

2020-12-18 Thread liwei (Jira)
liwei created HUDI-1472: --- Summary: support inline clustering for spark datasource Key: HUDI-1472 URL: https://issues.apache.org/jira/browse/HUDI-1472 Project: Apache Hudi Issue Type: Task

[jira] [Updated] (HUDI-1399) support clustering operation can run asynchronously

2020-12-18 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1399: Status: Open (was: New) > support clustering operation can run asynchronously >

[jira] [Commented] (HUDI-1399) support clustering operation can run asynchronously

2020-12-16 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250765#comment-17250765 ] liwei commented on HUDI-1399: - [~vinoth] code freeze is Dec 31? just like compaction asynchronously have four

[jira] [Commented] (HUDI-1399) support clustering operation can run asynchronously

2020-12-16 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250424#comment-17250424 ] liwei commented on HUDI-1399: - [~vinoth] i plan to begin it about next week > support clustering operation

[jira] [Commented] (HUDI-1456) Concurrent Writing to Hudi tables

2020-12-13 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248711#comment-17248711 ] liwei commented on HUDI-1456: - [~nishith29] Great , it will begin. If have some independent task, I’m happy to

[jira] [Comment Edited] (HUDI-1456) Concurrent Writing to Hudi tables

2020-12-13 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248711#comment-17248711 ] liwei edited comment on HUDI-1456 at 12/14/20, 1:49 AM: [~nishith29] Good news ,

[jira] [Updated] (HUDI-1456) Concurrent Writing to Hudi tables

2020-12-13 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1456: Attachment: image-2020-12-14-09-48-46-946.png > Concurrent Writing to Hudi tables >

[jira] [Created] (HUDI-1454) in unit test have error as Error reading clustering plan 006

2020-12-12 Thread liwei (Jira)
liwei created HUDI-1454: --- Summary: in unit test have error as Error reading clustering plan 006 Key: HUDI-1454 URL: https://issues.apache.org/jira/browse/HUDI-1454 Project: Apache Hudi Issue Type:

[jira] [Assigned] (HUDI-1448) hudi dla sync skip rt create

2020-12-10 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-1448: --- Assignee: liwei > hudi dla sync skip rt create > - > > Key:

[jira] [Created] (HUDI-1448) hudi dla sync skip rt create

2020-12-10 Thread liwei (Jira)
liwei created HUDI-1448: --- Summary: hudi dla sync skip rt create Key: HUDI-1448 URL: https://issues.apache.org/jira/browse/HUDI-1448 Project: Apache Hudi Issue Type: Sub-task Components:

[jira] [Closed] (HUDI-1349) spark sql support overwrite use replace action with dynamic partitioning

2020-12-09 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei closed HUDI-1349. --- > spark sql support overwrite use replace action with dynamic partitioning >

[jira] [Reopened] (HUDI-1349) spark sql support overwrite use replace action with dynamic partitioning

2020-12-09 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reopened HUDI-1349: - > spark sql support overwrite use replace action with dynamic partitioning >

[jira] [Resolved] (HUDI-1349) spark sql support overwrite use replace action with dynamic partitioning

2020-12-09 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei resolved HUDI-1349. - Resolution: Fixed > spark sql support overwrite use replace action with dynamic partitioning >

[jira] [Updated] (HUDI-1349) spark sql support overwrite use replace action with dynamic partitioning

2020-12-09 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1349: Status: Closed (was: Patch Available) > spark sql support overwrite use replace action with dynamic partitioning

[jira] [Assigned] (HUDI-1437) some description in spark ui is not reality, Not good for performance tracking

2020-12-07 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-1437: --- Assignee: liwei > some description in spark ui is not reality, Not good for performance > tracking >

[jira] [Updated] (HUDI-1437) some description in spark ui is not reality, Not good for performance tracking

2020-12-07 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei updated HUDI-1437: Description: some spark action in hudi ,not set the real description, it is not good for  performance tracking  

[jira] [Created] (HUDI-1437) some description in spark ui is not reality, Not good for performance tracking

2020-12-07 Thread liwei (Jira)
liwei created HUDI-1437: --- Summary: some description in spark ui is not reality, Not good for performance tracking Key: HUDI-1437 URL: https://issues.apache.org/jira/browse/HUDI-1437 Project: Apache Hudi

[jira] [Assigned] (HUDI-1076) CLI tools to support clustering

2020-11-21 Thread liwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-1076: --- Assignee: liwei > CLI tools to support clustering > --- > > Key:

  1   2   3   4   >