[jira] [Updated] (HUDI-6703) StreamWriteOperatorCoordinator should refresh the last txn metadata firstly for recommit

2023-08-15 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6703: - Description: StreamWriteOperatorCoordinator should refresh the last txn metadata firstly to

[jira] [Created] (HUDI-6703) StreamWriteOperatorCoordinator should refresh the last txn metadata firstly for recommit

2023-08-15 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6703: Summary: StreamWriteOperatorCoordinator should refresh the last txn metadata firstly for recommit Key: HUDI-6703 URL: https://issues.apache.org/jira/browse/HUDI-6703

[jira] [Updated] (HUDI-6669) HoodieEngineContext should not use parallel stream with parallelism greater than CPU cores

2023-08-08 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6669: - Description: HoodieEngineContext should not use parallel stream with parallelism greater than

[jira] [Updated] (HUDI-6669) HoodieEngineContext should not use parallel stream with parallelism greater than CPU cores

2023-08-08 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6669: - Description: HoodieEngineContext should not use parallel stream with parallelism greater than

[jira] [Created] (HUDI-6669) HoodieEngineContext should not use parallel stream with parallelism greater than CPU cores

2023-08-08 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6669: Summary: HoodieEngineContext should not use parallel stream with parallelism greater than CPU cores Key: HUDI-6669 URL: https://issues.apache.org/jira/browse/HUDI-6669

[jira] [Created] (HUDI-6667) ClientIds should generate next id automatically with random uuid instead of incremental id

2023-08-08 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6667: Summary: ClientIds should generate next id automatically with random uuid instead of incremental id Key: HUDI-6667 URL: https://issues.apache.org/jira/browse/HUDI-6667

[jira] [Created] (HUDI-6592) Flink insert overwrite should support dynamic partition instead of whole table

2023-07-26 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6592: Summary: Flink insert overwrite should support dynamic partition instead of whole table Key: HUDI-6592 URL: https://issues.apache.org/jira/browse/HUDI-6592 Project:

[jira] [Created] (HUDI-6541) Multiple writers should create new and different instant time to avoid marker conflict of same instant

2023-07-16 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6541: Summary: Multiple writers should create new and different instant time to avoid marker conflict of same instant Key: HUDI-6541 URL:

[jira] [Created] (HUDI-6540) Support failed writes clean policy for Flink

2023-07-16 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6540: Summary: Support failed writes clean policy for Flink Key: HUDI-6540 URL: https://issues.apache.org/jira/browse/HUDI-6540 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-6519) The default value of read.streaming.enabled is determined by execution.runtime-mode

2023-07-10 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6519: Summary: The default value of read.streaming.enabled is determined by execution.runtime-mode Key: HUDI-6519 URL: https://issues.apache.org/jira/browse/HUDI-6519

[jira] [Updated] (HUDI-6501) StreamWriteOperatorCoordinator should recommit with starting heartbeat for lazy failed writes clean policy

2023-07-06 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6501: - Summary: StreamWriteOperatorCoordinator should recommit with starting heartbeat for lazy failed

[jira] [Updated] (HUDI-6501) Recommit should not abort for heartbeat expired caused by the last failed write

2023-07-06 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6501: - Description: When the last write had failed, HoodieHeartbeatClient would close with stopping all

[jira] [Created] (HUDI-6501) Recommit should not abort for heartbeat expired caused by the last failed write

2023-07-06 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6501: Summary: Recommit should not abort for heartbeat expired caused by the last failed write Key: HUDI-6501 URL: https://issues.apache.org/jira/browse/HUDI-6501 Project:

[jira] [Created] (HUDI-6384) The commit action type of inflight instant for replacecommit should be replacecommit

2023-06-15 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6384: Summary: The commit action type of inflight instant for replacecommit should be replacecommit Key: HUDI-6384 URL: https://issues.apache.org/jira/browse/HUDI-6384

[jira] [Updated] (HUDI-6317) Streaming read should skip compaction and clustering instants to avoid duplicates

2023-06-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6317: - Description: At present, the default value of read.streaming.skip_clustering is false, which

[jira] [Updated] (HUDI-6317) Streaming read should skip compaction and clustering instants to avoid duplicates

2023-06-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6317: - Description: At present, the default value of read.streaming.skip_clustering is false, which

[jira] [Updated] (HUDI-6317) Streaming read should skip compaction and clustering instants to avoid duplicates

2023-06-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6317: - Summary: Streaming read should skip compaction and clustering instants to avoid duplicates (was:

[jira] [Updated] (HUDI-6317) Streaming read should skip clustering instants to avoid duplicated reading

2023-06-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6317: - Status: In Progress (was: Open) > Streaming read should skip clustering instants to avoid

[jira] [Updated] (HUDI-6317) Streaming read should skip clustering instants to avoid duplicated reading

2023-06-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6317: - Summary: Streaming read should skip clustering instants to avoid duplicated reading (was:

[jira] [Updated] (HUDI-6317) Streaming read should skip clustering instants to avoid deplicated reading

2023-06-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6317: - Summary: Streaming read should skip clustering instants to avoid deplicated reading (was:

[jira] [Updated] (HUDI-6317) Streaming read should skip clustering instants

2023-06-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6317: - Description: At present, the default value of read.streaming.skip_clustering is false, which

[jira] [Updated] (HUDI-6317) Streaming read should skip clustering instants

2023-06-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6317: - Description: At present, the default value of read.streaming.skip_clustering is false, which

[jira] [Updated] (HUDI-6317) Streaming read should skip clustering instants

2023-06-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6317: - Description: At present, the default value of read.streaming.skip_clustering is false, which

[jira] [Updated] (HUDI-6317) Streaming read should skip clustering instants

2023-06-04 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6317: - Summary: Streaming read should skip clustering instants (was: The default value of

[jira] [Created] (HUDI-6317) The default value of read.streaming.skip_clustering should be true

2023-06-04 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6317: Summary: The default value of read.streaming.skip_clustering should be true Key: HUDI-6317 URL: https://issues.apache.org/jira/browse/HUDI-6317 Project: Apache Hudi

[jira] [Closed] (HUDI-6292) HoodieRealtimeRecordReader#constructRecordReader leads memory leak

2023-05-31 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang closed HUDI-6292. Resolution: Duplicate > HoodieRealtimeRecordReader#constructRecordReader leads memory leak >

[jira] [Updated] (HUDI-6292) HoodieRealtimeRecordReader#constructRecordReader leads memory leak

2023-05-31 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6292: - Summary: HoodieRealtimeRecordReader#constructRecordReader leads memory leak (was:

[jira] [Created] (HUDI-6292) HoodieRealtimeRecordReader leads memory leak

2023-05-31 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6292: Summary: HoodieRealtimeRecordReader leads memory leak Key: HUDI-6292 URL: https://issues.apache.org/jira/browse/HUDI-6292 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-6281) Comprehensive schema evolution supports column change with a default value

2023-05-29 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6281: - Status: In Progress (was: Open) > Comprehensive schema evolution supports column change with a

[jira] [Created] (HUDI-6281) Comprehensive schema evolution supports column change with a default value

2023-05-29 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6281: Summary: Comprehensive schema evolution supports column change with a default value Key: HUDI-6281 URL: https://issues.apache.org/jira/browse/HUDI-6281 Project:

[jira] [Created] (HUDI-6229) HoodieInternalWriteStatus marks failure with totalErrorRecords increment

2023-05-17 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6229: Summary: HoodieInternalWriteStatus marks failure with totalErrorRecords increment Key: HUDI-6229 URL: https://issues.apache.org/jira/browse/HUDI-6229 Project: Apache

[jira] [Created] (HUDI-6218) Support instant_time/commit_time of savepoint procedure optional

2023-05-16 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6218: Summary: Support instant_time/commit_time of savepoint procedure optional Key: HUDI-6218 URL: https://issues.apache.org/jira/browse/HUDI-6218 Project: Apache Hudi

[jira] [Updated] (HUDI-6192) HoodieFlinkCompactor and HoodieFlinkClusteringJob supports streaming mode in service mode

2023-05-10 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6192: - Summary: HoodieFlinkCompactor and HoodieFlinkClusteringJob supports streaming mode in service

[jira] [Updated] (HUDI-6192) HoodieFlinkCompactor and HoodieFlinkClusteringJob supports streaming mode in service mode

2023-05-10 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6192: - Description: HoodieFlinkCompactor and HoodieFlinkClusteringJob supports streaming mode in service

[jira] [Updated] (HUDI-6192) HoodieFlinkCompactor and HoodieFlinkClustering supports streaming mode in service mode

2023-05-09 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6192: - Description: HoodieFlinkCompactor and HoodieFlinkClustering supports streaming mode in service

[jira] [Updated] (HUDI-6192) HoodieFlinkCompactor and HoodieFlinkClustering supports streaming mode in service mode

2023-05-09 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6192: - Summary: HoodieFlinkCompactor and HoodieFlinkClustering supports streaming mode in service mode

[jira] [Updated] (HUDI-6192) HoodieFlinkCompactor and HoodieFlinkClusteringJob supports streaming mode in service mode

2023-05-09 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6192: - Description: HoodieFlinkCompactor and HoodieFlinkClusteringJob supports streaming mode in service

[jira] [Updated] (HUDI-6192) HoodieFlinkCompactor and HoodieFlinkClusteringJob supports streaming mode in service mode

2023-05-09 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-6192: - Summary: HoodieFlinkCompactor and HoodieFlinkClusteringJob supports streaming mode in service

[jira] [Created] (HUDI-6192) HoodieFlinkCompactor and HoodieFlinkClusteringJob supports streaming mode

2023-05-08 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6192: Summary: HoodieFlinkCompactor and HoodieFlinkClusteringJob supports streaming mode Key: HUDI-6192 URL: https://issues.apache.org/jira/browse/HUDI-6192 Project:

[jira] [Created] (HUDI-6158) Strengthen Flink clustering commit and rollback strategy

2023-04-30 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6158: Summary: Strengthen Flink clustering commit and rollback strategy Key: HUDI-6158 URL: https://issues.apache.org/jira/browse/HUDI-6158 Project: Apache Hudi

[jira] [Assigned] (HUDI-6135) FlinkClusteringConfig adds --sort-memory option to support write.sort.memory config

2023-04-24 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-6135: Assignee: Nicholas Jiang > FlinkClusteringConfig adds --sort-memory option to support

[jira] [Created] (HUDI-6135) FlinkClusteringConfig adds --sort-memory option to support write.sort.memory config

2023-04-24 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6135: Summary: FlinkClusteringConfig adds --sort-memory option to support write.sort.memory config Key: HUDI-6135 URL: https://issues.apache.org/jira/browse/HUDI-6135

[jira] [Assigned] (HUDI-6066) HoodieTableSource supports parquet predicate push down

2023-04-12 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-6066: Assignee: Nicholas Jiang > HoodieTableSource supports parquet predicate push down >

[jira] [Created] (HUDI-6066) HoodieTableSource supports parquet predicate push down

2023-04-12 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-6066: Summary: HoodieTableSource supports parquet predicate push down Key: HUDI-6066 URL: https://issues.apache.org/jira/browse/HUDI-6066 Project: Apache Hudi

[jira] [Reopened] (HUDI-5728) HoodieTimelineArchiver archives the latest instant before inflight replacecommit

2023-03-04 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reopened HUDI-5728: -- > HoodieTimelineArchiver archives the latest instant before inflight > replacecommit >

[jira] [Resolved] (HUDI-5728) HoodieTimelineArchiver archives the latest instant before inflight replacecommit

2023-03-04 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang resolved HUDI-5728. -- > HoodieTimelineArchiver archives the latest instant before inflight > replacecommit >

[jira] [Reopened] (HUDI-5772) Align Flink clustering configuration with HoodieClusteringConfig

2023-03-04 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reopened HUDI-5772: -- > Align Flink clustering configuration with HoodieClusteringConfig >

[jira] [Resolved] (HUDI-5772) Align Flink clustering configuration with HoodieClusteringConfig

2023-03-04 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang resolved HUDI-5772. -- > Align Flink clustering configuration with HoodieClusteringConfig >

[jira] [Closed] (HUDI-5531) RECENT_DAYS strategy of ClusteringPlanPartitionFilterMode should rename to RECENT_PARTITIONS

2023-03-04 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang closed HUDI-5531. Resolution: Won't Fix > RECENT_DAYS strategy of ClusteringPlanPartitionFilterMode should rename to

[jira] [Closed] (HUDI-2503) HoodieFlinkWriteClient supports to allow parallel writing to tables using Locking service

2023-03-04 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang closed HUDI-2503. Resolution: Fixed > HoodieFlinkWriteClient supports to allow parallel writing to tables using >

[jira] [Closed] (HUDI-5772) Align Flink clustering configuration with HoodieClusteringConfig

2023-03-04 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang closed HUDI-5772. Resolution: Fixed > Align Flink clustering configuration with HoodieClusteringConfig >

[jira] [Closed] (HUDI-5728) HoodieTimelineArchiver archives the latest instant before inflight replacecommit

2023-03-04 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang closed HUDI-5728. Resolution: Fixed > HoodieTimelineArchiver archives the latest instant before inflight >

[jira] [Updated] (HUDI-5787) HMSDDLExecutor should set table type to EXTERNAL_TABLE when hoodie.datasource.hive_sync.create_managed_table of sync config is false

2023-02-14 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-5787: - Description: HMSDDLExecutor should set the table type of Hive table to EXTERNAL_TABLE when

[jira] [Updated] (HUDI-5787) HMSDDLExecutor should set table type to EXTERNAL_TABLE when hoodie.datasource.hive_sync.create_managed_table of sync config is false

2023-02-14 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-5787: - Summary: HMSDDLExecutor should set table type to EXTERNAL_TABLE when

[jira] [Updated] (HUDI-5787) HMSDDLExecutor should set table type to EXTERNAL_TABLE when setting hoodie.datasource.hive_sync.create_managed_table to false

2023-02-14 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-5787: - Summary: HMSDDLExecutor should set table type to EXTERNAL_TABLE when setting

[jira] [Assigned] (HUDI-5787) HoodieHiveCatalog should not delete data for dropping external table

2023-02-13 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-5787: Assignee: Nicholas Jiang > HoodieHiveCatalog should not delete data for dropping external

[jira] [Created] (HUDI-5787) HoodieHiveCatalog should not delete data for dropping external table

2023-02-13 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-5787: Summary: HoodieHiveCatalog should not delete data for dropping external table Key: HUDI-5787 URL: https://issues.apache.org/jira/browse/HUDI-5787 Project: Apache

[jira] [Assigned] (HUDI-1741) Row Level TTL Support for records stored in Hudi

2023-02-13 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-1741: Assignee: Nicholas Jiang > Row Level TTL Support for records stored in Hudi >

[jira] [Created] (HUDI-5772) Align Flink clustering configuration with HoodieClusteringConfig

2023-02-12 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-5772: Summary: Align Flink clustering configuration with HoodieClusteringConfig Key: HUDI-5772 URL: https://issues.apache.org/jira/browse/HUDI-5772 Project: Apache Hudi

[jira] [Updated] (HUDI-5728) HoodieTimelineArchiver archives the latest instant before inflight replacecommit

2023-02-07 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-5728: - Summary: HoodieTimelineArchiver archives the latest instant before inflight replacecommit (was:

[jira] [Created] (HUDI-5728) HoodieTimelineArchiver archive the latest instant before inflight replacecommit

2023-02-07 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-5728: Summary: HoodieTimelineArchiver archive the latest instant before inflight replacecommit Key: HUDI-5728 URL: https://issues.apache.org/jira/browse/HUDI-5728 Project:

[jira] [Assigned] (HUDI-5728) HoodieTimelineArchiver archive the latest instant before inflight replacecommit

2023-02-07 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-5728: Assignee: Nicholas Jiang > HoodieTimelineArchiver archive the latest instant before

[jira] [Created] (HUDI-5663) The pending table service operation should check whether the partition corresponding to the filegroup exists

2023-01-31 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-5663: Summary: The pending table service operation should check whether the partition corresponding to the filegroup exists Key: HUDI-5663 URL:

[jira] [Closed] (HUDI-5553) ALTER TABLE DROP PARTITION DDL may cause data inconsistencies when table service actions are performed

2023-01-31 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang closed HUDI-5553. Resolution: Fixed > ALTER TABLE DROP PARTITION DDL may cause data inconsistencies when table >

[jira] [Created] (HUDI-5558) Serializable interface implementation don't explicitly declare serialVersionUID

2023-01-15 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-5558: Summary: Serializable interface implementation don't explicitly declare serialVersionUID Key: HUDI-5558 URL: https://issues.apache.org/jira/browse/HUDI-5558 Project:

[jira] [Assigned] (HUDI-5543) Description of clustering.plan.partition.filter.mode supports DAY_ROLLING strategy

2023-01-12 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-5543: Assignee: Nicholas Jiang > Description of clustering.plan.partition.filter.mode supports

[jira] [Created] (HUDI-5543) Description of clustering.plan.partition.filter.mode supports DAY_ROLLING strategy

2023-01-12 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-5543: Summary: Description of clustering.plan.partition.filter.mode supports DAY_ROLLING strategy Key: HUDI-5543 URL: https://issues.apache.org/jira/browse/HUDI-5543

[jira] [Commented] (HUDI-5531) RECENT_DAYS strategy of ClusteringPlanPartitionFilterMode should rename to RECENT_PARTITIONS

2023-01-12 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17675992#comment-17675992 ] Nicholas Jiang commented on HUDI-5531: -- [~yihua], [~xleesf] , WDYT? > RECENT_DAYS strategy of

[jira] [Updated] (HUDI-5531) RECENT_DAYS strategy of ClusteringPlanPartitionFilterMode should rename to RECENT_PARTITIONS

2023-01-11 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-5531: - Issue Type: Improvement (was: Task) > RECENT_DAYS strategy of ClusteringPlanPartitionFilterMode

[jira] [Created] (HUDI-5531) RECENT_DAYS strategy of ClusteringPlanPartitionFilterMode should rename to RECENT_PARTITIONS

2023-01-11 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-5531: Summary: RECENT_DAYS strategy of ClusteringPlanPartitionFilterMode should rename to RECENT_PARTITIONS Key: HUDI-5531 URL: https://issues.apache.org/jira/browse/HUDI-5531

[jira] [Assigned] (HUDI-5531) RECENT_DAYS strategy of ClusteringPlanPartitionFilterMode should rename to RECENT_PARTITIONS

2023-01-11 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-5531: Assignee: Nicholas Jiang > RECENT_DAYS strategy of ClusteringPlanPartitionFilterMode

[jira] [Created] (HUDI-5506) StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event

2023-01-04 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-5506: Summary: StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event Key: HUDI-5506 URL: https://issues.apache.org/jira/browse/HUDI-5506

[jira] [Assigned] (HUDI-5506) StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event

2023-01-04 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-5506: Assignee: Nicholas Jiang > StreamWriteOperatorCoordinator may not recommit with partial

[jira] [Updated] (HUDI-5343) HoodieFlinkStreamer supports async clustering for append mode

2022-12-07 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-5343: - Description: HoodieFlinkStreamer supports async clustering for append mode, which keeps the

[jira] [Assigned] (HUDI-5343) HoodieFlinkStreamer supports async clustering for append mode

2022-12-07 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-5343: Assignee: Nicholas Jiang > HoodieFlinkStreamer supports async clustering for append mode >

[jira] [Created] (HUDI-5343) HoodieFlinkStreamer supports async clustering for append mode

2022-12-07 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-5343: Summary: HoodieFlinkStreamer supports async clustering for append mode Key: HUDI-5343 URL: https://issues.apache.org/jira/browse/HUDI-5343 Project: Apache Hudi

[jira] [Created] (HUDI-5252) ClusteringCommitSink supports to rollback clustering

2022-11-21 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-5252: Summary: ClusteringCommitSink supports to rollback clustering Key: HUDI-5252 URL: https://issues.apache.org/jira/browse/HUDI-5252 Project: Apache Hudi Issue

[jira] [Assigned] (HUDI-5252) ClusteringCommitSink supports to rollback clustering

2022-11-21 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-5252: Assignee: Nicholas Jiang > ClusteringCommitSink supports to rollback clustering >

[jira] [Assigned] (HUDI-5206) RowColumnReader should not return null value for certain null child columns

2022-11-13 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-5206: Assignee: Nicholas Jiang > RowColumnReader should not return null value for certain null

[jira] [Created] (HUDI-5206) RowColumnReader should not return null value for certain null child columns

2022-11-13 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-5206: Summary: RowColumnReader should not return null value for certain null child columns Key: HUDI-5206 URL: https://issues.apache.org/jira/browse/HUDI-5206 Project:

[jira] [Comment Edited] (HUDI-1741) Row Level TTL Support for records stored in Hudi

2022-10-27 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625400#comment-17625400 ] Nicholas Jiang edited comment on HUDI-1741 at 10/28/22 3:10 AM:

[jira] [Commented] (HUDI-1741) Row Level TTL Support for records stored in Hudi

2022-10-27 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625400#comment-17625400 ] Nicholas Jiang commented on HUDI-1741: -- [~shivnarayan], IMO, each record of hudi has the commit time

[jira] [Updated] (HUDI-5049) HoodieCatalog supports the implementation of dropPartition

2022-10-18 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-5049: - Description: HoodieCatalog doesn't support the implementation of dropPartition at present, which

[jira] [Assigned] (HUDI-5049) HoodieCatalog supports the implementation of dropPartition

2022-10-18 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-5049: Assignee: Nicholas Jiang > HoodieCatalog supports the implementation of dropPartition >

[jira] [Created] (HUDI-5049) HoodieCatalog supports the implementation of dropPartition

2022-10-18 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-5049: Summary: HoodieCatalog supports the implementation of dropPartition Key: HUDI-5049 URL: https://issues.apache.org/jira/browse/HUDI-5049 Project: Apache Hudi

[jira] [Updated] (HUDI-4914) Managed memory weight should be set when sort clustering is enabled

2022-09-26 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-4914: - Status: In Progress (was: Open) > Managed memory weight should be set when sort clustering is

[jira] [Updated] (HUDI-4914) Managed memory weight should be set when sort clustering is enabled

2022-09-24 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-4914: - Affects Version/s: (was: 0.12.0) > Managed memory weight should be set when sort clustering

[jira] [Updated] (HUDI-4914) Managed memory weight should be set when sort clustering is enabled

2022-09-24 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-4914: - Priority: Critical (was: Major) > Managed memory weight should be set when sort clustering is

[jira] [Assigned] (HUDI-4914) Managed memory weight should be set when sort clustering is enabled

2022-09-24 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-4914: Assignee: Nicholas Jiang > Managed memory weight should be set when sort clustering is

[jira] [Updated] (HUDI-4914) Managed memory weight should be set when sort clustering is enabled

2022-09-24 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang updated HUDI-4914: - Fix Version/s: 0.12.1 > Managed memory weight should be set when sort clustering is enabled >

[jira] [Created] (HUDI-4914) Managed memory weight should be set when sort clustering is enabled

2022-09-24 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-4914: Summary: Managed memory weight should be set when sort clustering is enabled Key: HUDI-4914 URL: https://issues.apache.org/jira/browse/HUDI-4914 Project: Apache Hudi

[jira] (HUDI-4269) Support multiple precombine fields

2022-08-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4269 ] Nicholas Jiang deleted comment on HUDI-4269: -- was (Author: nicholasjiang): [~danny0405], I have interest to multiple precombine fields. Could you please assign this ticket to me? > Support

[jira] [Assigned] (HUDI-1161) Support update partial fields for MoR table

2022-08-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-1161: Assignee: Jian Feng (was: Nicholas Jiang) > Support update partial fields for MoR table >

[jira] [Assigned] (HUDI-2545) Flink compaction source supports the Source interface based on FLIP-27

2022-08-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-2545: Assignee: yuemeng (was: Nicholas Jiang) > Flink compaction source supports the Source

[jira] [Assigned] (HUDI-2441) To support partial update function which can move and update the data from the old partition to the new partition , when the data with same key change it's partition

2022-08-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-2441: Assignee: David_Liang (was: Nicholas Jiang) > To support partial update function which

[jira] [Assigned] (HUDI-4551) The default value of READ_TASKS, WRITE_TASKS, CLUSTERING_TASKS is the parallelism of the execution environment

2022-08-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-4551: Assignee: Nicholas Jiang > The default value of READ_TASKS, WRITE_TASKS, CLUSTERING_TASKS

[jira] [Created] (HUDI-4551) The default value of READ_TASKS, WRITE_TASKS, CLUSTERING_TASKS is the parallelism of the execution environment

2022-08-05 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-4551: Summary: The default value of READ_TASKS, WRITE_TASKS, CLUSTERING_TASKS is the parallelism of the execution environment Key: HUDI-4551 URL:

[jira] [Closed] (HUDI-4536) ClusteringOperator causes the NullPointerException when writing with BulkInsertWriterHelper in clustering

2022-08-05 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang closed HUDI-4536. Reviewers: Danny Chen Resolution: Fixed > ClusteringOperator causes the NullPointerException

[jira] [Assigned] (HUDI-4536) ClusteringOperator causes the NullPointerException when writing with BulkInsertWriterHelper in clustering

2022-08-04 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Jiang reassigned HUDI-4536: Assignee: Nicholas Jiang > ClusteringOperator causes the NullPointerException when writing

[jira] [Created] (HUDI-4536) ClusteringOperator causes the NullPointerException when writing with BulkInsertWriterHelper in clustering

2022-08-04 Thread Nicholas Jiang (Jira)
Nicholas Jiang created HUDI-4536: Summary: ClusteringOperator causes the NullPointerException when writing with BulkInsertWriterHelper in clustering Key: HUDI-4536 URL:

  1   2   >