[jira] [Updated] (HUDI-6068) Improve logic of getOldestInstantToRetainForClustering when archive timeline

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6068: Fix Version/s: 0.13.1 > Improve logic of getOldestInstantToRetainForClustering when archive timeline >

[jira] [Updated] (HUDI-6068) Improve logic of getOldestInstantToRetainForClustering when archive timeline

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6068: Status: In Progress (was: Open) > Improve logic of getOldestInstantToRetainForClustering when archive

[jira] [Resolved] (HUDI-6068) Improve logic of getOldestInstantToRetainForClustering when archive timeline

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6068. - > Improve logic of getOldestInstantToRetainForClustering when archive timeline >

[jira] [Updated] (HUDI-6132) Fix multiple streaming writers w/ streaming sink

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6132: Fix Version/s: 0.13.1 (was: 0.14.0) > Fix multiple streaming writers w/ streaming

[jira] [Updated] (HUDI-6222) ParquetSchemaConverter shoud always convert the Map key type as not nullable

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6222: Fix Version/s: 0.13.1 (was: 0.14.0) > ParquetSchemaConverter shoud always convert

[jira] [Updated] (HUDI-6134) prevent multi clean run concurrently in flink

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6134: Fix Version/s: 0.13.1 (was: 0.14.0) > prevent multi clean run concurrently in flink

[jira] [Resolved] (HUDI-6199) CDC payload with op field for deletes do not work

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6199. - > CDC payload with op field for deletes do not work > - > >

[jira] [Updated] (HUDI-6199) CDC payload with op field for deletes do not work

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6199: Status: In Progress (was: Open) > CDC payload with op field for deletes do not work >

[jira] [Updated] (HUDI-6204) Add Spark 3.3.2 in bundle validation

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6204: Status: In Progress (was: Open) > Add Spark 3.3.2 in bundle validation >

[jira] [Resolved] (HUDI-6204) Add Spark 3.3.2 in bundle validation

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6204. - > Add Spark 3.3.2 in bundle validation > > > Key:

[jira] [Updated] (HUDI-6196) Keep compatibility for old version archival instants without ACTION_STATE field

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6196: Fix Version/s: 0.13.1 (was: 0.14.0) > Keep compatibility for old version archival

[jira] [Updated] (HUDI-6047) Clustering operation on consistent hashing resulting in duplicate data

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6047: Fix Version/s: 0.13.1 (was: 0.14.0) > Clustering operation on consistent hashing

[jira] [Resolved] (HUDI-5816) Avoid loading archived timeline during meta sync

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5816. - > Avoid loading archived timeline during meta sync > > >

[jira] [Updated] (HUDI-5816) Avoid loading archived timeline during meta sync

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5816: Status: In Progress (was: Open) > Avoid loading archived timeline during meta sync >

[jira] [Resolved] (HUDI-6174) Fix flaky test testCleanerDeleteReplacedDataWithArchive

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6174. - > Fix flaky test testCleanerDeleteReplacedDataWithArchive >

[jira] [Updated] (HUDI-6027) Unnecessary scala-maven-plugin causes build issue with JDK17

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6027: Fix Version/s: 0.13.1 > Unnecessary scala-maven-plugin causes build issue with JDK17 >

[jira] [Updated] (HUDI-6027) Unnecessary scala-maven-plugin causes build issue with JDK17

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6027: Status: Open (was: In Progress) > Unnecessary scala-maven-plugin causes build issue with JDK17 >

[jira] [Updated] (HUDI-6027) Unnecessary scala-maven-plugin causes build issue with JDK17

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6027: Status: In Progress (was: Open) > Unnecessary scala-maven-plugin causes build issue with JDK17 >

[jira] [Resolved] (HUDI-6027) Unnecessary scala-maven-plugin causes build issue with JDK17

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6027. - > Unnecessary scala-maven-plugin causes build issue with JDK17 >

[jira] [Updated] (HUDI-6027) Unnecessary scala-maven-plugin causes build issue with JDK17

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6027: Status: In Progress (was: Open) > Unnecessary scala-maven-plugin causes build issue with JDK17 >

[jira] [Updated] (HUDI-6184) Improve the test on incremental queries

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6184: Status: In Progress (was: Open) > Improve the test on incremental queries >

[jira] [Resolved] (HUDI-6184) Improve the test on incremental queries

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6184. - > Improve the test on incremental queries > --- > > Key:

[jira] [Updated] (HUDI-6127) Flink Hudi Support Commit on empty batch

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6127: Fix Version/s: 0.13.1 (was: 0.14.0) > Flink Hudi Support Commit on empty batch >

[jira] [Resolved] (HUDI-6090) Optimise payload size for list of FileGroupDTO

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6090. - > Optimise payload size for list of FileGroupDTO > -- > >

[jira] [Updated] (HUDI-6090) Optimise payload size for list of FileGroupDTO

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6090: Status: In Progress (was: Open) > Optimise payload size for list of FileGroupDTO >

[jira] [Updated] (HUDI-6090) Optimise payload size for list of FileGroupDTO

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6090: Fix Version/s: 0.13.1 > Optimise payload size for list of FileGroupDTO >

[jira] [Updated] (HUDI-6135) FlinkClusteringConfig adds --sort-memory option to support write.sort.memory config

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6135: Fix Version/s: 0.13.1 (was: 0.14.0) > FlinkClusteringConfig adds --sort-memory

[jira] [Updated] (HUDI-4920) fix PartialUpdatePayload cannot return deleted record in preCombine function issue

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-4920: Fix Version/s: 0.13.1 > fix PartialUpdatePayload cannot return deleted record in preCombine function >

[jira] [Resolved] (HUDI-4920) fix PartialUpdatePayload cannot return deleted record in preCombine function issue

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-4920. - > fix PartialUpdatePayload cannot return deleted record in preCombine function > issue >

[jira] [Updated] (HUDI-4920) fix PartialUpdatePayload cannot return deleted record in preCombine function issue

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-4920: Status: In Progress (was: Open) > fix PartialUpdatePayload cannot return deleted record in preCombine

[jira] [Updated] (HUDI-6091) Add Java 11 and 17 to bundle validation image

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6091: Fix Version/s: 0.13.1 > Add Java 11 and 17 to bundle validation image >

[jira] [Updated] (HUDI-6039) Fix FS based listing in clean planner

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6039: Fix Version/s: 0.13.1 > Fix FS based listing in clean planner > - > >

[jira] [Resolved] (HUDI-6091) Add Java 11 and 17 to bundle validation image

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6091. - > Add Java 11 and 17 to bundle validation image > - > >

[jira] [Resolved] (HUDI-6039) Fix FS based listing in clean planner

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6039. - > Fix FS based listing in clean planner > - > > Key:

[jira] [Updated] (HUDI-6091) Add Java 11 and 17 to bundle validation image

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6091: Status: In Progress (was: Open) > Add Java 11 and 17 to bundle validation image >

[jira] [Updated] (HUDI-6039) Fix FS based listing in clean planner

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6039: Status: In Progress (was: Open) > Fix FS based listing in clean planner >

[jira] [Updated] (HUDI-5509) check if dfs support atomic creation when using filesystem base lock provider

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5509: Fix Version/s: 0.13.1 > check if dfs support atomic creation when using filesystem base lock provider >

[jira] [Updated] (HUDI-5509) check if dfs support atomic creation when using filesystem base lock provider

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5509: Status: In Progress (was: Open) > check if dfs support atomic creation when using filesystem base lock

[jira] [Updated] (HUDI-6015) Refresh the table after executing rollback to instantTime

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6015: Status: In Progress (was: Open) > Refresh the table after executing rollback to instantTime >

[jira] [Resolved] (HUDI-5509) check if dfs support atomic creation when using filesystem base lock provider

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5509. - > check if dfs support atomic creation when using filesystem base lock provider >

[jira] [Updated] (HUDI-5509) check if dfs support atomic creation when using filesystem base lock provider

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5509: Issue Type: Improvement (was: Bug) > check if dfs support atomic creation when using filesystem base lock

[jira] [Updated] (HUDI-6015) Refresh the table after executing rollback to instantTime

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6015: Fix Version/s: 0.13.1 > Refresh the table after executing rollback to instantTime >

[jira] [Resolved] (HUDI-6015) Refresh the table after executing rollback to instantTime

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6015. - > Refresh the table after executing rollback to instantTime >

[jira] [Resolved] (HUDI-6009) Let the jetty server in TimelineService create daemon threads

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6009. - > Let the jetty server in TimelineService create daemon threads >

[jira] [Updated] (HUDI-6071) If the Flink Hive Catalog is used and the table type is Bigint, the Sql Client will report an error

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6071: Fix Version/s: 0.13.1 (was: 0.14.0) > If the Flink Hive Catalog is used and the

[jira] [Updated] (HUDI-6009) Let the jetty server in TimelineService create daemon threads

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6009: Fix Version/s: 0.13.1 > Let the jetty server in TimelineService create daemon threads >

[jira] [Updated] (HUDI-6009) Let the jetty server in TimelineService create daemon threads

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6009: Status: In Progress (was: Open) > Let the jetty server in TimelineService create daemon threads >

[jira] [Updated] (HUDI-6050) We should add HoodieOperation when deduplicate records in WriteHelper

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6050: Fix Version/s: 0.13.1 (was: 0.14.0) > We should add HoodieOperation when deduplicate

[jira] [Updated] (HUDI-6080) Use hoodie.properties to determine if the table exists

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6080: Fix Version/s: 0.13.1 (was: 0.14.0) > Use hoodie.properties to determine if the

[jira] [Updated] (HUDI-5991) Fix RDDCustomColumnsSortPartitioner's RepartitionRecords

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5991: Fix Version/s: 0.13.1 (was: 0.14.0) > Fix RDDCustomColumnsSortPartitioner's

[jira] [Updated] (HUDI-6063) Modify logging errors In JDBCExecutor

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6063: Fix Version/s: 0.13.1 (was: 0.14.0) > Modify logging errors In JDBCExecutor >

[jira] [Updated] (HUDI-6073) Table create schema should not include metadata fields

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6073: Fix Version/s: 0.13.1 (was: 0.14.0) > Table create schema should not include

[jira] [Updated] (HUDI-6048) Exceptions should not be thrown when querying partitions that do not exist

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6048: Fix Version/s: 0.14.0 (was: 0.13.1) > Exceptions should not be thrown when querying

[jira] [Updated] (HUDI-6074) check inlineClusteringEnabled in isAsyncClusteringEnabled

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6074: Fix Version/s: 0.13.1 (was: 0.14.0) > check inlineClusteringEnabled in

[jira] [Updated] (HUDI-6048) Exceptions should not be thrown when querying partitions that do not exist

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6048: Fix Version/s: 0.13.1 (was: 0.14.0) > Exceptions should not be thrown when querying

[jira] [Updated] (HUDI-5990) Incremental queries on MOR sometimes miss data

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5990: Fix Version/s: 0.13.1 (was: 0.14.0) > Incremental queries on MOR sometimes miss data

[jira] [Updated] (HUDI-6053) Fix integration test run for M1 mac

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6053: Fix Version/s: 0.13.1 (was: 0.14.0) > Fix integration test run for M1 mac >

[jira] [Updated] (HUDI-5989) Fix the date conversion issue when lazy fetching partition path & file slice for HoodieFileIndex is used

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5989: Fix Version/s: 0.13.1 (was: 0.14.0) > Fix the date conversion issue when lazy

[jira] [Updated] (HUDI-5406) Troubleshoot NoClassDefFoundError in Integration Tests logs

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5406: Fix Version/s: 0.13.1 (was: 0.14.0) > Troubleshoot NoClassDefFoundError in

[jira] [Updated] (HUDI-5955) Incremental clean does not work with archived commits

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5955: Fix Version/s: 0.13.1 (was: 0.14.0) > Incremental clean does not work with archived

[jira] [Updated] (HUDI-5979) Replace individual hudi modules by hudi-trino-bundle in Trino Hudi connector

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5979: Status: In Progress (was: Reopened) > Replace individual hudi modules by hudi-trino-bundle in Trino Hudi

[jira] [Updated] (HUDI-6038) Fix async compact/clustering serdes conflicts caused by WatermarkStatus in multi versions Flink

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6038: Fix Version/s: 0.13.1 (was: 0.14.0) > Fix async compact/clustering serdes conflicts

[jira] [Updated] (HUDI-6032) Fix Read metafield '_hoodie_commit_time' multiple times from the parquet file when using flink

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6032: Fix Version/s: 0.13.1 (was: 0.14.0) > Fix Read metafield '_hoodie_commit_time'

[jira] [Updated] (HUDI-6045) Support append mode by default for MOR table with INSERT operation

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6045: Fix Version/s: 0.13.1 (was: 0.14.0) > Support append mode by default for MOR table

[jira] [Updated] (HUDI-5921) Partition path should be considered in BucketIndexConcurrentFileWritesConflictResolutionStrategy

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5921: Fix Version/s: 0.13.1 (was: 0.14.0) > Partition path should be considered in >

[jira] [Updated] (HUDI-5992) Kryo SerDe error when performing compaction with GenericData$Fixed types on Hudi-Flink

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5992: Fix Version/s: 0.13.1 (was: 0.14.0) > Kryo SerDe error when performing compaction

[jira] [Resolved] (HUDI-5960) Allow bootstrap procedure to throw an exception when execution fails

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5960. - > Allow bootstrap procedure to throw an exception when execution fails >

[jira] [Updated] (HUDI-5957) Run cluster should fail when using bucket index

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5957: Fix Version/s: 0.13.1 > Run cluster should fail when using bucket index >

[jira] [Updated] (HUDI-5957) Run cluster should fail when using bucket index

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5957: Status: In Progress (was: Open) > Run cluster should fail when using bucket index >

[jira] [Updated] (HUDI-5960) Allow bootstrap procedure to throw an exception when execution fails

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5960: Status: In Progress (was: Open) > Allow bootstrap procedure to throw an exception when execution fails >

[jira] [Resolved] (HUDI-5957) Run cluster should fail when using bucket index

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5957. - > Run cluster should fail when using bucket index > --- > >

[jira] [Updated] (HUDI-5960) Allow bootstrap procedure to throw an exception when execution fails

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5960: Fix Version/s: 0.13.1 > Allow bootstrap procedure to throw an exception when execution fails >

[jira] [Updated] (HUDI-5952) NullPointerException when use kafka callback

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5952: Fix Version/s: 0.13.1 (was: 0.14.0) > NullPointerException when use kafka callback >

[jira] [Updated] (HUDI-5928) PostWriteTermination Strategy does not shutdown the spark job completely

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5928: Fix Version/s: 0.13.1 (was: 0.14.0) > PostWriteTermination Strategy does not

[jira] [Updated] (HUDI-5986) empty preCombineKey should never be stored in hoodie.properties

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5986: Fix Version/s: 0.13.1 (was: 0.14.0) > empty preCombineKey should never be stored in

[jira] [Resolved] (HUDI-5979) Replace individual hudi modules by hudi-trino-bundle in Trino Hudi connector

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5979. - > Replace individual hudi modules by hudi-trino-bundle in Trino Hudi connector >

[jira] [Updated] (HUDI-5927) Improve parallelism of deleting invalid files

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5927: Fix Version/s: 0.13.1 (was: 0.14.0) > Improve parallelism of deleting invalid files

[jira] [Updated] (HUDI-5925) Improve bootstrap parallelism

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5925: Fix Version/s: 0.13.1 (was: 0.14.0) > Improve bootstrap parallelism >

[jira] [Resolved] (HUDI-5919) Fix the validation of partition listing in metadata table validator

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5919. - > Fix the validation of partition listing in metadata table validator >

[jira] [Updated] (HUDI-5926) Improve cleaner parallelism

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5926: Fix Version/s: 0.13.1 (was: 0.14.0) > Improve cleaner parallelism >

[jira] [Updated] (HUDI-5919) Fix the validation of partition listing in metadata table validator

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5919: Status: In Progress (was: Open) > Fix the validation of partition listing in metadata table validator >

[jira] [Updated] (HUDI-5941) Support savepoint CALL procedure with table base path

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5941: Fix Version/s: 0.13.1 (was: 0.14.0) > Support savepoint CALL procedure with table

[jira] [Updated] (HUDI-5870) Fix some comments about column type change rules

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5870: Fix Version/s: 0.13.1 > Fix some comments about column type change rules >

[jira] [Resolved] (HUDI-5870) Fix some comments about column type change rules

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5870. - > Fix some comments about column type change rules > > >

[jira] [Updated] (HUDI-5870) Fix some comments about column type change rules

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5870: Status: In Progress (was: Open) > Fix some comments about column type change rules >

[jira] [Updated] (HUDI-5796) Infer partition path automatically from incoming df if not explicitly set

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5796: Fix Version/s: 0.13.1 (was: 0.14.0) > Infer partition path automatically from

[jira] [Updated] (HUDI-5736) De-coupling column drop flag and schema validation flag in Flink

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5736: Fix Version/s: 0.13.1 > De-coupling column drop flag and schema validation flag in Flink >

[jira] [Updated] (HUDI-5665) Re-use table configs for subsequent writes

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5665: Fix Version/s: 0.13.1 (was: 0.14.0) > Re-use table configs for subsequent writes >

[jira] [Updated] (HUDI-5869) Fix Some Typos in Hudi-Common

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5869: Fix Version/s: 0.13.1 > Fix Some Typos in Hudi-Common > - > >

[jira] [Resolved] (HUDI-5835) spark cannot read mor table after execute update statement

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5835. - > spark cannot read mor table after execute update statement >

[jira] [Updated] (HUDI-5835) spark cannot read mor table after execute update statement

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5835: Status: In Progress (was: Open) > spark cannot read mor table after execute update statement >

[jira] [Updated] (HUDI-5838) Mask sensitive info while printing hudi properties in DeltaStreamer

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5838: Fix Version/s: 0.13.1 (was: 0.14.0) > Mask sensitive info while printing hudi

[jira] [Updated] (HUDI-5455) Add commons configuration2 to cli bundle

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5455: Fix Version/s: 0.13.1 > Add commons configuration2 to cli bundle >

[jira] [Updated] (HUDI-5455) Add commons configuration2 to cli bundle

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5455: Status: In Progress (was: Open) > Add commons configuration2 to cli bundle >

[jira] [Resolved] (HUDI-5455) Add commons configuration2 to cli bundle

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5455. - > Add commons configuration2 to cli bundle > > >

[jira] [Updated] (HUDI-5058) The primary key cannot be empty when Flink reads an error from the hudi table

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5058: Fix Version/s: 0.13.1 > The primary key cannot be empty when Flink reads an error from the hudi table >

[jira] [Updated] (HUDI-5799) Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5799: Status: In Progress (was: Open) > Fix Spark partition validation in

[jira] [Updated] (HUDI-5800) Fix test failure in TestHoodieMergeOnReadTable

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5800: Fix Version/s: 0.13.1 > Fix test failure in TestHoodieMergeOnReadTable >

[jira] [Resolved] (HUDI-5799) Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5799. - > Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows >

[jira] [Updated] (HUDI-5799) Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5799: Fix Version/s: 0.13.1 > Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows >

<    1   2   3   4   5   >