[jira] [Updated] (HUDI-6091) Add Java 11 and 17 to bundle validation image

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6091: Fix Version/s: 0.13.1 > Add Java 11 and 17 to bundle validation image >

[jira] [Updated] (HUDI-6039) Fix FS based listing in clean planner

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6039: Fix Version/s: 0.13.1 > Fix FS based listing in clean planner > - > >

[jira] [Resolved] (HUDI-6091) Add Java 11 and 17 to bundle validation image

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6091. - > Add Java 11 and 17 to bundle validation image > - > >

[jira] [Resolved] (HUDI-6039) Fix FS based listing in clean planner

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6039. - > Fix FS based listing in clean planner > - > > Key:

[jira] [Updated] (HUDI-6091) Add Java 11 and 17 to bundle validation image

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6091: Status: In Progress (was: Open) > Add Java 11 and 17 to bundle validation image >

[jira] [Updated] (HUDI-6039) Fix FS based listing in clean planner

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6039: Status: In Progress (was: Open) > Fix FS based listing in clean planner >

[GitHub] [hudi] hudi-bot commented on pull request #8776: [HUDI-5994] Bucket index supports bulk insert row writer

2023-05-22 Thread via GitHub
hudi-bot commented on PR #8776: URL: https://github.com/apache/hudi/pull/8776#issuecomment-1557134032 ## CI report: * af6ed32c20ef7fbf2336744d63cab1b78b20f819 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8445: [HUDI-3088] Use Spark 3.2 as default Spark version

2023-05-22 Thread via GitHub
hudi-bot commented on PR #8445: URL: https://github.com/apache/hudi/pull/8445#issuecomment-1557132517 ## CI report: * fe98254bcb3001cdb13409ff53a6f1958bd365f9 UNKNOWN * 1f9f158675ba301312206710df2fad27982bc0b3 UNKNOWN * 78d54f595beb56afcafc17cbab200d1ef479eaa3 Azure:

[GitHub] [hudi] danny0405 commented on a diff in pull request #8687: [HUDI-6202] Validate that hiveStylePartitioningEnable is present in t…

2023-05-22 Thread via GitHub
danny0405 commented on code in PR #8687: URL: https://github.com/apache/hudi/pull/8687#discussion_r1200440995 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/SparkHoodieTableFileIndex.scala: ## @@ -319,6 +319,8 @@ class SparkHoodieTableFileIndex(spark:

[GitHub] [hudi] hudi-bot commented on pull request #8776: [HUDI-5994] Bucket index supports bulk insert row writer

2023-05-22 Thread via GitHub
hudi-bot commented on PR #8776: URL: https://github.com/apache/hudi/pull/8776#issuecomment-1557122527 ## CI report: * af6ed32c20ef7fbf2336744d63cab1b78b20f819 Azure:

[jira] [Closed] (HUDI-6237) Fix call stats_file_sizes failure error due to empty globRegex for partitioned tables

2023-05-22 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-6237. Fix Version/s: 0.14.0 Resolution: Fixed Fixed via master branch:

[GitHub] [hudi] danny0405 closed issue #8750: [BUG] call stats_file_sizes failure

2023-05-22 Thread via GitHub
danny0405 closed issue #8750: [BUG] call stats_file_sizes failure URL: https://github.com/apache/hudi/issues/8750 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[hudi] branch master updated (5bcbdada0d0 -> e9cf0443815)

2023-05-22 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 5bcbdada0d0 [HUDI-6244] Add bundle validation images for Spark 3.0 and 3.4 (#8767) add e9cf0443815 [HUDI-6237]

[GitHub] [hudi] danny0405 merged pull request #8755: [HUDI-6237] Fix call stats_file_sizes failure error due to empty glob…

2023-05-22 Thread via GitHub
danny0405 merged PR #8755: URL: https://github.com/apache/hudi/pull/8755 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #8776: [HUDI-5994] Bucket index supports bulk insert row writer

2023-05-22 Thread via GitHub
hudi-bot commented on PR #8776: URL: https://github.com/apache/hudi/pull/8776#issuecomment-1557109246 ## CI report: * af6ed32c20ef7fbf2336744d63cab1b78b20f819 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8445: [HUDI-3088] Use Spark 3.2 as default Spark version

2023-05-22 Thread via GitHub
hudi-bot commented on PR #8445: URL: https://github.com/apache/hudi/pull/8445#issuecomment-1557107156 ## CI report: * fe98254bcb3001cdb13409ff53a6f1958bd365f9 UNKNOWN * 1f9f158675ba301312206710df2fad27982bc0b3 UNKNOWN * 78d54f595beb56afcafc17cbab200d1ef479eaa3 Azure:

[GitHub] [hudi] boneanxs commented on a diff in pull request #8076: [HUDI-5884] Support bulk_insert for insert_overwrite and insert_overwrite_table

2023-05-22 Thread via GitHub
boneanxs commented on code in PR #8076: URL: https://github.com/apache/hudi/pull/8076#discussion_r1200339336 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala: ## @@ -850,9 +854,12 @@ object HoodieSparkSqlWriter { if

[GitHub] [hudi] devanshguptatrepp opened a new issue, #8777: [SUPPORT] Meta sync error when trying to write to s3 bucket

2023-05-22 Thread via GitHub
devanshguptatrepp opened a new issue, #8777: URL: https://github.com/apache/hudi/issues/8777 Describe the problem you faced When trying to write data to hudi, my spark application fails with following error java.lang.Exception: Could not sync using the meta sync class

[GitHub] [hudi] hudi-bot commented on pull request #8478: [HUDI-6086] Improve HiveSchemaUtil#generateCreateDDL With StringBuilder

2023-05-22 Thread via GitHub
hudi-bot commented on PR #8478: URL: https://github.com/apache/hudi/pull/8478#issuecomment-1556965840 ## CI report: * 1b207dfb87f2e63eca74f81b85e4effa41794e2b UNKNOWN * 708a1ba81f47ec600e819d74bd6547e4a9d2258d UNKNOWN * ae2265f4222944c7c4e60a5158c18f8811e2261f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8478: [HUDI-6086] Improve HiveSchemaUtil#generateCreateDDL With StringBuilder

2023-05-22 Thread via GitHub
hudi-bot commented on PR #8478: URL: https://github.com/apache/hudi/pull/8478#issuecomment-1556952528 ## CI report: * 1b207dfb87f2e63eca74f81b85e4effa41794e2b UNKNOWN * 708a1ba81f47ec600e819d74bd6547e4a9d2258d UNKNOWN * ae2265f4222944c7c4e60a5158c18f8811e2261f Azure:

[jira] [Updated] (HUDI-5509) check if dfs support atomic creation when using filesystem base lock provider

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5509: Fix Version/s: 0.13.1 > check if dfs support atomic creation when using filesystem base lock provider >

[jira] [Updated] (HUDI-5509) check if dfs support atomic creation when using filesystem base lock provider

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5509: Status: In Progress (was: Open) > check if dfs support atomic creation when using filesystem base lock

[jira] [Updated] (HUDI-6015) Refresh the table after executing rollback to instantTime

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6015: Status: In Progress (was: Open) > Refresh the table after executing rollback to instantTime >

[jira] [Resolved] (HUDI-5509) check if dfs support atomic creation when using filesystem base lock provider

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5509. - > check if dfs support atomic creation when using filesystem base lock provider >

[jira] [Updated] (HUDI-5509) check if dfs support atomic creation when using filesystem base lock provider

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5509: Issue Type: Improvement (was: Bug) > check if dfs support atomic creation when using filesystem base lock

[jira] [Updated] (HUDI-6015) Refresh the table after executing rollback to instantTime

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6015: Fix Version/s: 0.13.1 > Refresh the table after executing rollback to instantTime >

[jira] [Resolved] (HUDI-6015) Refresh the table after executing rollback to instantTime

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6015. - > Refresh the table after executing rollback to instantTime >

[jira] [Resolved] (HUDI-6009) Let the jetty server in TimelineService create daemon threads

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-6009. - > Let the jetty server in TimelineService create daemon threads >

[jira] [Updated] (HUDI-6071) If the Flink Hive Catalog is used and the table type is Bigint, the Sql Client will report an error

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6071: Fix Version/s: 0.13.1 (was: 0.14.0) > If the Flink Hive Catalog is used and the

[jira] [Updated] (HUDI-6009) Let the jetty server in TimelineService create daemon threads

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6009: Fix Version/s: 0.13.1 > Let the jetty server in TimelineService create daemon threads >

[jira] [Updated] (HUDI-6009) Let the jetty server in TimelineService create daemon threads

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6009: Status: In Progress (was: Open) > Let the jetty server in TimelineService create daemon threads >

[GitHub] [hudi] hudi-bot commented on pull request #8775: [HUDI-5584] Metasync update props when changed

2023-05-22 Thread via GitHub
hudi-bot commented on PR #8775: URL: https://github.com/apache/hudi/pull/8775#issuecomment-1556939384 ## CI report: * c2a8001e786e9218072564f2a8e0ba823fe75242 Azure:

[jira] [Updated] (HUDI-6050) We should add HoodieOperation when deduplicate records in WriteHelper

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6050: Fix Version/s: 0.13.1 (was: 0.14.0) > We should add HoodieOperation when deduplicate

[jira] [Updated] (HUDI-6080) Use hoodie.properties to determine if the table exists

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6080: Fix Version/s: 0.13.1 (was: 0.14.0) > Use hoodie.properties to determine if the

[jira] [Updated] (HUDI-5991) Fix RDDCustomColumnsSortPartitioner's RepartitionRecords

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5991: Fix Version/s: 0.13.1 (was: 0.14.0) > Fix RDDCustomColumnsSortPartitioner's

[jira] [Updated] (HUDI-6063) Modify logging errors In JDBCExecutor

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6063: Fix Version/s: 0.13.1 (was: 0.14.0) > Modify logging errors In JDBCExecutor >

[jira] [Updated] (HUDI-6073) Table create schema should not include metadata fields

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6073: Fix Version/s: 0.13.1 (was: 0.14.0) > Table create schema should not include

[jira] [Updated] (HUDI-6048) Exceptions should not be thrown when querying partitions that do not exist

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6048: Fix Version/s: 0.14.0 (was: 0.13.1) > Exceptions should not be thrown when querying

[jira] [Updated] (HUDI-6074) check inlineClusteringEnabled in isAsyncClusteringEnabled

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6074: Fix Version/s: 0.13.1 (was: 0.14.0) > check inlineClusteringEnabled in

[jira] [Updated] (HUDI-6048) Exceptions should not be thrown when querying partitions that do not exist

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6048: Fix Version/s: 0.13.1 (was: 0.14.0) > Exceptions should not be thrown when querying

[jira] [Updated] (HUDI-5990) Incremental queries on MOR sometimes miss data

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5990: Fix Version/s: 0.13.1 (was: 0.14.0) > Incremental queries on MOR sometimes miss data

[jira] [Updated] (HUDI-6053) Fix integration test run for M1 mac

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6053: Fix Version/s: 0.13.1 (was: 0.14.0) > Fix integration test run for M1 mac >

[jira] [Updated] (HUDI-5989) Fix the date conversion issue when lazy fetching partition path & file slice for HoodieFileIndex is used

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5989: Fix Version/s: 0.13.1 (was: 0.14.0) > Fix the date conversion issue when lazy

[jira] [Updated] (HUDI-5406) Troubleshoot NoClassDefFoundError in Integration Tests logs

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5406: Fix Version/s: 0.13.1 (was: 0.14.0) > Troubleshoot NoClassDefFoundError in

[jira] [Updated] (HUDI-5955) Incremental clean does not work with archived commits

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5955: Fix Version/s: 0.13.1 (was: 0.14.0) > Incremental clean does not work with archived

[jira] [Updated] (HUDI-5979) Replace individual hudi modules by hudi-trino-bundle in Trino Hudi connector

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5979: Status: In Progress (was: Reopened) > Replace individual hudi modules by hudi-trino-bundle in Trino Hudi

[jira] [Updated] (HUDI-6038) Fix async compact/clustering serdes conflicts caused by WatermarkStatus in multi versions Flink

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6038: Fix Version/s: 0.13.1 (was: 0.14.0) > Fix async compact/clustering serdes conflicts

[jira] [Updated] (HUDI-6032) Fix Read metafield '_hoodie_commit_time' multiple times from the parquet file when using flink

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6032: Fix Version/s: 0.13.1 (was: 0.14.0) > Fix Read metafield '_hoodie_commit_time'

[jira] [Updated] (HUDI-6045) Support append mode by default for MOR table with INSERT operation

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6045: Fix Version/s: 0.13.1 (was: 0.14.0) > Support append mode by default for MOR table

[jira] [Updated] (HUDI-5921) Partition path should be considered in BucketIndexConcurrentFileWritesConflictResolutionStrategy

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5921: Fix Version/s: 0.13.1 (was: 0.14.0) > Partition path should be considered in >

[jira] [Updated] (HUDI-5992) Kryo SerDe error when performing compaction with GenericData$Fixed types on Hudi-Flink

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5992: Fix Version/s: 0.13.1 (was: 0.14.0) > Kryo SerDe error when performing compaction

[GitHub] [hudi] Klring commented on issue #8737: [SUPPORT]multi-writer and clustering

2023-05-22 Thread via GitHub
Klring commented on issue #8737: URL: https://github.com/apache/hudi/issues/8737#issuecomment-1556891841 > Do you set the config `write.client.id`,and try again I checked the https://hudi.apache.org/docs/configurations page, but did not find the configuration

[jira] [Resolved] (HUDI-5960) Allow bootstrap procedure to throw an exception when execution fails

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5960. - > Allow bootstrap procedure to throw an exception when execution fails >

[jira] [Updated] (HUDI-5957) Run cluster should fail when using bucket index

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5957: Fix Version/s: 0.13.1 > Run cluster should fail when using bucket index >

[jira] [Updated] (HUDI-5957) Run cluster should fail when using bucket index

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5957: Status: In Progress (was: Open) > Run cluster should fail when using bucket index >

[jira] [Updated] (HUDI-5960) Allow bootstrap procedure to throw an exception when execution fails

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5960: Status: In Progress (was: Open) > Allow bootstrap procedure to throw an exception when execution fails >

[jira] [Resolved] (HUDI-5957) Run cluster should fail when using bucket index

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5957. - > Run cluster should fail when using bucket index > --- > >

[jira] [Updated] (HUDI-5960) Allow bootstrap procedure to throw an exception when execution fails

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5960: Fix Version/s: 0.13.1 > Allow bootstrap procedure to throw an exception when execution fails >

[jira] [Updated] (HUDI-5952) NullPointerException when use kafka callback

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5952: Fix Version/s: 0.13.1 (was: 0.14.0) > NullPointerException when use kafka callback >

[jira] [Updated] (HUDI-5928) PostWriteTermination Strategy does not shutdown the spark job completely

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5928: Fix Version/s: 0.13.1 (was: 0.14.0) > PostWriteTermination Strategy does not

[jira] [Updated] (HUDI-5986) empty preCombineKey should never be stored in hoodie.properties

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5986: Fix Version/s: 0.13.1 (was: 0.14.0) > empty preCombineKey should never be stored in

[jira] [Resolved] (HUDI-5979) Replace individual hudi modules by hudi-trino-bundle in Trino Hudi connector

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5979. - > Replace individual hudi modules by hudi-trino-bundle in Trino Hudi connector >

[jira] [Updated] (HUDI-5927) Improve parallelism of deleting invalid files

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5927: Fix Version/s: 0.13.1 (was: 0.14.0) > Improve parallelism of deleting invalid files

[jira] [Updated] (HUDI-5925) Improve bootstrap parallelism

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5925: Fix Version/s: 0.13.1 (was: 0.14.0) > Improve bootstrap parallelism >

[GitHub] [hudi] hudi-bot commented on pull request #8445: [HUDI-3088] Use Spark 3.2 as default Spark version

2023-05-22 Thread via GitHub
hudi-bot commented on PR #8445: URL: https://github.com/apache/hudi/pull/8445#issuecomment-1556870345 ## CI report: * fe98254bcb3001cdb13409ff53a6f1958bd365f9 UNKNOWN * d8059ab19d150ccfc70a8fb0963c5551884e3b9e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8452: [HUDI-6077] Add more partition push down filters

2023-05-22 Thread via GitHub
hudi-bot commented on PR #8452: URL: https://github.com/apache/hudi/pull/8452#issuecomment-1556870463 ## CI report: * 8082df232089396b2a9f9be2b915e51b3645f172 UNKNOWN * 074aa00e69b27cf9534a492ace4bec8ed2c562f5 Azure:

[jira] [Resolved] (HUDI-5919) Fix the validation of partition listing in metadata table validator

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5919. - > Fix the validation of partition listing in metadata table validator >

[jira] [Updated] (HUDI-5926) Improve cleaner parallelism

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5926: Fix Version/s: 0.13.1 (was: 0.14.0) > Improve cleaner parallelism >

[jira] [Updated] (HUDI-5919) Fix the validation of partition listing in metadata table validator

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5919: Status: In Progress (was: Open) > Fix the validation of partition listing in metadata table validator >

[jira] [Updated] (HUDI-5941) Support savepoint CALL procedure with table base path

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5941: Fix Version/s: 0.13.1 (was: 0.14.0) > Support savepoint CALL procedure with table

[GitHub] [hudi] fujianhua168 commented on issue #8754: [SUPPORT] PrestoDB encountered data quality issues while reading the Hudi Mor table.

2023-05-22 Thread via GitHub
fujianhua168 commented on issue #8754: URL: https://github.com/apache/hudi/issues/8754#issuecomment-1556860739 > As for support in Trino, I am workin on rebasing the MOR snapshot query support on top of master. Thank you very much for your contribution. We look forward to its

[jira] [Updated] (HUDI-5870) Fix some comments about column type change rules

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5870: Fix Version/s: 0.13.1 > Fix some comments about column type change rules >

[jira] [Resolved] (HUDI-5870) Fix some comments about column type change rules

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5870. - > Fix some comments about column type change rules > > >

[jira] [Updated] (HUDI-5870) Fix some comments about column type change rules

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5870: Status: In Progress (was: Open) > Fix some comments about column type change rules >

[jira] [Updated] (HUDI-5796) Infer partition path automatically from incoming df if not explicitly set

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5796: Fix Version/s: 0.13.1 (was: 0.14.0) > Infer partition path automatically from

[jira] [Updated] (HUDI-5736) De-coupling column drop flag and schema validation flag in Flink

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5736: Fix Version/s: 0.13.1 > De-coupling column drop flag and schema validation flag in Flink >

[GitHub] [hudi] hudi-bot commented on pull request #8452: [HUDI-6077] Add more partition push down filters

2023-05-22 Thread via GitHub
hudi-bot commented on PR #8452: URL: https://github.com/apache/hudi/pull/8452#issuecomment-1556857857 ## CI report: * 8082df232089396b2a9f9be2b915e51b3645f172 UNKNOWN * fd10e2fde3f04d17921bbfdff6a62491794795cc Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8445: [HUDI-3088] Use Spark 3.2 as default Spark version

2023-05-22 Thread via GitHub
hudi-bot commented on PR #8445: URL: https://github.com/apache/hudi/pull/8445#issuecomment-1556857725 ## CI report: * fe98254bcb3001cdb13409ff53a6f1958bd365f9 UNKNOWN * d8059ab19d150ccfc70a8fb0963c5551884e3b9e Azure:

[jira] [Updated] (HUDI-5665) Re-use table configs for subsequent writes

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5665: Fix Version/s: 0.13.1 (was: 0.14.0) > Re-use table configs for subsequent writes >

[jira] [Updated] (HUDI-5869) Fix Some Typos in Hudi-Common

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5869: Fix Version/s: 0.13.1 > Fix Some Typos in Hudi-Common > - > >

[jira] [Resolved] (HUDI-5835) spark cannot read mor table after execute update statement

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5835. - > spark cannot read mor table after execute update statement >

[jira] [Updated] (HUDI-5835) spark cannot read mor table after execute update statement

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5835: Status: In Progress (was: Open) > spark cannot read mor table after execute update statement >

[jira] [Updated] (HUDI-5838) Mask sensitive info while printing hudi properties in DeltaStreamer

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5838: Fix Version/s: 0.13.1 (was: 0.14.0) > Mask sensitive info while printing hudi

[jira] [Updated] (HUDI-5455) Add commons configuration2 to cli bundle

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5455: Fix Version/s: 0.13.1 > Add commons configuration2 to cli bundle >

[jira] [Updated] (HUDI-5455) Add commons configuration2 to cli bundle

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5455: Status: In Progress (was: Open) > Add commons configuration2 to cli bundle >

[jira] [Resolved] (HUDI-5455) Add commons configuration2 to cli bundle

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5455. - > Add commons configuration2 to cli bundle > > >

[jira] [Updated] (HUDI-5058) The primary key cannot be empty when Flink reads an error from the hudi table

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5058: Fix Version/s: 0.13.1 > The primary key cannot be empty when Flink reads an error from the hudi table >

[jira] [Updated] (HUDI-5799) Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5799: Status: In Progress (was: Open) > Fix Spark partition validation in

[jira] [Updated] (HUDI-5800) Fix test failure in TestHoodieMergeOnReadTable

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5800: Fix Version/s: 0.13.1 > Fix test failure in TestHoodieMergeOnReadTable >

[jira] [Resolved] (HUDI-5799) Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5799. - > Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows >

[jira] [Updated] (HUDI-5799) Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5799: Fix Version/s: 0.13.1 > Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows >

[jira] [Resolved] (HUDI-5800) Fix test failure in TestHoodieMergeOnReadTable

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang resolved HUDI-5800. - > Fix test failure in TestHoodieMergeOnReadTable > -- > >

[jira] [Updated] (HUDI-5800) Fix test failure in TestHoodieMergeOnReadTable

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5800: Status: In Progress (was: Open) > Fix test failure in TestHoodieMergeOnReadTable >

[GitHub] [hudi] hudi-bot commented on pull request #4913: [HUDI-1517] create marker file for every log file

2023-05-22 Thread via GitHub
hudi-bot commented on PR #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1556836200 ## CI report: * 89082b2b9791a42b0bc612daeef15d816a50a6e9 Azure:

[jira] [Updated] (HUDI-5772) Align Flink clustering configuration with HoodieClusteringConfig

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5772: Fix Version/s: 0.13.1 > Align Flink clustering configuration with HoodieClusteringConfig >

[jira] [Updated] (HUDI-5764) Allow lazy rollback for async indexer commit

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5764: Fix Version/s: 0.13.1 > Allow lazy rollback for async indexer commit >

[jira] [Updated] (HUDI-5768) Fail to read metadata table in Spark Datasource

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5768: Fix Version/s: 0.13.1 > Fail to read metadata table in Spark Datasource >

[jira] [Updated] (HUDI-4968) Fix ambiguous stream read config

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-4968: Fix Version/s: 0.13.1 > Fix ambiguous stream read config > > >

[jira] [Updated] (HUDI-5270) Duplicate key error when insert_overwrite same partition in multi writer

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5270: Fix Version/s: 0.13.1 (was: 0.14.0) > Duplicate key error when insert_overwrite same

[jira] [Updated] (HUDI-5721) Add Github actions on more validations

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5721: Status: In Progress (was: Open) > Add Github actions on more validations >

<    1   2   3   4   5   >