[GitHub] [hudi] Zouxxyy commented on a diff in pull request #9332: [HUDI-6625] Lazy create metadata and viewManager in HoodieTable

Zouxxyy commented on code in PR #9332: URL: https://github.com/apache/hudi/pull/9332#discussion_r1281464112 ## hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/storage/row/TestHoodieRowCreateHandle.java: ## @@ -187,7 +187,9 @@ public void testInstantiationFailure(b

[GitHub] [hudi] hudi-bot commented on pull request #9330: [HUDI-6622] Reuse the table config from HoodieTableMetaClient in the …

hudi-bot commented on PR #9330: URL: https://github.com/apache/hudi/pull/9330#issuecomment-1661590662 ## CI report: * d41ace0369057dca454b81fc373e1fb5e45ffe23 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=189

[GitHub] [hudi] Zouxxyy commented on a diff in pull request #9332: [HUDI-6625] Lazy create metadata and viewManager in HoodieTable

Zouxxyy commented on code in PR #9332: URL: https://github.com/apache/hudi/pull/9332#discussion_r1281459986 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/HoodieSparkTable.java: ## @@ -53,7 +53,7 @@ protected HoodieSparkTable(HoodieWriteConfig config, Hood

[GitHub] [hudi] xushiyan commented on a diff in pull request #8697: [HUDI-5514] Improving usability/performance with out of box default for append only use-cases

xushiyan commented on code in PR #8697: URL: https://github.com/apache/hudi/pull/8697#discussion_r1281457455 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala: ## @@ -429,6 +416,40 @@ object HoodieSparkSqlWriter { } }

[GitHub] [hudi] hudi-bot commented on pull request #9330: [HUDI-6622] Reuse the table config from HoodieTableMetaClient in the …

hudi-bot commented on PR #9330: URL: https://github.com/apache/hudi/pull/9330#issuecomment-1661582112 ## CI report: * 72a29231ecc147a87700ef70a524a40cf70a8840 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1895

[GitHub] [hudi] hudi-bot commented on pull request #9113: [HUDI-6466] Fix spark insert overwrite partitioned table with dynamic partition

hudi-bot commented on PR #9113: URL: https://github.com/apache/hudi/pull/9113#issuecomment-1661581407 ## CI report: * a14a5534ce3d3ed64a52fcfbb5c97b907c2e914c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1897

[GitHub] [hudi] 1032851561 commented on issue #9339: [BUG] TaskManager exit with 143 when bucket_assigner is INITIALIZING

1032851561 commented on issue #9339: URL: https://github.com/apache/hudi/issues/9339#issuecomment-1661578324 > But stil got confused because the original code does not really throw exception: > > ```java > WriteProfiles.getCommitMetadataSafely(config.getTableName(), basePath, inst

[GitHub] [hudi] flashJd commented on pull request #9113: [HUDI-6466] Fix spark insert overwrite partitioned table with dynamic partition

flashJd commented on PR #9113: URL: https://github.com/apache/hudi/pull/9113#issuecomment-1661573425 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot commented on pull request #9327: [HUDI-6617] make HoodieRecordDelegate implement KryoSerializable

hudi-bot commented on PR #9327: URL: https://github.com/apache/hudi/pull/9327#issuecomment-1661573327 ## CI report: * d875b12ed9e6742f2ad1a2dcd8405d7ab74295a2 UNKNOWN * 49498a06f3f74ef66f7f732b5d906210bdc1c98d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9237: [HUDI-6569] Fix write failure for Avro Enum type

hudi-bot commented on PR #9237: URL: https://github.com/apache/hudi/pull/9237#issuecomment-1661572971 ## CI report: * b0b58a2ef7136e105139881694333ed481c0b4d9 UNKNOWN * 71c11aa3b61634102d4dac556c314136dbd851ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9113: [HUDI-6466] Fix spark insert overwrite partitioned table with dynamic partition

hudi-bot commented on PR #9113: URL: https://github.com/apache/hudi/pull/9113#issuecomment-1661572696 ## CI report: * a14a5534ce3d3ed64a52fcfbb5c97b907c2e914c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1897

[GitHub] [hudi] 1032851561 commented on issue #9339: [BUG] TaskManager exit with 143 when bucket_assigner is INITIALIZING

1032851561 commented on issue #9339: URL: https://github.com/apache/hudi/issues/9339#issuecomment-1661572649 > Yeah, `org.apache.hudi.sink.partitioner.profile.WriteProfile#averageBytesPerRecord` tries to read the commit file to fetch some size info, it seems the commit file is not complete

[GitHub] [hudi] xushiyan commented on a diff in pull request #9324: [HUDI-6619] [WIP] Fix hudi-integ-test-bundle dependency on jackson jsk310 package.

xushiyan commented on code in PR #9324: URL: https://github.com/apache/hudi/pull/9324#discussion_r1281444222 ## pom.xml: ## @@ -98,8 +98,6 @@ ${fasterxml.spark3.version} ${fasterxml.spark3.version} ${fasterxml.spark3.version} - - Review Comment: > t

[GitHub] [hudi] eric9204 commented on a diff in pull request #9330: [HUDI-6622] Reuse the table config from HoodieTableMetaClient in the …

eric9204 commented on code in PR #9330: URL: https://github.com/apache/hudi/pull/9330#discussion_r1281439455 ## hudi-platform-service/hudi-metaserver/hudi-metaserver-client/src/main/java/org/apache/hudi/common/table/HoodieTableMetaserverClient.java: ## @@ -63,15 +60,12 @@ public

[GitHub] [hudi] hudi-bot commented on pull request #9327: [HUDI-6617] make HoodieRecordDelegate implement KryoSerializable

hudi-bot commented on PR #9327: URL: https://github.com/apache/hudi/pull/9327#issuecomment-1661527046 ## CI report: * d875b12ed9e6742f2ad1a2dcd8405d7ab74295a2 UNKNOWN * 49498a06f3f74ef66f7f732b5d906210bdc1c98d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9261: [HUDI-6579] Adding support for upsert and deletes with spark datasource for pk less table

hudi-bot commented on PR #9261: URL: https://github.com/apache/hudi/pull/9261#issuecomment-1661526805 ## CI report: * 15220b94628cc0432abfb3a147ada8997c4420e3 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=189

[GitHub] [hudi] hudi-bot commented on pull request #9237: [HUDI-6569] Fix write failure for Avro Enum type

hudi-bot commented on PR #9237: URL: https://github.com/apache/hudi/pull/9237#issuecomment-1661526693 ## CI report: * b0b58a2ef7136e105139881694333ed481c0b4d9 UNKNOWN * 71c11aa3b61634102d4dac556c314136dbd851ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] danny0405 commented on a diff in pull request #9229: [HUDI-6565] Spark offline compaction add failed retry mechanism

danny0405 commented on code in PR #9229: URL: https://github.com/apache/hudi/pull/9229#discussion_r1281414915 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieCompactor.java: ## @@ -265,11 +267,36 @@ private int doCompact(JavaSparkContext jsc) throws Exception {

[GitHub] [hudi] hudi-bot commented on pull request #9273: [HUDI-6320] Fix partition parsing in Spark file index for custom keygen

hudi-bot commented on PR #9273: URL: https://github.com/apache/hudi/pull/9273#issuecomment-1661519603 ## CI report: * ccdc272f4c7c61263f15174d9b468301800b25c9 UNKNOWN * 0cdbf1e6d0feec799e69f20c5345113d20bf3d53 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9261: [HUDI-6579] Adding support for upsert and deletes with spark datasource for pk less table

hudi-bot commented on PR #9261: URL: https://github.com/apache/hudi/pull/9261#issuecomment-1661519564 ## CI report: * 84ef26635cf016f0e4466754ad89f8b70b66d889 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1893

[GitHub] [hudi] SteNicholas commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink

SteNicholas commented on PR #9211: URL: https://github.com/apache/hudi/pull/9211#issuecomment-1661519274 @danny0405, the CI is successful. PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [hudi] eric9204 commented on a diff in pull request #9327: [HUDI-6617] make HoodieRecordDelegate implement KryoSerializable

eric9204 commented on code in PR #9327: URL: https://github.com/apache/hudi/pull/9327#discussion_r1281413079 ## hudi-common/src/test/java/org/apache/hudi/common/model/TestHoodieRecordDelegate.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] [hudi] eric9204 commented on a diff in pull request #9327: [HUDI-6617] make HoodieRecordDelegate implement KryoSerializable

eric9204 commented on code in PR #9327: URL: https://github.com/apache/hudi/pull/9327#discussion_r1281412954 ## hudi-common/src/test/java/org/apache/hudi/common/model/TestHoodieRecordDelegate.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[hudi] branch master updated (5bf89964c8d -> a495c16696d)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 5bf89964c8d [MINOR] Builder#numTolerableHeartbeatMisses should set numTolerableHeartbeatMisses variable in ClientIds

[GitHub] [hudi] danny0405 merged pull request #9325: [HUDI-6624]Fix to return a empty list when there is no commit instant to read

danny0405 merged PR #9325: URL: https://github.com/apache/hudi/pull/9325 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

[GitHub] [hudi] danny0405 merged pull request #9334: [MINOR] Builder#numTolerableHeartbeatMisses should set numTolerableHeartbeatMisses variable in ClientIds

danny0405 merged PR #9334: URL: https://github.com/apache/hudi/pull/9334 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

[hudi] branch master updated: [MINOR] Builder#numTolerableHeartbeatMisses should set numTolerableHeartbeatMisses variable in ClientIds (#9334)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 5bf89964c8d [MINOR] Builder#numTolerableHeartbe

[GitHub] [hudi] danny0405 commented on a diff in pull request #9332: [HUDI-6625] Lazy create metadata and viewManager in HoodieTable

danny0405 commented on code in PR #9332: URL: https://github.com/apache/hudi/pull/9332#discussion_r1281408958 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/HoodieSparkTable.java: ## @@ -53,7 +53,7 @@ protected HoodieSparkTable(HoodieWriteConfig config, Ho

[GitHub] [hudi] hudi-bot commented on pull request #9340: [HUDI-6630] Automatic release connection for hoodie metaserver client

hudi-bot commented on PR #9340: URL: https://github.com/apache/hudi/pull/9340#issuecomment-1661513887 ## CI report: * de0ad1dd3783cc2a9fb47e4266c2a345ca444387 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1898

[GitHub] [hudi] hudi-bot commented on pull request #9332: [HUDI-6625] Lazy create metadata and viewManager in HoodieTable

hudi-bot commented on PR #9332: URL: https://github.com/apache/hudi/pull/9332#issuecomment-1661513832 ## CI report: * daa28a4bd88b29bf80b19210dfb4a54667e07cae UNKNOWN * 085364149cfdf26c706702db32294cf486d8af97 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9324: [HUDI-6619] [WIP] Fix hudi-integ-test-bundle dependency on jackson jsk310 package.

hudi-bot commented on PR #9324: URL: https://github.com/apache/hudi/pull/9324#issuecomment-1661513742 ## CI report: * 98e49fad21b4c7b1151e96c7a72b18caf5014a7f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1893

[GitHub] [hudi] hudi-bot commented on pull request #9237: [HUDI-6569] Fix write failure for Avro Enum type

hudi-bot commented on PR #9237: URL: https://github.com/apache/hudi/pull/9237#issuecomment-1661513479 ## CI report: * b0b58a2ef7136e105139881694333ed481c0b4d9 UNKNOWN * 71c11aa3b61634102d4dac556c314136dbd851ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] danny0405 commented on a diff in pull request #9332: [HUDI-6625] Lazy create metadata and viewManager in HoodieTable

danny0405 commented on code in PR #9332: URL: https://github.com/apache/hudi/pull/9332#discussion_r1281408540 ## hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/storage/row/TestHoodieRowCreateHandle.java: ## @@ -187,7 +187,9 @@ public void testInstantiationFailure

[GitHub] [hudi] danny0405 commented on a diff in pull request #9327: [HUDI-6617] make HoodieRecordDelegate implement KryoSerializable

danny0405 commented on code in PR #9327: URL: https://github.com/apache/hudi/pull/9327#discussion_r1281405234 ## hudi-common/src/test/java/org/apache/hudi/common/model/TestHoodieRecordDelegate.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

[GitHub] [hudi] danny0405 commented on a diff in pull request #9327: [HUDI-6617] make HoodieRecordDelegate implement KryoSerializable

danny0405 commented on code in PR #9327: URL: https://github.com/apache/hudi/pull/9327#discussion_r1281404983 ## hudi-common/src/test/java/org/apache/hudi/common/model/TestHoodieRecordDelegate.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

[GitHub] [hudi] amrishlal commented on pull request #9324: [HUDI-6619] [WIP] Fix hudi-integ-test-bundle dependency on jackson jsk310 package.

amrishlal commented on PR #9324: URL: https://github.com/apache/hudi/pull/9324#issuecomment-1661507526 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [hudi] danny0405 commented on issue #9339: [BUG] TaskManager exit with 143 when bucket_assigner is INITIALIZING

danny0405 commented on issue #9339: URL: https://github.com/apache/hudi/issues/9339#issuecomment-1661503444 Yeah, `org.apache.hudi.sink.partitioner.profile.WriteProfile#averageBytesPerRecord` tries to read the commit file to fetch some size info, it seems the commit file is not complete, i

[GitHub] [hudi] danny0405 commented on a diff in pull request #9330: [HUDI-6622] Reuse the table config from HoodieTableMetaClient in the …

danny0405 commented on code in PR #9330: URL: https://github.com/apache/hudi/pull/9330#discussion_r1281395591 ## hudi-platform-service/hudi-metaserver/hudi-metaserver-client/src/main/java/org/apache/hudi/common/table/HoodieTableMetaserverClient.java: ## @@ -63,15 +60,12 @@ publi

[GitHub] [hudi] hudi-bot commented on pull request #9340: [HUDI-6630] Automatic release connection for hoodie metaserver client

hudi-bot commented on PR #9340: URL: https://github.com/apache/hudi/pull/9340#issuecomment-1661483463 ## CI report: * de0ad1dd3783cc2a9fb47e4266c2a345ca444387 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9273: [HUDI-6320] Fix partition parsing in Spark file index for custom keygen

hudi-bot commented on PR #9273: URL: https://github.com/apache/hudi/pull/9273#issuecomment-1661482786 ## CI report: * ccdc272f4c7c61263f15174d9b468301800b25c9 UNKNOWN * 0cdbf1e6d0feec799e69f20c5345113d20bf3d53 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9330: [HUDI-6622] Reuse the table config from HoodieTableMetaClient in the …

hudi-bot commented on PR #9330: URL: https://github.com/apache/hudi/pull/9330#issuecomment-1661471871 ## CI report: * 72a29231ecc147a87700ef70a524a40cf70a8840 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1895

[jira] [Updated] (HUDI-6630) Automatic release connection for hoodie metaserver client

[ https://issues.apache.org/jira/browse/HUDI-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6630: - Labels: pull-request-available (was: ) > Automatic release connection for hoodie metaserver clien

[GitHub] [hudi] eric9204 opened a new pull request, #9340: [HUDI-6630] Automatic release connection for hoodie metaserver client

eric9204 opened a new pull request, #9340: URL: https://github.com/apache/hudi/pull/9340 ### Change Logs Automatic release connection ### Impact Reduce port occupation. ### Risk level (write none, low medium or high below) none ### Documentation Upda

[jira] [Created] (HUDI-6630) Automatic release connection for hoodie metaserver client

eric created HUDI-6630: -- Summary: Automatic release connection for hoodie metaserver client Key: HUDI-6630 URL: https://issues.apache.org/jira/browse/HUDI-6630 Project: Apache Hudi Issue Type: Bug A

[GitHub] [hudi] hudi-bot commented on pull request #9330: [HUDI-6622] Reuse the table config from HoodieTableMetaClient in the …

hudi-bot commented on PR #9330: URL: https://github.com/apache/hudi/pull/9330#issuecomment-1661443387 ## CI report: * 72a29231ecc147a87700ef70a524a40cf70a8840 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1895

[GitHub] [hudi] hudi-bot commented on pull request #9261: [HUDI-6579] Adding support for upsert and deletes with spark datasource for pk less table

hudi-bot commented on PR #9261: URL: https://github.com/apache/hudi/pull/9261#issuecomment-1661443178 ## CI report: * 84ef26635cf016f0e4466754ad89f8b70b66d889 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1893

[GitHub] [hudi] hudi-bot commented on pull request #9209: [HUDI-6539] New LSM tree style archived timeline

hudi-bot commented on PR #9209: URL: https://github.com/apache/hudi/pull/9209#issuecomment-1661443076 ## CI report: * 8f2dc4ec3e26f1908ae5d15f194bf70ca7dab27e UNKNOWN * 9a2afc24ea8552ec6869f9d5819a00c78067a4e6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9261: [HUDI-6579] Adding support for upsert and deletes with spark datasource for pk less table

hudi-bot commented on PR #9261: URL: https://github.com/apache/hudi/pull/9261#issuecomment-1661438758 ## CI report: * 84ef26635cf016f0e4466754ad89f8b70b66d889 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1893

[GitHub] [hudi] hudi-bot commented on pull request #9209: [HUDI-6539] New LSM tree style archived timeline

hudi-bot commented on PR #9209: URL: https://github.com/apache/hudi/pull/9209#issuecomment-1661438646 ## CI report: * 8f2dc4ec3e26f1908ae5d15f194bf70ca7dab27e UNKNOWN * 9a2afc24ea8552ec6869f9d5819a00c78067a4e6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] nsivabalan commented on pull request #9261: [HUDI-6579] Adding support for upsert and deletes with spark datasource for pk less table

nsivabalan commented on PR #9261: URL: https://github.com/apache/hudi/pull/9261#issuecomment-1661430331 @codope : Updated -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [hudi] nsivabalan commented on pull request #9248: [HUDI-6324] Fixing deletion of MDT index

nsivabalan commented on PR #9248: URL: https://github.com/apache/hudi/pull/9248#issuecomment-1661427644 CI is green https://github.com/apache/hudi/assets/513218/7d9d23b2-8c66-408d-89fd-09283196edd1";> -- This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [hudi] 1032851561 opened a new issue, #9339: [BUG] TaskManager exit with 143 when bucket_assigner is INITIALIZING

1032851561 opened a new issue, #9339: URL: https://github.com/apache/hudi/issues/9339 **Describe the problem you faced** The taskmanager always exits without error quickly when I restart the job. Before exiting TM, I saw on the UI that the `bucket_assigner` was initializing.

[GitHub] [hudi] hudi-bot commented on pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

hudi-bot commented on PR #9337: URL: https://github.com/apache/hudi/pull/9337#issuecomment-1661403790 ## CI report: * e8527c9addb6b9135b6a39f8aedc2b6b863f3ca5 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=189

[GitHub] [hudi] hudi-bot commented on pull request #9332: [HUDI-6625] Lazy create metadata and viewManager in HoodieTable

hudi-bot commented on PR #9332: URL: https://github.com/apache/hudi/pull/9332#issuecomment-1661403736 ## CI report: * daa28a4bd88b29bf80b19210dfb4a54667e07cae UNKNOWN * 1653ede72c4d0bbde09db9465eb82897c3e8955f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9113: [HUDI-6466] Fix spark insert overwrite partitioned table with dynamic partition

hudi-bot commented on PR #9113: URL: https://github.com/apache/hudi/pull/9113#issuecomment-1661403327 ## CI report: * 4f2a46d3a64f86b108d7a892decb27075c7c6995 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1895

[GitHub] [hudi] hudi-bot commented on pull request #9332: [HUDI-6625] Lazy create metadata and viewManager in HoodieTable

hudi-bot commented on PR #9332: URL: https://github.com/apache/hudi/pull/9332#issuecomment-1661398037 ## CI report: * daa28a4bd88b29bf80b19210dfb4a54667e07cae UNKNOWN * 1653ede72c4d0bbde09db9465eb82897c3e8955f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

hudi-bot commented on PR #9337: URL: https://github.com/apache/hudi/pull/9337#issuecomment-1661398137 ## CI report: * 89d3dd3c8ba9bc10d6f6be906337c4d55c741780 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=189

[GitHub] [hudi] hudi-bot commented on pull request #9276: [HUDI-6568] Hudi Spark Integration Redesign

hudi-bot commented on PR #9276: URL: https://github.com/apache/hudi/pull/9276#issuecomment-1661397775 ## CI report: * 662f3b320ab6ea06462bad9a4448add1ec2f380a UNKNOWN * d6025b94167f6a2ff9fd24193f6b356be2b16704 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9113: [HUDI-6466] Fix spark insert overwrite partitioned table with dynamic partition

hudi-bot commented on PR #9113: URL: https://github.com/apache/hudi/pull/9113#issuecomment-1661397445 ## CI report: * 4f2a46d3a64f86b108d7a892decb27075c7c6995 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1895

[GitHub] [hudi] nsivabalan commented on pull request #9261: [HUDI-6579] Adding support for upsert and deletes with spark datasource for pk less table

nsivabalan commented on PR #9261: URL: https://github.com/apache/hudi/pull/9261#issuecomment-1661397073 oops, my bad. not sure how I missed. will fix it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] nsivabalan commented on a diff in pull request #8697: [HUDI-5514] Improving usability/performance with out of box default for append only use-cases

nsivabalan commented on code in PR #8697: URL: https://github.com/apache/hudi/pull/8697#discussion_r1281307491 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala: ## @@ -429,6 +416,40 @@ object HoodieSparkSqlWriter { } }

[GitHub] [hudi] the-other-tim-brown commented on a diff in pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

the-other-tim-brown commented on code in PR #9337: URL: https://github.com/apache/hudi/pull/9337#discussion_r1281305345 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bloom/HoodieBloomIndex.java: ## @@ -214,12 +214,16 @@ protected List> loadColumnRangesFr

[GitHub] [hudi] eric9204 commented on a diff in pull request #9327: [HUDI-6617] make HoodieRecordDelegate implement KryoSerializable

eric9204 commented on code in PR #9327: URL: https://github.com/apache/hudi/pull/9327#discussion_r1281302685 ## hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecordDelegate.java: ## @@ -122,4 +127,20 @@ public String toString() { + ", newLocation=" + newL

[GitHub] [hudi] hudi-bot commented on pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

hudi-bot commented on PR #9337: URL: https://github.com/apache/hudi/pull/9337#issuecomment-1661354347 ## CI report: * 89d3dd3c8ba9bc10d6f6be906337c4d55c741780 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=189

[GitHub] [hudi] hudi-bot commented on pull request #9237: [HUDI-6569] Fix write failure for Avro Enum type

hudi-bot commented on PR #9237: URL: https://github.com/apache/hudi/pull/9237#issuecomment-1661353162 ## CI report: * b0b58a2ef7136e105139881694333ed481c0b4d9 UNKNOWN * 639df233faf2520c38d8069d2a499f51b28785ce Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

hudi-bot commented on PR #9337: URL: https://github.com/apache/hudi/pull/9337#issuecomment-1661331253 ## CI report: * 655dfafb77fc0df33d56f7c97314f680fb13b01d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1896

[GitHub] [hudi] hudi-bot commented on pull request #9237: [HUDI-6569] Fix write failure for Avro Enum type

hudi-bot commented on PR #9237: URL: https://github.com/apache/hudi/pull/9237#issuecomment-1661329419 ## CI report: * b0b58a2ef7136e105139881694333ed481c0b4d9 UNKNOWN * 639df233faf2520c38d8069d2a499f51b28785ce Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

hudi-bot commented on PR #9337: URL: https://github.com/apache/hudi/pull/9337#issuecomment-1661322702 ## CI report: * 655dfafb77fc0df33d56f7c97314f680fb13b01d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1896

[hudi] branch master updated: [HUDI-5760] Use Avro as serde for delete log blocks (#9315)

This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 211c315e57f [HUDI-5760] Use Avro as serde for delet

[GitHub] [hudi] yihua merged pull request #9315: [HUDI-5760] Use Avro as serde for delete log blocks

yihua merged PR #9315: URL: https://github.com/apache/hudi/pull/9315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

hudi-bot commented on PR #9337: URL: https://github.com/apache/hudi/pull/9337#issuecomment-1661289302 ## CI report: * 655dfafb77fc0df33d56f7c97314f680fb13b01d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1896

[GitHub] [hudi] hudi-bot commented on pull request #9336: [HUDI-6629] - Changes for s3/gcs IncrSource job to taken into sourceLimit during ingestion

hudi-bot commented on PR #9336: URL: https://github.com/apache/hudi/pull/9336#issuecomment-1661283148 ## CI report: * 77d7b455ee5cd668a005f6f7e6f04135608f2b7a UNKNOWN * 0644289c60213febf6e80d48e5cf4e22b7b24c87 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #9315: [HUDI-5760] Use Avro as serde for delete log blocks

hudi-bot commented on PR #9315: URL: https://github.com/apache/hudi/pull/9315#issuecomment-1661283012 ## CI report: * 4016bdb10065fb83579c9d0488e558e2c70e023a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1894

[GitHub] [hudi] bhasudha commented on pull request #9338: [DOCS] Update bootstrap page

bhasudha commented on PR #9338: URL: https://github.com/apache/hudi/pull/9338#issuecomment-1661263178 @jonvex Can you take a look at this page overall for changes? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [hudi] bhasudha commented on pull request #9338: [DOCS] Update bootstrap page

bhasudha commented on PR #9338: URL: https://github.com/apache/hudi/pull/9338#issuecomment-1661260739 Tested the page locally  ![bootstrap-2](https://github.com/apache/hudi/assets/217925

[GitHub] [hudi] bhasudha opened a new pull request, #9338: [DOCS] Update bootstrap page

bhasudha opened a new pull request, #9338: URL: https://github.com/apache/hudi/pull/9338 ### Change Logs Update bootstrap page with configs and minor fixes ### Impact Doc changes ### Risk level (write none, low medium or high below) Low ### Documentat

[GitHub] [hudi] hudi-bot commented on pull request #9276: [HUDI-6568] Hudi Spark Integration Redesign

hudi-bot commented on PR #9276: URL: https://github.com/apache/hudi/pull/9276#issuecomment-1661248710 ## CI report: * 662f3b320ab6ea06462bad9a4448add1ec2f380a UNKNOWN * b8f1f891c36938d73d0ba7a84f392c0ac082e443 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] the-other-tim-brown commented on a diff in pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

the-other-tim-brown commented on code in PR #9337: URL: https://github.com/apache/hudi/pull/9337#discussion_r1281245951 ## hudi-common/src/main/java/org/apache/hudi/common/model/HoodieBaseFile.java: ## @@ -52,14 +59,39 @@ public HoodieBaseFile(String filePath) { public Hoodie

[GitHub] [hudi] hudi-bot commented on pull request #9335: [HUDI-6627] Fix NPE when spark client writer schema is null

hudi-bot commented on PR #9335: URL: https://github.com/apache/hudi/pull/9335#issuecomment-1661242500 ## CI report: * 1e5cc41028b53a99efacd59d15f610aa96d5b5e2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1896

[GitHub] [hudi] hudi-bot commented on pull request #9276: [HUDI-6568] Hudi Spark Integration Redesign

hudi-bot commented on PR #9276: URL: https://github.com/apache/hudi/pull/9276#issuecomment-1661242254 ## CI report: * 662f3b320ab6ea06462bad9a4448add1ec2f380a UNKNOWN * b8f1f891c36938d73d0ba7a84f392c0ac082e443 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] amrishlal commented on a diff in pull request #9336: [HUDI-6629] - Changes for s3/gcs IncrSource job to taken into sourceLimit during ingestion

amrishlal commented on code in PR #9336: URL: https://github.com/apache/hudi/pull/9336#discussion_r1281240893 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/CloudObjectIncrCheckpoint.java: ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] [hudi] hudi-bot commented on pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

hudi-bot commented on PR #9337: URL: https://github.com/apache/hudi/pull/9337#issuecomment-1661236196 ## CI report: * 655dfafb77fc0df33d56f7c97314f680fb13b01d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1896

[GitHub] [hudi] hudi-bot commented on pull request #9324: [HUDI-6619] [WIP] Fix hudi-integ-test-bundle dependency on jackson jsk310 package.

hudi-bot commented on PR #9324: URL: https://github.com/apache/hudi/pull/9324#issuecomment-1661236085 ## CI report: * 98e49fad21b4c7b1151e96c7a72b18caf5014a7f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1893

[GitHub] [hudi] jonvex commented on a diff in pull request #9276: [HUDI-6568] Hudi Spark Integration Redesign

jonvex commented on code in PR #9276: URL: https://github.com/apache/hudi/pull/9276#discussion_r1281236300 ## hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/MergeIntoHoodieTableCommand.scala: ## @@ -172,9 +172,9 @@ case class MergeIntoHoodieTab

[GitHub] [hudi] amrishlal commented on a diff in pull request #9336: [HUDI-6629] - Changes for s3/gcs IncrSource job to taken into sourceLimit during ingestion

amrishlal commented on code in PR #9336: URL: https://github.com/apache/hudi/pull/9336#discussion_r1281234501 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieTimeline.java: ## @@ -413,6 +423,14 @@ static boolean isInRange(String timestamp, String startTs

[GitHub] [hudi] amrishlal commented on a diff in pull request #9336: [HUDI-6629] - Changes for s3/gcs IncrSource job to taken into sourceLimit during ingestion

amrishlal commented on code in PR #9336: URL: https://github.com/apache/hudi/pull/9336#discussion_r1281234205 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieDefaultTimeline.java: ## @@ -203,6 +204,12 @@ public HoodieDefaultTimeline findInstantsInRange(S

[GitHub] [hudi] amrishlal commented on a diff in pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

amrishlal commented on code in PR #9337: URL: https://github.com/apache/hudi/pull/9337#discussion_r1281221181 ## hudi-common/src/main/java/org/apache/hudi/common/model/HoodieBaseFile.java: ## @@ -52,14 +59,39 @@ public HoodieBaseFile(String filePath) { public HoodieBaseFile(S

[GitHub] [hudi] hudi-bot commented on pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

hudi-bot commented on PR #9337: URL: https://github.com/apache/hudi/pull/9337#issuecomment-1661187879 ## CI report: * 655dfafb77fc0df33d56f7c97314f680fb13b01d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1896

[GitHub] [hudi] hudi-bot commented on pull request #9315: [HUDI-5760] Use Avro as serde for delete log blocks

hudi-bot commented on PR #9315: URL: https://github.com/apache/hudi/pull/9315#issuecomment-1661187733 ## CI report: * 4016bdb10065fb83579c9d0488e558e2c70e023a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1894

[GitHub] [hudi] hudi-bot commented on pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

hudi-bot commented on PR #9337: URL: https://github.com/apache/hudi/pull/9337#issuecomment-1661179035 ## CI report: * 655dfafb77fc0df33d56f7c97314f680fb13b01d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9315: [HUDI-5760] Use Avro as serde for delete log blocks

hudi-bot commented on PR #9315: URL: https://github.com/apache/hudi/pull/9315#issuecomment-1661178847 ## CI report: * 4016bdb10065fb83579c9d0488e558e2c70e023a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9237: [HUDI-6569] Fix write failure for Avro Enum type

hudi-bot commented on PR #9237: URL: https://github.com/apache/hudi/pull/9237#issuecomment-1661178508 ## CI report: * b0b58a2ef7136e105139881694333ed481c0b4d9 UNKNOWN * 639df233faf2520c38d8069d2a499f51b28785ce Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] the-other-tim-brown commented on a diff in pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

the-other-tim-brown commented on code in PR #9337: URL: https://github.com/apache/hudi/pull/9337#discussion_r1281188320 ## hudi-common/src/main/java/org/apache/hudi/common/model/HoodieLogFile.java: ## @@ -47,64 +52,86 @@ public class HoodieLogFile implements Serializable {

[jira] [Updated] (HUDI-6628) Rely on HoodieBaseFile and HoodieLogFile methods over FsUtils

[ https://issues.apache.org/jira/browse/HUDI-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6628: - Labels: pull-request-available (was: ) > Rely on HoodieBaseFile and HoodieLogFile methods over Fs

[GitHub] [hudi] the-other-tim-brown opened a new pull request, #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

the-other-tim-brown opened a new pull request, #9337: URL: https://github.com/apache/hudi/pull/9337 ### Change Logs - Updates sections of the code to use the getters in the HoodieBaseFile and HoodieLogFile instead of FSUtils to move away from relying directly on the path for getting

[hudi] branch master updated: [HUDI-6459] Add Rollback and multi-writer tests for Record Level Index (#9105)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a399bc5c4e7 [HUDI-6459] Add Rollback and multi-

[GitHub] [hudi] nsivabalan merged pull request #9105: [HUDI-6459] Add Rollback and multi-writer tests for Record Level Index

nsivabalan merged PR #9105: URL: https://github.com/apache/hudi/pull/9105 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apach

[GitHub] [hudi] nsivabalan commented on pull request #9105: [HUDI-6459] Add Rollback and multi-writer tests for Record Level Index

nsivabalan commented on PR #9105: URL: https://github.com/apache/hudi/pull/9105#issuecomment-1661129002 CI is good. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [hudi] hudi-bot commented on pull request #9336: [HUDI-6629] - Changes for s3/gcs IncrSource job to taken into sourceLimit during ingestion

hudi-bot commented on PR #9336: URL: https://github.com/apache/hudi/pull/9336#issuecomment-1661127541 ## CI report: * 77d7b455ee5cd668a005f6f7e6f04135608f2b7a UNKNOWN * 0644289c60213febf6e80d48e5cf4e22b7b24c87 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] kazdy commented on a diff in pull request #9277: [HUDI-6558] support SQL update for no-precombine field tables

kazdy commented on code in PR #9277: URL: https://github.com/apache/hudi/pull/9277#discussion_r1276494722 ## hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/UpdateHoodieTableCommand.scala: ## @@ -31,6 +34,22 @@ import org.apache.spark.sql.hudi.P

  1   2   3   >