[GitHub] [hudi] hudi-bot commented on pull request #9276: [HUDI-6568] Hudi Spark Integration Redesign

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9276: URL: https://github.com/apache/hudi/pull/9276#issuecomment-1662867603 ## CI report: * 662f3b320ab6ea06462bad9a4448add1ec2f380a UNKNOWN * 87e8f76e3d97d5b3b2fc10fe7704395575cc1b79 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9237: [HUDI-6569] Fix write failure for Avro Enum type

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9237: URL: https://github.com/apache/hudi/pull/9237#issuecomment-1662867394 ## CI report: * a30830bcec5f907c190d3349be68297f72a158c1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9261: [HUDI-6579] Adding support for upsert and deletes with spark datasource for pk less table

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9261: URL: https://github.com/apache/hudi/pull/9261#issuecomment-1662857650 ## CI report: * c84b19381bc677b00b20e7f3ad3bc5c3b2287ef1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9237: [HUDI-6569] Fix write failure for Avro Enum type

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9237: URL: https://github.com/apache/hudi/pull/9237#issuecomment-1662857473 ## CI report: * a30830bcec5f907c190d3349be68297f72a158c1 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9209: [HUDI-6539] New LSM tree style archived timeline

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9209: URL: https://github.com/apache/hudi/pull/9209#issuecomment-1662857335 ## CI report: * 8f2dc4ec3e26f1908ae5d15f194bf70ca7dab27e UNKNOWN * 4ade37c10c908c0422915aaa489208e6ee62bb0d Azure:

[GitHub] [hudi] bhasudha commented on a diff in pull request #9346: [DOCS] Update Indexing page with all index types and file layout page

2023-08-02 Thread via GitHub
bhasudha commented on code in PR #9346: URL: https://github.com/apache/hudi/pull/9346#discussion_r1282317869 ## website/docs/indexing.md: ## @@ -20,34 +22,79 @@ _Figure: Comparison of merge cost for updates (yellow blocks) against base files ## Index Types in Hudi

[GitHub] [hudi] bhasudha commented on a diff in pull request #9346: [DOCS] Update Indexing page with all index types and file layout page

2023-08-02 Thread via GitHub
bhasudha commented on code in PR #9346: URL: https://github.com/apache/hudi/pull/9346#discussion_r1282317414 ## website/docs/indexing.md: ## @@ -20,34 +22,79 @@ _Figure: Comparison of merge cost for updates (yellow blocks) against base files ## Index Types in Hudi

[GitHub] [hudi] nsivabalan commented on a diff in pull request #9345: [WIP] Add query filter for MOR snapshot relation

2023-08-02 Thread via GitHub
nsivabalan commented on code in PR #9345: URL: https://github.com/apache/hudi/pull/9345#discussion_r1282159469 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieFileIndex.scala: ## @@ -180,20 +183,94 @@ case class HoodieFileIndex(spark:

[GitHub] [hudi] hudi-bot commented on pull request #9330: [HUDI-6622] Reuse the table config from HoodieTableMetaClient in the …

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9330: URL: https://github.com/apache/hudi/pull/9330#issuecomment-1662548101 ## CI report: * 53e9bab71f8766ff092f7109abf6232098e0084c Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9276: [HUDI-6568] Hudi Spark Integration Redesign

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9276: URL: https://github.com/apache/hudi/pull/9276#issuecomment-1662547467 ## CI report: * 662f3b320ab6ea06462bad9a4448add1ec2f380a UNKNOWN * 87e8f76e3d97d5b3b2fc10fe7704395575cc1b79 Azure:

[jira] [Created] (HUDI-6633) Add hms based sync to hudi website

2023-08-02 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-6633: - Summary: Add hms based sync to hudi website Key: HUDI-6633 URL: https://issues.apache.org/jira/browse/HUDI-6633 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-6632) Revert FileSystemBackedTableMetadata#getAllPartitionPaths improvements due to HUDI-6476

2023-08-02 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-6632: - Summary: Revert FileSystemBackedTableMetadata#getAllPartitionPaths improvements due to HUDI-6476 Key: HUDI-6632 URL: https://issues.apache.org/jira/browse/HUDI-6632

[GitHub] [hudi] lucienoz commented on issue #9342: [SUPPORT] spark sql cow how to set payload class?

2023-08-02 Thread via GitHub
lucienoz commented on issue #9342: URL: https://github.com/apache/hudi/issues/9342#issuecomment-1662215750 create table hudi.payload_demo_cow (id bigint, value string, ts long) using hudi tblproperties ( type = 'cow', primaryKey = 'id',

[GitHub] [hudi] hudi-bot commented on pull request #9327: [HUDI-6617] make HoodieRecordDelegate implement KryoSerializable

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9327: URL: https://github.com/apache/hudi/pull/9327#issuecomment-1662209317 ## CI report: * d875b12ed9e6742f2ad1a2dcd8405d7ab74295a2 UNKNOWN * d0159ccf2980bd97f42f14d351791740566f387d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9287: [HUDI-6592] Flink insert overwrite should support dynamic partition and whole table

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9287: URL: https://github.com/apache/hudi/pull/9287#issuecomment-1662208897 ## CI report: * 1d7fd930f39ea1f776beea617ca672bd3ac4c585 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9237: [HUDI-6569] Fix write failure for Avro Enum type

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9237: URL: https://github.com/apache/hudi/pull/9237#issuecomment-1662208531 ## CI report: * b0b58a2ef7136e105139881694333ed481c0b4d9 UNKNOWN * a30830bcec5f907c190d3349be68297f72a158c1 Azure:

[GitHub] [hudi] eric9204 commented on a diff in pull request #9327: [HUDI-6617] make HoodieRecordDelegate implement KryoSerializable

2023-08-02 Thread via GitHub
eric9204 commented on code in PR #9327: URL: https://github.com/apache/hudi/pull/9327#discussion_r1281892591 ## hudi-common/src/test/java/org/apache/hudi/common/model/TestHoodieRecordDelegate.java: ## @@ -0,0 +1,73 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [hudi] SteNicholas commented on pull request #9286: [MINOR] Add rowId field to HoodieRecordIndexInfo in metadata payload

2023-08-02 Thread via GitHub
SteNicholas commented on PR #9286: URL: https://github.com/apache/hudi/pull/9286#issuecomment-1662168443 @codope, could rowId field add to metadata column? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hudi] hudi-bot commented on pull request #9335: [HUDI-6627] Fix NPE when spark client writer schema is null

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9335: URL: https://github.com/apache/hudi/pull/9335#issuecomment-1662137343 ## CI report: * b1091bdeaf25dcd95f567a8e50c2c6d4dc80fb79 UNKNOWN * c37dc656ad139cebecd3d56a3d4bb7eca9477498 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9287: [HUDI-6592] Flink insert overwrite should support dynamic partition and whole table

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9287: URL: https://github.com/apache/hudi/pull/9287#issuecomment-1662136962 ## CI report: * 1d7fd930f39ea1f776beea617ca672bd3ac4c585 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9335: [HUDI-6627] Fix NPE when spark client writer schema is null

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9335: URL: https://github.com/apache/hudi/pull/9335#issuecomment-1662124730 ## CI report: * f5f782eb73f43a49310e547209415b695dafa108 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9308: [HUDI-6606] Use record level index with SQL equality queries

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9308: URL: https://github.com/apache/hudi/pull/9308#issuecomment-1662124350 ## CI report: * c8652010dd5bbc28bae7a57c896d5babd05203f3 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9261: [HUDI-6579] Adding support for upsert and deletes with spark datasource for pk less table

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9261: URL: https://github.com/apache/hudi/pull/9261#issuecomment-1662123955 ## CI report: * c84b19381bc677b00b20e7f3ad3bc5c3b2287ef1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9335: [HUDI-6627] Fix NPE when spark client writer schema is null

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9335: URL: https://github.com/apache/hudi/pull/9335#issuecomment-1662061693 ## CI report: * f5f782eb73f43a49310e547209415b695dafa108 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9308: [HUDI-6606] Use record level index with SQL equality queries

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9308: URL: https://github.com/apache/hudi/pull/9308#issuecomment-1662061313 ## CI report: * 1061cf17d80bcf623da9fa86650ecbb4e082c447 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9335: [HUDI-6627] Fix NPE when spark client writer schema is null

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9335: URL: https://github.com/apache/hudi/pull/9335#issuecomment-1662049721 ## CI report: * 1e5cc41028b53a99efacd59d15f610aa96d5b5e2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9308: [HUDI-6606] Use record level index with SQL equality queries

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9308: URL: https://github.com/apache/hudi/pull/9308#issuecomment-1662049356 ## CI report: * 1061cf17d80bcf623da9fa86650ecbb4e082c447 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9324: [HUDI-6619] [WIP] Fix hudi-integ-test-bundle dependency on jackson jsk310 package.

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9324: URL: https://github.com/apache/hudi/pull/9324#issuecomment-1662038193 ## CI report: * 98e49fad21b4c7b1151e96c7a72b18caf5014a7f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9118: [HUDI-2141] Support flink metrics

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9118: URL: https://github.com/apache/hudi/pull/9118#issuecomment-1662037388 ## CI report: * f6d7dd97c73898206da91b17144326a7dbbffae8 UNKNOWN * c62db1fdf94ee2c1f9b9e539f7a4b1bb866beb7e UNKNOWN * 635191fb53fc205fafdabd05175810a2a64f9eec Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9335: [HUDI-6627] Fix NPE when spark client writer schema is null

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9335: URL: https://github.com/apache/hudi/pull/9335#issuecomment-1661982421 ## CI report: * 1e5cc41028b53a99efacd59d15f610aa96d5b5e2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9118: [HUDI-2141] Support flink metrics

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9118: URL: https://github.com/apache/hudi/pull/9118#issuecomment-1661981366 ## CI report: * f6d7dd97c73898206da91b17144326a7dbbffae8 UNKNOWN * a3544a0dbac8c7aa675384a85430ad9139d70bda Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9335: [HUDI-6627] Fix NPE when spark client writer schema is null

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9335: URL: https://github.com/apache/hudi/pull/9335#issuecomment-1661969373 ## CI report: * 1e5cc41028b53a99efacd59d15f610aa96d5b5e2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9340: [HUDI-6630] Automatic release connection for hoodie metaserver client

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9340: URL: https://github.com/apache/hudi/pull/9340#issuecomment-1661956114 ## CI report: * de0ad1dd3783cc2a9fb47e4266c2a345ca444387 Azure:

[GitHub] [hudi] lokeshj1703 commented on pull request #9308: [HUDI-6606] Use record level index with SQL equality queries

2023-08-02 Thread via GitHub
lokeshj1703 commented on PR #9308: URL: https://github.com/apache/hudi/pull/9308#issuecomment-1661948497 Created https://issues.apache.org/jira/browse/HUDI-6631 to track the followup items. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Created] (HUDI-6631) RLI integration with SQL queries followup

2023-08-02 Thread Lokesh Jain (Jira)
Lokesh Jain created HUDI-6631: - Summary: RLI integration with SQL queries followup Key: HUDI-6631 URL: https://issues.apache.org/jira/browse/HUDI-6631 Project: Apache Hudi Issue Type: Bug

[GitHub] [hudi] lucienoz opened a new issue, #9342: [SUPPORT] spark sql cow how to set payload class?

2023-08-02 Thread via GitHub
lucienoz opened a new issue, #9342: URL: https://github.com/apache/hudi/issues/9342 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at

[GitHub] [hudi] aib628 commented on issue #8848: [SUPPORT] Hive Sync tool fails to sync Hoodi table written using Flink 1.16 to HMS

2023-08-02 Thread via GitHub
aib628 commented on issue #8848: URL: https://github.com/apache/hudi/issues/8848#issuecomment-1661927203 @danny0405 yeah, i'm do found hive-exec dependency in my flink-bundle jar file, but none of calcite dependency found. then test found that hudi-flink1.13-bundle-0.13.1.jar

[GitHub] [hudi] danielfordfc commented on issue #9341: [SUPPORT] Strange Behaviour of Deltastreamer Utility on EMR with YARN Scheduler

2023-08-02 Thread via GitHub
danielfordfc commented on issue #9341: URL: https://github.com/apache/hudi/issues/9341#issuecomment-1661907057 Would this not have been a problem if we'd have configured a lock provider? https://hudi.apache.org/docs/concurrency_control Regardless, YARN seemingly continuing to run the

[GitHub] [hudi] hudi-bot commented on pull request #9273: [HUDI-6320] Fix partition parsing in Spark file index for custom keygen

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9273: URL: https://github.com/apache/hudi/pull/9273#issuecomment-1661884211 ## CI report: * ccdc272f4c7c61263f15174d9b468301800b25c9 UNKNOWN * 3b54d26d8787cdb0cc1bccd86bcaa2e40b3d94a7 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9118: [HUDI-2141] Support flink metrics

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9118: URL: https://github.com/apache/hudi/pull/9118#issuecomment-1661883687 ## CI report: * f6d7dd97c73898206da91b17144326a7dbbffae8 UNKNOWN * a3544a0dbac8c7aa675384a85430ad9139d70bda Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9209: [HUDI-6539] New LSM tree style archived timeline

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9209: URL: https://github.com/apache/hudi/pull/9209#issuecomment-1661883911 ## CI report: * 8f2dc4ec3e26f1908ae5d15f194bf70ca7dab27e UNKNOWN * 6ab7d4bd2696988e3784291879d1f713d6a9c98d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9209: [HUDI-6539] New LSM tree style archived timeline

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9209: URL: https://github.com/apache/hudi/pull/9209#issuecomment-1661869288 ## CI report: * 8f2dc4ec3e26f1908ae5d15f194bf70ca7dab27e UNKNOWN * 6ab7d4bd2696988e3784291879d1f713d6a9c98d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9118: [HUDI-2141] Support flink metrics

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9118: URL: https://github.com/apache/hudi/pull/9118#issuecomment-1661869018 ## CI report: * f6d7dd97c73898206da91b17144326a7dbbffae8 UNKNOWN * a3544a0dbac8c7aa675384a85430ad9139d70bda Azure:

[GitHub] [hudi] danny0405 commented on a diff in pull request #9330: [HUDI-6622] Reuse the table config from HoodieTableMetaClient in the …

2023-08-02 Thread via GitHub
danny0405 commented on code in PR #9330: URL: https://github.com/apache/hudi/pull/9330#discussion_r1281648845 ## hudi-platform-service/hudi-metaserver/hudi-metaserver-client/src/main/java/org/apache/hudi/common/table/HoodieTableMetaserverClient.java: ## @@ -60,20 +62,22 @@

[GitHub] [hudi] danny0405 commented on issue #8848: [SUPPORT] Hive Sync tool fails to sync Hoodi table written using Flink 1.16 to HMS

2023-08-02 Thread via GitHub
danny0405 commented on issue #8848: URL: https://github.com/apache/hudi/issues/8848#issuecomment-1661860791 If you specify the hive profile, the hive-exec scope would switch to `compile`: `-Drat.skip=true -Pflink-bundle-shade-hive3` -- This is an automated message from the Apache Git

[GitHub] [hudi] hudi-bot commented on pull request #9320: [MINOR] Pass prepped boolean correctly in sql writer

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9320: URL: https://github.com/apache/hudi/pull/9320#issuecomment-1661855416 ## CI report: * a01fadec22c7dcf344bdfcb71fb13daedb83e54d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9118: [HUDI-2141] Support flink metrics

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9118: URL: https://github.com/apache/hudi/pull/9118#issuecomment-1661854285 ## CI report: * f6d7dd97c73898206da91b17144326a7dbbffae8 UNKNOWN * a3544a0dbac8c7aa675384a85430ad9139d70bda Azure:

[GitHub] [hudi] aib628 commented on issue #8848: [SUPPORT] Hive Sync tool fails to sync Hoodi table written using Flink 1.16 to HMS

2023-08-02 Thread via GitHub
aib628 commented on issue #8848: URL: https://github.com/apache/hudi/issues/8848#issuecomment-1661827303 @danny0405 I'm using hive3 , and packaging command as follow: `mvn clean install -DskipTests -Dhadoop.version=3.1.0 -Dhive.version=3.1.2 -Dflink.version=1.17.1 -Drat.skip=true

[GitHub] [hudi] danielfordfc opened a new issue, #9341: [SUPPORT] Strange Behaviour of Deltastreamer Utility on EMR with YARN Scheduler

2023-08-02 Thread via GitHub
danielfordfc opened a new issue, #9341: URL: https://github.com/apache/hudi/issues/9341 **Describe the problem you faced** Apache Hudi's deltastreamer utility on EMR, with YARN as the scheduler. I've noticed a rather peculiar behaviour that has started causing sporadic errors in my

[GitHub] [hudi] hudi-bot commented on pull request #9320: [MINOR] Pass prepped boolean correctly in sql writer

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9320: URL: https://github.com/apache/hudi/pull/9320#issuecomment-1661763635 ## CI report: * a01fadec22c7dcf344bdfcb71fb13daedb83e54d Azure:

[GitHub] [hudi] danny0405 commented on a diff in pull request #9327: [HUDI-6617] make HoodieRecordDelegate implement KryoSerializable

2023-08-02 Thread via GitHub
danny0405 commented on code in PR #9327: URL: https://github.com/apache/hudi/pull/9327#discussion_r1281585998 ## hudi-common/src/test/java/org/apache/hudi/common/model/TestHoodieRecordDelegate.java: ## @@ -0,0 +1,73 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[jira] [Closed] (HUDI-6540) Support failed writes clean policy for Flink

2023-08-02 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-6540. Resolution: Fixed Fixed via master branch: 8da99f8a5c9ce3abd5a5a14baf3a8db81c3d39f0 > Support failed

[hudi] branch master updated: [HUDI-6540] Support failed writes clean policy for Flink (#9211)

2023-08-02 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 8da99f8a5c9 [HUDI-6540] Support failed writes

[GitHub] [hudi] danny0405 merged pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink

2023-08-02 Thread via GitHub
danny0405 merged PR #9211: URL: https://github.com/apache/hudi/pull/9211 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] voonhous commented on issue #7145: [SUPPORT] `org.apache.avro.SchemaParseException: Can't redefine: array` when an Array containing a Struct is the only field in a Struct

2023-08-02 Thread via GitHub
voonhous commented on issue #7145: URL: https://github.com/apache/hudi/issues/7145#issuecomment-1661743916 Detailed explanation of this error: https://github.com/apache/hudi/issues/6849#issuecomment-1661734683 -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hudi] voonhous commented on issue #7717: [SUPPORT] org.apache.avro.SchemaParseException: Can't redefine: array When there are Top level variables , Struct and Array[struct] (no complex data

2023-08-02 Thread via GitHub
voonhous commented on issue #7717: URL: https://github.com/apache/hudi/issues/7717#issuecomment-1661742304 Detailed explanation of this error can be found here: https://github.com/apache/hudi/issues/6849#issuecomment-1661734683 -- This is an automated message from the Apache Git

[GitHub] [hudi] voonhous commented on issue #7145: [SUPPORT] `org.apache.avro.SchemaParseException: Can't redefine: array` when an Array containing a Struct is the only field in a Struct

2023-08-02 Thread via GitHub
voonhous commented on issue #7145: URL: https://github.com/apache/hudi/issues/7145#issuecomment-1661740856 The root cause for this error can be found here: https://github.com/apache/hudi/issues/6849#issuecomment-1661734683 -- This is an automated message from the Apache Git

[GitHub] [hudi] voonhous commented on issue #6849: [SUPPORT]Caused by: org.apache.hudi.exception.HoodieException: org.apache.avro.SchemaParseException: Can't redefine: element

2023-08-02 Thread via GitHub
voonhous commented on issue #6849: URL: https://github.com/apache/hudi/issues/6849#issuecomment-1661734683 # Root cause Was looking into this issue and didn't really understand the explanation. For anyone that's encountering this issue and are looking for the root-cause, I hope this is

[GitHub] [hudi] hudi-bot commented on pull request #9209: [HUDI-6539] New LSM tree style archived timeline

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9209: URL: https://github.com/apache/hudi/pull/9209#issuecomment-1661681506 ## CI report: * 8f2dc4ec3e26f1908ae5d15f194bf70ca7dab27e UNKNOWN * 6ab7d4bd2696988e3784291879d1f713d6a9c98d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9332: [HUDI-6625] Lazy create metadata and viewManager in HoodieTable

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9332: URL: https://github.com/apache/hudi/pull/9332#issuecomment-1661669649 ## CI report: * daa28a4bd88b29bf80b19210dfb4a54667e07cae UNKNOWN * 085364149cfdf26c706702db32294cf486d8af97 Azure:

[hudi] branch master updated (a495c16696d -> 6273d56356c)

2023-08-02 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from a495c16696d [HUDI-6624] Fix to return Empty when there is no commit instant (#9325) add 6273d56356c

[GitHub] [hudi] nsivabalan merged pull request #9293: [HUDI-6595] Move min and max instants to a static function in HoodieTimelineArchiver

2023-08-02 Thread via GitHub
nsivabalan merged PR #9293: URL: https://github.com/apache/hudi/pull/9293 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #9337: [HUDI-6628] Rely on methods in HoodieBaseFile and HoodieLogFile instead of FSUtils when possible

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9337: URL: https://github.com/apache/hudi/pull/9337#issuecomment-1661655174 ## CI report: * 48b44eb2e8d531fb7d11ab8be777808e422aa975 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9332: [HUDI-6625] Lazy create metadata and viewManager in HoodieTable

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9332: URL: https://github.com/apache/hudi/pull/9332#issuecomment-1661655047 ## CI report: * daa28a4bd88b29bf80b19210dfb4a54667e07cae UNKNOWN * 085364149cfdf26c706702db32294cf486d8af97 Azure:

[GitHub] [hudi] Zouxxyy commented on a diff in pull request #9332: [HUDI-6625] Lazy create metadata and viewManager in HoodieTable

2023-08-02 Thread via GitHub
Zouxxyy commented on code in PR #9332: URL: https://github.com/apache/hudi/pull/9332#discussion_r1281464112 ## hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/storage/row/TestHoodieRowCreateHandle.java: ## @@ -187,7 +187,9 @@ public void

[GitHub] [hudi] hudi-bot commented on pull request #9330: [HUDI-6622] Reuse the table config from HoodieTableMetaClient in the …

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9330: URL: https://github.com/apache/hudi/pull/9330#issuecomment-1661590662 ## CI report: * d41ace0369057dca454b81fc373e1fb5e45ffe23 Azure:

[GitHub] [hudi] Zouxxyy commented on a diff in pull request #9332: [HUDI-6625] Lazy create metadata and viewManager in HoodieTable

2023-08-02 Thread via GitHub
Zouxxyy commented on code in PR #9332: URL: https://github.com/apache/hudi/pull/9332#discussion_r1281459986 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/HoodieSparkTable.java: ## @@ -53,7 +53,7 @@ protected HoodieSparkTable(HoodieWriteConfig config,

[GitHub] [hudi] xushiyan commented on a diff in pull request #8697: [HUDI-5514] Improving usability/performance with out of box default for append only use-cases

2023-08-02 Thread via GitHub
xushiyan commented on code in PR #8697: URL: https://github.com/apache/hudi/pull/8697#discussion_r1281457455 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala: ## @@ -429,6 +416,40 @@ object HoodieSparkSqlWriter { } }

[GitHub] [hudi] hudi-bot commented on pull request #9330: [HUDI-6622] Reuse the table config from HoodieTableMetaClient in the …

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9330: URL: https://github.com/apache/hudi/pull/9330#issuecomment-1661582112 ## CI report: * 72a29231ecc147a87700ef70a524a40cf70a8840 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9113: [HUDI-6466] Fix spark insert overwrite partitioned table with dynamic partition

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9113: URL: https://github.com/apache/hudi/pull/9113#issuecomment-1661581407 ## CI report: * a14a5534ce3d3ed64a52fcfbb5c97b907c2e914c Azure:

[GitHub] [hudi] 1032851561 commented on issue #9339: [BUG] TaskManager exit with 143 when bucket_assigner is INITIALIZING

2023-08-02 Thread via GitHub
1032851561 commented on issue #9339: URL: https://github.com/apache/hudi/issues/9339#issuecomment-1661578324 > But stil got confused because the original code does not really throw exception: > > ```java > WriteProfiles.getCommitMetadataSafely(config.getTableName(), basePath,

[GitHub] [hudi] flashJd commented on pull request #9113: [HUDI-6466] Fix spark insert overwrite partitioned table with dynamic partition

2023-08-02 Thread via GitHub
flashJd commented on PR #9113: URL: https://github.com/apache/hudi/pull/9113#issuecomment-1661573425 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot commented on pull request #9327: [HUDI-6617] make HoodieRecordDelegate implement KryoSerializable

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9327: URL: https://github.com/apache/hudi/pull/9327#issuecomment-1661573327 ## CI report: * d875b12ed9e6742f2ad1a2dcd8405d7ab74295a2 UNKNOWN * 49498a06f3f74ef66f7f732b5d906210bdc1c98d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9237: [HUDI-6569] Fix write failure for Avro Enum type

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9237: URL: https://github.com/apache/hudi/pull/9237#issuecomment-1661572971 ## CI report: * b0b58a2ef7136e105139881694333ed481c0b4d9 UNKNOWN * 71c11aa3b61634102d4dac556c314136dbd851ee Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9113: [HUDI-6466] Fix spark insert overwrite partitioned table with dynamic partition

2023-08-02 Thread via GitHub
hudi-bot commented on PR #9113: URL: https://github.com/apache/hudi/pull/9113#issuecomment-1661572696 ## CI report: * a14a5534ce3d3ed64a52fcfbb5c97b907c2e914c Azure:

[GitHub] [hudi] 1032851561 commented on issue #9339: [BUG] TaskManager exit with 143 when bucket_assigner is INITIALIZING

2023-08-02 Thread via GitHub
1032851561 commented on issue #9339: URL: https://github.com/apache/hudi/issues/9339#issuecomment-1661572649 > Yeah, `org.apache.hudi.sink.partitioner.profile.WriteProfile#averageBytesPerRecord` tries to read the commit file to fetch some size info, it seems the commit file is not

[GitHub] [hudi] xushiyan commented on a diff in pull request #9324: [HUDI-6619] [WIP] Fix hudi-integ-test-bundle dependency on jackson jsk310 package.

2023-08-02 Thread via GitHub
xushiyan commented on code in PR #9324: URL: https://github.com/apache/hudi/pull/9324#discussion_r1281444222 ## pom.xml: ## @@ -98,8 +98,6 @@ ${fasterxml.spark3.version} ${fasterxml.spark3.version} ${fasterxml.spark3.version} - - Review Comment: >

[GitHub] [hudi] eric9204 commented on a diff in pull request #9330: [HUDI-6622] Reuse the table config from HoodieTableMetaClient in the …

2023-08-02 Thread via GitHub
eric9204 commented on code in PR #9330: URL: https://github.com/apache/hudi/pull/9330#discussion_r1281439455 ## hudi-platform-service/hudi-metaserver/hudi-metaserver-client/src/main/java/org/apache/hudi/common/table/HoodieTableMetaserverClient.java: ## @@ -63,15 +60,12 @@

<    1   2