[hudi] branch master updated (a8fb696 -> 63b1560)

This is an automated email from the ASF dual-hosted git repository. wangxianghu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from a8fb696 [HUDI-2877] Support flink catalog to help user use flink table conveniently (#4153) add 63b1560 [H

[GitHub] [hudi] wangxianghu merged pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

wangxianghu merged pull request #4217: URL: https://github.com/apache/hudi/pull/4217 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [hudi] hudi-bot removed a comment on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot removed a comment on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-986176280 ## CI report: * 014eb29699116b93c91af926594035c63fc09fff Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot commented on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-986181867 ## CI report: * 014eb29699116b93c91af926594035c63fc09fff Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot commented on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986181216 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * de7a095ead81f31cd841bd268357494d7a587b8e Azure

[GitHub] [hudi] hudi-bot removed a comment on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot removed a comment on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986180677 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * de7a095ead81f31cd841bd268357494d7a587b

[GitHub] [hudi] hudi-bot commented on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot commented on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986180677 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * de7a095ead81f31cd841bd268357494d7a587b8e Azure

[GitHub] [hudi] hudi-bot removed a comment on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot removed a comment on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986174121 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * de7a095ead81f31cd841bd268357494d7a587b

[GitHub] [hudi] stayrascal edited a comment on issue #4219: [SUPPORT] Flink SQL: NoSuchMethodError: com.esotericsoftware.kryo.Kryo$DefaultInstantiatorStrategy.(Lorg/objenesis/strategy/Instantiat

stayrascal edited a comment on issue #4219: URL: https://github.com/apache/hudi/issues/4219#issuecomment-986170198 Thanks @danny0405 for looking at this. I pull the latest master version, and rebuild again, but still meet this problem, but found some tricky thing: 1. the versi

[GitHub] [hudi] hudi-bot removed a comment on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot removed a comment on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-986176080 ## CI report: * 4aaa1089b03c26011072a75edc4673255961af7d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot commented on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-986176280 ## CI report: * 014eb29699116b93c91af926594035c63fc09fff Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot commented on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-986176080 ## CI report: * 4aaa1089b03c26011072a75edc4673255961af7d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot removed a comment on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-986175837 ## CI report: * 4aaa1089b03c26011072a75edc4673255961af7d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot removed a comment on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot removed a comment on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-986175607 ## CI report: * 4aaa1089b03c26011072a75edc4673255961af7d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot commented on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-986175837 ## CI report: * 4aaa1089b03c26011072a75edc4673255961af7d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot commented on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot commented on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-986175607 ## CI report: * 4aaa1089b03c26011072a75edc4673255961af7d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4181: [HUDI-2900] Fix corrupt block end position

hudi-bot removed a comment on pull request #4181: URL: https://github.com/apache/hudi/pull/4181#issuecomment-984724864 ## CI report: * 4aaa1089b03c26011072a75edc4673255961af7d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot commented on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986174121 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * de7a095ead81f31cd841bd268357494d7a587b8e Azure

[GitHub] [hudi] hudi-bot removed a comment on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot removed a comment on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986169970 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * a0af660192faca0b74d84e10f2249299b05bb4

[GitHub] [hudi] stayrascal commented on issue #4219: [SUPPORT] Flink SQL: NoSuchMethodError: com.esotericsoftware.kryo.Kryo$DefaultInstantiatorStrategy.(Lorg/objenesis/strategy/InstantiatorStrat

stayrascal commented on issue #4219: URL: https://github.com/apache/hudi/issues/4219#issuecomment-986171825 I tried to download the official release version(0.0.9), and uncompress the jar, found that the kryo-shaded version is still 3.0.3. -- This is an automated message from the Apache

[GitHub] [hudi] stayrascal commented on issue #4219: [SUPPORT] Flink SQL: NoSuchMethodError: com.esotericsoftware.kryo.Kryo$DefaultInstantiatorStrategy.(Lorg/objenesis/strategy/InstantiatorStrat

stayrascal commented on issue #4219: URL: https://github.com/apache/hudi/issues/4219#issuecomment-986170198 Thanks @danny0405 for looking at this. I pull the latest master version, and rebuild again, but still meet this problem, but found some tricky thing: 1. the version of `

[GitHub] [hudi] hudi-bot commented on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot commented on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986169970 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * a0af660192faca0b74d84e10f2249299b05bb4b6 Azure

[GitHub] [hudi] hudi-bot removed a comment on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot removed a comment on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986165356 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * a0af660192faca0b74d84e10f2249299b05bb4

[jira] [Created] (HUDI-2939) [DOC] Add description of write commit callback by pulsar to document

Forward Xu created HUDI-2939: Summary: [DOC] Add description of write commit callback by pulsar to document Key: HUDI-2939 URL: https://issues.apache.org/jira/browse/HUDI-2939 Project: Apache Hudi

[GitHub] [hudi] hudi-bot commented on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot commented on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986165356 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * a0af660192faca0b74d84e10f2249299b05bb4b6 Azure

[GitHub] [hudi] hudi-bot removed a comment on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot removed a comment on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986159635 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * a0af660192faca0b74d84e10f2249299b05bb4

[GitHub] [hudi] xushiyan commented on issue #4165: [SUPPORT] NullPointerException in EMR Hudi MultitableDeltasteamer

xushiyan commented on issue #4165: URL: https://github.com/apache/hudi/issues/4165#issuecomment-986164353 @pratyakshsharma any insights on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [hudi] xushiyan commented on issue #3834: [SUPPORT] - AWS Athena snapshot query fails if there are two or more record array fields in a MoR table

xushiyan commented on issue #3834: URL: https://github.com/apache/hudi/issues/3834#issuecomment-986164208 another parquet upgrade request. tracking it in https://issues.apache.org/jira/browse/HUDI-2811 -- This is an automated message from the Apache Git Service. To respond to the message

[jira] [Updated] (HUDI-2811) Support Spark 3.2 and Parquet 1.12.x

[ https://issues.apache.org/jira/browse/HUDI-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2811: - Description: Reported issues * [https://github.com/apache/hudi/issues/4001] * [https://github.com/apache

[jira] [Resolved] (HUDI-2396) Tracking larger changes in 0.9.0 to be called out in 0.10.0

[ https://issues.apache.org/jira/browse/HUDI-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2396. -- > Tracking larger changes in 0.9.0 to be called out in 0.10.0 >

[GitHub] [hudi] xushiyan commented on issue #4174: Cannot delete data; Illegal character error

xushiyan commented on issue #4174: URL: https://github.com/apache/hudi/issues/4174#issuecomment-986160608 @esaeki which hudi version this is? can you also post the complete stacktrace? -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [hudi] hudi-bot removed a comment on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot removed a comment on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986154238 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * 789d39ea7cb58f354e2691fb9410d6d4395300

[GitHub] [hudi] hudi-bot commented on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot commented on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986159635 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * a0af660192faca0b74d84e10f2249299b05bb4b6 Azure

[GitHub] [hudi] xushiyan commented on issue #4176: [SUPPORT] Getting java.lang.NoSuchFieldError: TIMESTAMP_MICROS error while hive sync using run_sync_tool.sh

xushiyan commented on issue #4176: URL: https://github.com/apache/hudi/issues/4176#issuecomment-986158858 @codejoyan the right jar should be ``` 1.10.1 org.apache.parquet parquet-avro ${parquet.version} provided

[GitHub] [hudi] xushiyan edited a comment on issue #4200: spark-sql query timestamp partition error

xushiyan edited a comment on issue #4200: URL: https://github.com/apache/hudi/issues/4200#issuecomment-986158172 @forest455 which hudi version you used here? this may have been fixed in the upcoming 0.10 cc @YannByron -- This is an automated message from the Apache Git Service. To r

[GitHub] [hudi] xushiyan commented on issue #4200: spark-sql query timestamp partition error

xushiyan commented on issue #4200: URL: https://github.com/apache/hudi/issues/4200#issuecomment-986158172 @forest455 which hudi version you used here? this may have been fixed in the upcoming 0.10 -- This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [hudi] hudi-bot commented on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot commented on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986154238 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * 789d39ea7cb58f354e2691fb9410d6d43953009a Azure

[GitHub] [hudi] hudi-bot removed a comment on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot removed a comment on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986151593 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * 789d39ea7cb58f354e2691fb9410d6d4395300

[jira] [Commented] (HUDI-2877) Support flink catalog to help user use flink table conveniently

[ https://issues.apache.org/jira/browse/HUDI-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17453508#comment-17453508 ] Danny Chen commented on HUDI-2877: -- Fixed via master branch: a8fb69656f522648233f0310ca37

[jira] [Resolved] (HUDI-2877) Support flink catalog to help user use flink table conveniently

[ https://issues.apache.org/jira/browse/HUDI-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2877. -- > Support flink catalog to help user use flink table conveniently >

[hudi] branch master updated (36b69d8 -> a8fb696)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 36b69d8 [HUDI-2935] Remove special casing of clustering in deltastreamer checkpoint retrival (#4216) add a8fb

[GitHub] [hudi] danny0405 merged pull request #4153: [HUDI-2877] Support flink catalog to help user use flink table conveniently

danny0405 merged pull request #4153: URL: https://github.com/apache/hudi/pull/4153 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [hudi] hudi-bot commented on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot commented on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986151593 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * 789d39ea7cb58f354e2691fb9410d6d43953009a Azure

[GitHub] [hudi] hudi-bot removed a comment on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot removed a comment on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986010920 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * 789d39ea7cb58f354e2691fb9410d6d4395300

[GitHub] [hudi] danny0405 commented on issue #4219: [SUPPORT] Flink SQL: NoSuchMethodError: com.esotericsoftware.kryo.Kryo$DefaultInstantiatorStrategy.(Lorg/objenesis/strategy/InstantiatorStrate

danny0405 commented on issue #4219: URL: https://github.com/apache/hudi/issues/4219#issuecomment-986150411 We try to solve the problem by add explicit dependency in flink hudi bundle jar: https://github.com/apache/hudi/commit/38585e4e57c86e0846b5561c4d1750676d88e5f4, can you check your kr

[GitHub] [hudi] xushiyan commented on issue #4208: [SUPPORT] On Hudi 0.9.0 - Alter table throws java.lang.NoSuchMethodException: org.apache.hadoop.hive.ql.metadata.Hive.alterTable(java.lang.String, or

xushiyan commented on issue #4208: URL: https://github.com/apache/hudi/issues/4208#issuecomment-986142729 @BenjMaq can you share the sql used to create this table? also did you run the sql on EMR? -- This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [hudi] xushiyan commented on issue #4207: [SUPPORT] Hudi 0.10.0 throws java.lang.NoSuchMethodError: com.amazonaws.http.AmazonHttpClient.disableStrictHostnameVerification

xushiyan commented on issue #4207: URL: https://github.com/apache/hudi/issues/4207#issuecomment-986136021 @BenjMaq is the 0.10 release candidate? can you please confirm which commit you're using? also can you describe the environment, is this from EMR? cc @umehrot2 -- This is an aut

[GitHub] [hudi] xushiyan closed issue #4202: [SUPPORT] Support Apache Spark 3.2

xushiyan closed issue #4202: URL: https://github.com/apache/hudi/issues/4202 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@h

[GitHub] [hudi] xushiyan commented on issue #4202: [SUPPORT] Support Apache Spark 3.2

xushiyan commented on issue #4202: URL: https://github.com/apache/hudi/issues/4202#issuecomment-986106572 @melin Understood the need for 3.2 support. we have been tracking this in https://issues.apache.org/jira/browse/HUDI-2811 and we should be prioritizing this in next release. cc @

[jira] [Updated] (HUDI-2811) Support Spark 3.2 and Parquet 1.12.x

[ https://issues.apache.org/jira/browse/HUDI-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2811: - Description: Reported issues * [https://github.com/apache/hudi/issues/4001] * [https://github.com/apache

[GitHub] [hudi] yihua commented on a change in pull request #2400: [HUDI-1594] Some fixes and enhancements to test suite framework

yihua commented on a change in pull request #2400: URL: https://github.com/apache/hudi/pull/2400#discussion_r762399404 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java ## @@ -307,7 +307,10 @@ public void refreshTimeline() throws

[GitHub] [hudi] stayrascal opened a new issue #4219: [SUPPORT] Flink SQL: NoSuchMethodError: com.esotericsoftware.kryo.Kryo$DefaultInstantiatorStrategy.(Lorg/objenesis/strategy/InstantiatorStrat

stayrascal opened a new issue #4219: URL: https://github.com/apache/hudi/issues/4219 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)? No - Join the mailing list to engage in conversations and get fast

[jira] [Updated] (HUDI-2783) Upgrade HBase dependencies in Hudi

[ https://issues.apache.org/jira/browse/HUDI-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2783: -- Fix Version/s: 0.11.0 > Upgrade HBase dependencies in Hudi > -- > >

[jira] [Updated] (HUDI-2783) Upgrade HBase dependencies in Hudi

[ https://issues.apache.org/jira/browse/HUDI-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2783: -- Fix Version/s: (was: 0.10.0) > Upgrade HBase dependencies in Hudi >

[GitHub] [hudi] wangxianghu commented on a change in pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

wangxianghu commented on a change in pull request #4217: URL: https://github.com/apache/hudi/pull/4217#discussion_r762426293 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/callback/pulsar/HoodieWriteCommitPulsarCallbackConfig.java ## @@ -0,0 +1,101 @@ +/*

[GitHub] [hudi] wangxianghu commented on a change in pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

wangxianghu commented on a change in pull request #4217: URL: https://github.com/apache/hudi/pull/4217#discussion_r762426293 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/callback/pulsar/HoodieWriteCommitPulsarCallbackConfig.java ## @@ -0,0 +1,101 @@ +/*

svn commit: r51187 - in /dev/hudi/hudi-0.10.0-rc3: ./ hudi-0.10.0-rc3.src.tgz hudi-0.10.0-rc3.src.tgz.asc hudi-0.10.0-rc3.src.tgz.sha512

Author: danny0405 Date: Sat Dec 4 12:21:39 2021 New Revision: 51187 Log: Apache Hudi, version 0.10.0, release candidate 3 Added: dev/hudi/hudi-0.10.0-rc3/ dev/hudi/hudi-0.10.0-rc3/hudi-0.10.0-rc3.src.tgz (with props) dev/hudi/hudi-0.10.0-rc3/hudi-0.10.0-rc3.src.tgz.asc dev/hudi

[GitHub] [hudi] hudi-bot commented on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot commented on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986010920 ## CI report: * 47381a6f94e142f08c7d919ab7bfb213238c38d4 UNKNOWN * 8a00298ff5f2c28c1757582f5d9492ab9cd58e41 UNKNOWN * 789d39ea7cb58f354e2691fb9410d6d43953009a Azure

[GitHub] [hudi] hudi-bot removed a comment on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot removed a comment on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986003882 ## CI report: * 83d385fe307321e2f5846ac72829a8cc994ad239 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4218: [HUDI-2938] Metadata table util to get latest file slices for readers/writers

hudi-bot commented on pull request #4218: URL: https://github.com/apache/hudi/pull/4218#issuecomment-986006105 ## CI report: * 64e8859eecb2c095f71448b98bc4c48692321cdd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4218: [HUDI-2938] Metadata table util to get latest file slices for readers/writers

hudi-bot removed a comment on pull request #4218: URL: https://github.com/apache/hudi/pull/4218#issuecomment-985999024 ## CI report: * 64e8859eecb2c095f71448b98bc4c48692321cdd Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot commented on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-986003882 ## CI report: * 83d385fe307321e2f5846ac72829a8cc994ad239 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4217: [HUDI-2937] Introduce a pulsar implementation of hoodie write commit …

hudi-bot removed a comment on pull request #4217: URL: https://github.com/apache/hudi/pull/4217#issuecomment-985997743 ## CI report: * 83d385fe307321e2f5846ac72829a8cc994ad239 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4153: [HUDI-2877] Support flink catalog to help user use flink table conveniently

hudi-bot commented on pull request #4153: URL: https://github.com/apache/hudi/pull/4153#issuecomment-986002284 ## CI report: * 1decaea9f2a32391809f0210a401010f78066181 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4153: [HUDI-2877] Support flink catalog to help user use flink table conveniently

hudi-bot removed a comment on pull request #4153: URL: https://github.com/apache/hudi/pull/4153#issuecomment-985994711 ## CI report: * 1decaea9f2a32391809f0210a401010f78066181 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[hudi] annotated tag release-0.10.0-rc3 updated (e9e6939 -> d728cc1)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to annotated tag release-0.10.0-rc3 in repository https://gitbox.apache.org/repos/asf/hudi.git. *** WARNING: tag release-0.10.0-rc3 was modified! *** from e9e6939 (commit) to d728cc1 (tag)

[hudi] 25/26: [HUDI-2935] Remove special casing of clustering in deltastreamer checkpoint retrival (#4216)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 40879bca148932c9ad5a13e761cb34f99bc68932 Author: vinoth chandar AuthorDate: Sat Dec 4 01:16:11 2021 -0800

[hudi] 26/26: Bumping release candidate number 3

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit e9e693973fd8be77f2039ad1a9ac4b4ddd52124b Author: yuzhao.cyz AuthorDate: Sat Dec 4 17:39:49 2021 +0800 Bump

[hudi] 24/26: [HUDI-2934] Optimize RequestHandler code style

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 148e069f31f9b2166c3833a4103deeb1cc7e43b3 Author: fengli AuthorDate: Sat Dec 4 13:56:25 2021 +0800 [HUDI-29

[hudi] 18/26: [HUDI-2894][HUDI-2905] Metadata table - avoiding key lookup failures on base files over S3 (#4185)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit a49e5ac7160a5937ebfe2f72deb36dc0ab119f2e Author: Manoj Govindassamy AuthorDate: Fri Dec 3 11:18:10 2021 -0800

[hudi] 15/26: [HUDI-2902] Fixing populate meta fields with Hfile writers and Disabling virtual keys by default for metadata table (#4194)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 7de5d1760191128c86ef40ac2f9cb57e87328e3e Author: Sivabalan Narayanan AuthorDate: Fri Dec 3 07:20:21 2021 -0500

[hudi] 22/26: [HUDI-2890] Kafka Connect: Fix failed writes and avoid table service concurrent operations (#4211)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit b88d4beb23a5ba48fbe642d1f83e55a332b7ce5d Author: rmahindra123 <76502047+rmahindra...@users.noreply.github.com> A

[hudi] 20/26: [MINOR] Mitigate CI jobs timeout issues (#4173)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 31947a09a699f59578fe99c5834e171ab5f82280 Author: Raymond Xu <2701446+xushi...@users.noreply.github.com> AuthorDa

[hudi] 16/26: [HUDI-2911] Removing default value for `PARTITIONPATH_FIELD_NAME` resulting in incorrect `KeyGenerator` configuration (#4195)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 008df11e196d0ee81aa22cdd64bd27ca11d121dd Author: Alexey Kudinkin AuthorDate: Fri Dec 3 04:33:38 2021 -0800

[hudi] 17/26: Revert "[HUDI-2495] Resolve inconsistent key generation for timestamp types by GenericRecord and Row (#3944)" (#4201)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 342acbee33b0f76f7b3a3b328e2e988cc5fdef8f Author: Yann Byron AuthorDate: Sat Dec 4 00:13:38 2021 +0800 Reve

[hudi] 23/26: [HUDI-2923] Fixing metadata table reader when metadata compaction is inflight (#4206)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit e131507d4672316b6a0f2b2f3f63d8ad34e49b85 Author: Sivabalan Narayanan AuthorDate: Sat Dec 4 00:44:50 2021 -0500

[hudi] 19/26: Revert "[HUDI-2489]Tuning HoodieROTablePathFilter by caching hoodieTableFileSystemView, aiming to reduce unnecessary list/get requests"

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 474af05eb50af3943d4eedad9bafdf188d67f273 Author: zhangyue19921010 <69956021+zhangyue19921...@users.noreply.githu

[hudi] 21/26: [HUDI-2933] DISABLE Metadata table by default (#4213)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 7034d1a1be7ecefc346aea95a9ff30bdf758204a Author: vinoth chandar AuthorDate: Fri Dec 3 21:12:35 2021 -0800

[hudi] 10/26: [HUDI-2904] Fix metadata table archival overstepping between regular writers and table services (#4186)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 318818be44d065f1be523f7aa9eb949e09859cbb Author: rmahindra123 <76502047+rmahindra...@users.noreply.github.com> A

[hudi] 09/26: [MINOR] Fix the wrong usage of timestamp length variable bug (#4179)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 3e2116e69fb33009ba3336720f2c7d8d00909232 Author: zzzhy AuthorDate: Thu Dec 2 22:47:31 2021 +0800 [MINOR] F

[hudi] 11/26: [HUDI-2914] Fix remote timeline server config for flink (#4191)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 6c79a68ad91bac8f3bb0e4a97915e6ede90cfe6a Author: Danny Chan AuthorDate: Fri Dec 3 08:59:10 2021 +0800 [HUD

[hudi] 08/26: Fixed partitions produced by layout optimization in case order-by key is composed of a single column (#4183)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 1ee35c484b9e4eefb033086c5e0388afac70e642 Author: Alexey Kudinkin AuthorDate: Wed Dec 1 20:56:04 2021 -0800

[hudi] 07/26: [HUDI-2881] Compact the file group with larger log files to reduce write amplification (#4152)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 7d2c2489025fe5b183367b4f4dfbf64804d8c33b Author: Shawy Geng AuthorDate: Thu Dec 2 09:41:04 2021 +0800 [HUD

[hudi] 12/26: [minor] Refactor write profile to always generate fs view (#4198)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit fe2aae4cea9617cbb469f7b4c6aa072d4c2f3f55 Author: Danny Chan AuthorDate: Fri Dec 3 11:38:29 2021 +0800 [min

[hudi] 13/26: [HUDI-2924] Refresh the fs view on successful checkpoints for write profile (#4199)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 2a4e7186883eb97eca7a5072844f47c77fbf1ef4 Author: Danny Chan AuthorDate: Fri Dec 3 16:12:59 2021 +0800 [HUD

[hudi] 04/26: Revert "[HUDI-2855] Change the default value of 'PAYLOAD_CLASS_NAME' to 'DefaultHoodieRecordPayload' (#4115)" (#4169)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit df70e32ae00f124d6de325ebf1fd3ccf434ed00a Author: Alexey Kudinkin AuthorDate: Tue Nov 30 17:47:16 2021 -0800

[hudi] 05/26: Revert "[HUDI-2856] Bit cask disk map delete modified (#4116)" (#4171)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 7df81a6b6ff5405e9da93289789ec84a280cf8d7 Author: Y Ethan Guo AuthorDate: Tue Nov 30 22:08:44 2021 -0800 Re

[hudi] 14/26: [MINOR] use catalog schema if can not find table schema (#4182)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 1bf13d1a0f15e64433f915b32066caa8b7d76174 Author: Yann Byron AuthorDate: Fri Dec 3 16:37:13 2021 +0800 [MIN

[hudi] 03/26: [HUDI-2891] Fix write configs for Java engine in Kafka Connect Sink (#4161)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit c38ebbc2353fccf9ca91b21307d316bae27e9074 Author: Y Ethan Guo AuthorDate: Tue Nov 30 06:45:50 2021 -0800 [H

[hudi] 01/26: [MINOR] Fix typo, rename 'getUrlEncodePartitoning' to 'getUrlEncodePartitioning' (#4130)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 69d14353bcc20c07d53b7835940c4117cfbf5110 Author: 董可伦 AuthorDate: Tue Nov 30 10:31:22 2021 +0800 [MINOR] Fi

[hudi] 02/26: [HUDI-2642] Add support ignoring case in update sql operation (#3882)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 63a7df79e5e97159b39ae4354462b52d18899f22 Author: 董可伦 AuthorDate: Tue Nov 30 14:36:36 2021 +0800 [HUDI-2642

[hudi] branch release-0.10.0 updated (92dbb41 -> e9e6939)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git. from 92dbb41 Bumping release candidate number 2 new 69d1435 [MINOR] Fix typo,rename 'getUrlEncodePartitoni

[hudi] 06/26: [HUDI-2880] Fixing loading of props from default dir (#4167)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 9d7f681ca6d3d8c244854040298569f54ba701b8 Author: Sivabalan Narayanan AuthorDate: Wed Dec 1 03:02:30 2021 -0500

[GitHub] [hudi] hudi-bot commented on pull request #4218: [HUDI-2938] Metadata table util to get latest file slices for readers/writers

hudi-bot commented on pull request #4218: URL: https://github.com/apache/hudi/pull/4218#issuecomment-985999024 ## CI report: * 64e8859eecb2c095f71448b98bc4c48692321cdd Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4218: [HUDI-2938] Metadata table util to get latest file slices for readers/writers

hudi-bot removed a comment on pull request #4218: URL: https://github.com/apache/hudi/pull/4218#issuecomment-985998714 ## CI report: * 64e8859eecb2c095f71448b98bc4c48692321cdd UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] manojpec commented on pull request #4206: [HUDI-2923] Fixing metadata table reader when metadata compaction is inflight

manojpec commented on pull request #4206: URL: https://github.com/apache/hudi/pull/4206#issuecomment-985998752 @vinothchandar @prashantwason Addressed review comments in https://github.com/apache/hudi/pull/4218 -- This is an automated message from the Apache Git Service. To respond to th

[GitHub] [hudi] hudi-bot commented on pull request #4218: [HUDI-2938] Metadata table util to get latest file slices for readers/writers

hudi-bot commented on pull request #4218: URL: https://github.com/apache/hudi/pull/4218#issuecomment-985998714 ## CI report: * 64e8859eecb2c095f71448b98bc4c48692321cdd UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[jira] [Updated] (HUDI-2938) Code Refactor: Metadata util to get latest file slices for readers and writers

[ https://issues.apache.org/jira/browse/HUDI-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2938: - Labels: pull-request-available (was: ) > Code Refactor: Metadata util to get latest file slices f

[GitHub] [hudi] manojpec opened a new pull request #4218: [HUDI-2938] Metadata table util to get latest file slices for readers/writers

manojpec opened a new pull request #4218: URL: https://github.com/apache/hudi/pull/4218 ## What is the purpose of the pull request Readers would want to get the latest file slices merged with the last known committed instants just before the pending compaction if any, and Writers wo

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4192: [HUDI-2916] Add IssueNavigationLink for IDEA

XuQianJin-Stars commented on pull request #4192: URL: https://github.com/apache/hudi/pull/4192#issuecomment-985997793 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

  1   2   >