[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-09 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1152013872 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 497d3bf661b89b98cb37c6452d866d905c208c16 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] Chosen123Wang opened a new issue, #5833: [SUPPORT] flink 1.14 cdc 2.2 to hudi: org.apache.hudi.exception.HoodieRemoteException: 172.18.115.2:40827 failed to respond

2022-06-09 Thread GitBox
Chosen123Wang opened a new issue, #5833: URL: https://github.com/apache/hudi/issues/5833 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at dev-su

[GitHub] [hudi] hudi-bot commented on pull request #5831: [HUDI-4220] Created an utility to convert JSON to Avro

2022-06-09 Thread GitBox
hudi-bot commented on PR #5831: URL: https://github.com/apache/hudi/pull/5831#issuecomment-1152001605 ## CI report: * 2fd56a631800136a7fff3ff2575c1e49b5f1ee83 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9212

[GitHub] [hudi] hudi-bot commented on pull request #5727: [HUDI-3863] Add UT for drop partition column in deltastreamer testsuite

2022-06-09 Thread GitBox
hudi-bot commented on PR #5727: URL: https://github.com/apache/hudi/pull/5727#issuecomment-1152001314 ## CI report: * e45a2b36733acc7bff16dc02ec872c1363946c6b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9026

[GitHub] [hudi] hudi-bot commented on pull request #5829: [HUDI-4221] Fixing getAllPartitionPaths perf hit w/ FileSystemBackedMetadata

2022-06-09 Thread GitBox
hudi-bot commented on PR #5829: URL: https://github.com/apache/hudi/pull/5829#issuecomment-1151997687 ## CI report: * b7558b9ff9e4dd756ebd0adf8a0f27e3d4e3dd40 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9209

[GitHub] [hudi] hudi-bot commented on pull request #5831: [HUDI-4220] Created an utility to convert JSON to Avro

2022-06-09 Thread GitBox
hudi-bot commented on PR #5831: URL: https://github.com/apache/hudi/pull/5831#issuecomment-1151997726 ## CI report: * 2fd56a631800136a7fff3ff2575c1e49b5f1ee83 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5788: [HUDI-4207] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an e…

2022-06-09 Thread GitBox
hudi-bot commented on PR #5788: URL: https://github.com/apache/hudi/pull/5788#issuecomment-1151997566 ## CI report: * ea757ee1e9cc0b1794945199a7445099a25a4d4d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9206

[GitHub] [hudi] hudi-bot commented on pull request #5727: [HUDI-3863] Add UT for drop partition column in deltastreamer testsuite

2022-06-09 Thread GitBox
hudi-bot commented on PR #5727: URL: https://github.com/apache/hudi/pull/5727#issuecomment-1151997439 ## CI report: * e45a2b36733acc7bff16dc02ec872c1363946c6b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9026

[GitHub] [hudi] LinMingQiang opened a new issue, #5832: when task communicates with jm's timeline server throw HoodieRemoteException: IP : port failed to respond

2022-06-09 Thread GitBox
LinMingQiang opened a new issue, #5832: URL: https://github.com/apache/hudi/issues/5832 Flink streaming write to hudi , The task runs fine about an hour after it starts, and the communication is normal,When the task runs for a period of time,An error is reported when BucketAssignFunction co

[GitHub] [hudi] luoyajun10 commented on pull request #5727: [HUDI-3863] Add UT for drop partition column in deltastreamer testsuite

2022-06-09 Thread GitBox
luoyajun10 commented on PR #5727: URL: https://github.com/apache/hudi/pull/5727#issuecomment-1151969660 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] luoyajun10 commented on pull request #5727: [HUDI-3863] Add UT for drop partition column in deltastreamer testsuite

2022-06-09 Thread GitBox
luoyajun10 commented on PR #5727: URL: https://github.com/apache/hudi/pull/5727#issuecomment-1151968278 > patch as LGTM. can you check on CI failures please. @nsivabalan the failure seems the forked vm crashed. I try to rerun through the hudi-bot, but it's not be triggered. -- This

[GitHub] [hudi] luoyajun10 commented on pull request #5727: [HUDI-3863] Add UT for drop partition column in deltastreamer testsuite

2022-06-09 Thread GitBox
luoyajun10 commented on PR #5727: URL: https://github.com/apache/hudi/pull/5727#issuecomment-1151964891 > patch as LGTM. can you check on CI failures please. the failure seems vm crashed, I try to rerun through the hudi-bot but it's not be triggered. -- This is an automated message

[jira] [Updated] (HUDI-4220) Create a utility to convert json records to avro

2022-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4220: - Labels: pull-request-available (was: ) > Create a utility to convert json records to avro > -

[GitHub] [hudi] vingov opened a new pull request, #5831: [HUDI-4220] Created an utility to convert JSON to Avro

2022-06-09 Thread GitBox
vingov opened a new pull request, #5831: URL: https://github.com/apache/hudi/pull/5831 ## What is the purpose of the pull request *We need a utility to convert topics of many gzip files of JSON lines into Avro. This utility will convert topics of many gzip files of JSON lines into Av

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(R…

2022-06-09 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1151959011 ## CI report: * 152d9abfe646e966dd40171a15fd5faa5e0a4594 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9211

[GitHub] [hudi] hudi-bot commented on pull request #5788: [HUDI-4207] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an e…

2022-06-09 Thread GitBox
hudi-bot commented on PR #5788: URL: https://github.com/apache/hudi/pull/5788#issuecomment-1151958911 ## CI report: * 02b3550eb789013073e4d200ab5ec556199f6bb2 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9145

[GitHub] [hudi] hudi-bot commented on pull request #5829: [HUDI-4221] Fixing getAllPartitionPaths perf hit w/ FileSystemBackedMetadata

2022-06-09 Thread GitBox
hudi-bot commented on PR #5829: URL: https://github.com/apache/hudi/pull/5829#issuecomment-1151956525 ## CI report: * b7558b9ff9e4dd756ebd0adf8a0f27e3d4e3dd40 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9209

[GitHub] [hudi] hudi-bot commented on pull request #5788: [HUDI-4207] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an e…

2022-06-09 Thread GitBox
hudi-bot commented on PR #5788: URL: https://github.com/apache/hudi/pull/5788#issuecomment-1151956454 ## CI report: * 02b3550eb789013073e4d200ab5ec556199f6bb2 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9145

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(R…

2022-06-09 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1151956546 ## CI report: * 152d9abfe646e966dd40171a15fd5faa5e0a4594 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5829: [HUDI-4221] Fixing getAllPartitionPaths perf hit w/ FileSystemBackedMetadata

2022-06-09 Thread GitBox
hudi-bot commented on PR #5829: URL: https://github.com/apache/hudi/pull/5829#issuecomment-1151954252 ## CI report: * b7558b9ff9e4dd756ebd0adf8a0f27e3d4e3dd40 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5827: [HUDI-4218] The tableExists method should print the correct exception information when an exception occurs

2022-06-09 Thread GitBox
hudi-bot commented on PR #5827: URL: https://github.com/apache/hudi/pull/5827#issuecomment-1151954223 ## CI report: * 15e2111dd38e234f7648be667c6f5a579fd05fd6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9204

[jira] [Updated] (HUDI-3981) [UMBRELLA] Flink engine support for comprehensive schema evolution(RFC-33)

2022-06-09 Thread Alexander Trushev (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Trushev updated HUDI-3981: Status: In Progress (was: Open) > [UMBRELLA] Flink engine support for comprehensive schema

[GitHub] [hudi] trushev commented on pull request #5443: [HUDI-3982] Comprehensive schema evolution in flink when read/batch/cow/snapshot

2022-06-09 Thread GitBox
trushev commented on PR #5443: URL: https://github.com/apache/hudi/pull/5443#issuecomment-1151941699 I merged all supported modes into one patch and reworked pull request. https://github.com/apache/hudi/pull/5830 -- This is an automated message from the Apache Git Service. To respon

[jira] [Updated] (HUDI-3981) [UMBRELLA] Flink engine support for comprehensive schema evolution(RFC-33)

2022-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3981: - Labels: pull-request-available (was: ) > [UMBRELLA] Flink engine support for comprehensive schema

[GitHub] [hudi] trushev closed pull request #5443: [HUDI-3982] Comprehensive schema evolution in flink when read/batch/cow/snapshot

2022-06-09 Thread GitBox
trushev closed pull request #5443: [HUDI-3982] Comprehensive schema evolution in flink when read/batch/cow/snapshot URL: https://github.com/apache/hudi/pull/5443 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [hudi] trushev opened a new pull request, #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(R…

2022-06-09 Thread GitBox
trushev opened a new pull request, #5830: URL: https://github.com/apache/hudi/pull/5830 …FC-33) ## What is the purpose of the pull request This PR adds support of reading by flink when comprehensive schema evolution(RFC-33) enabled and there were some operations *add column*, *rena

[GitHub] [hudi] LinMingQiang commented on a diff in pull request #5788: [HUDI-4207] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an e…

2022-06-09 Thread GitBox
LinMingQiang commented on code in PR #5788: URL: https://github.com/apache/hudi/pull/5788#discussion_r894148151 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieMergeHandle.java: ## @@ -116,17 +117,19 @@ public HoodieMergeHandle(HoodieWriteConfig confi

[jira] [Updated] (HUDI-3982) Comprehensive schema evolution in flink when read/batch/cow/snapshot

2022-06-09 Thread Alexander Trushev (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Trushev updated HUDI-3982: Status: Open (was: In Progress) > Comprehensive schema evolution in flink when read/batch/c

[GitHub] [hudi] nsivabalan closed issue #5776: [SUPPORT] Performance degradation for listing partitions

2022-06-09 Thread GitBox
nsivabalan closed issue #5776: [SUPPORT] Performance degradation for listing partitions URL: https://github.com/apache/hudi/issues/5776 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [hudi] nsivabalan commented on issue #5776: [SUPPORT] Performance degradation for listing partitions

2022-06-09 Thread GitBox
nsivabalan commented on issue #5776: URL: https://github.com/apache/hudi/issues/5776#issuecomment-1151931305 thanks for pointing it out. since we have a PR, closing it out. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] nsivabalan commented on issue #5776: [SUPPORT] Performance degradation for listing partitions

2022-06-09 Thread GitBox
nsivabalan commented on issue #5776: URL: https://github.com/apache/hudi/issues/5776#issuecomment-1151931084 https://github.com/apache/hudi/pull/5829 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Updated] (HUDI-4221) GetAllPartitions w/o metadata has regressed in perf from 0.9.0 to 0.11.0

2022-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4221: - Labels: pull-request-available (was: ) > GetAllPartitions w/o metadata has regressed in perf from

[GitHub] [hudi] nsivabalan opened a new pull request, #5829: [HUDI-4221] Fixing getAllPartitionPaths perf hit w/o metadata table

2022-06-09 Thread GitBox
nsivabalan opened a new pull request, #5829: URL: https://github.com/apache/hudi/pull/5829 ## What is the purpose of the pull request - Looks like getAllPartitionPaths have regressed in perf from 0.9.0 to 0.11.0. I could able to triage it to newly written code where in "isExists()" i

[GitHub] [hudi] danny0405 commented on a diff in pull request #5788: [HUDI-4207] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an e…

2022-06-09 Thread GitBox
danny0405 commented on code in PR #5788: URL: https://github.com/apache/hudi/pull/5788#discussion_r894144666 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieMergeHandle.java: ## @@ -116,17 +117,19 @@ public HoodieMergeHandle(HoodieWriteConfig config,

[GitHub] [hudi] nsivabalan commented on issue #5776: [SUPPORT] Performance degradation for listing partitions

2022-06-09 Thread GitBox
nsivabalan commented on issue #5776: URL: https://github.com/apache/hudi/issues/5776#issuecomment-1151928249 @namuny : yes, looks like it regressed. https://issues.apache.org/jira/browse/HUDI-4221 I am reverting the change. will put up a PR. -- This is an automated message from t

[jira] [Assigned] (HUDI-4221) GetAllPartitions w/o metadata has regressed in perf from 0.9.0 to 0.11.0

2022-06-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-4221: - Assignee: sivabalan narayanan > GetAllPartitions w/o metadata has regressed in pe

[jira] [Created] (HUDI-4221) GetAllPartitions w/o metadata has regressed in perf from 0.9.0 to 0.11.0

2022-06-09 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-4221: - Summary: GetAllPartitions w/o metadata has regressed in perf from 0.9.0 to 0.11.0 Key: HUDI-4221 URL: https://issues.apache.org/jira/browse/HUDI-4221 Projec

[jira] [Updated] (HUDI-4221) GetAllPartitions w/o metadata has regressed in perf from 0.9.0 to 0.11.0

2022-06-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4221: -- Fix Version/s: 0.12.0 > GetAllPartitions w/o metadata has regressed in perf from 0.9.0 t

[jira] [Updated] (HUDI-4221) GetAllPartitions w/o metadata has regressed in perf from 0.9.0 to 0.11.0

2022-06-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4221: -- Priority: Blocker (was: Major) > GetAllPartitions w/o metadata has regressed in perf fr

[GitHub] [hudi] hudi-bot commented on pull request #5828: [HUDI-4219] Merge Into when update expression "col=s.col+2" on precombine cause exception

2022-06-09 Thread GitBox
hudi-bot commented on PR #5828: URL: https://github.com/apache/hudi/pull/5828#issuecomment-1151924602 ## CI report: * 0085d6d98d80f103f65a308db45fedc1a6bbfe89 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9208

[GitHub] [hudi] hudi-bot commented on pull request #5828: [HUDI-4219] Merge Into when update expression "col=s.col+2" on precombine cause exception

2022-06-09 Thread GitBox
hudi-bot commented on PR #5828: URL: https://github.com/apache/hudi/pull/5828#issuecomment-1151922364 ## CI report: * 0085d6d98d80f103f65a308db45fedc1a6bbfe89 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5825: [HUDI-4217] improve repeat init object in ExpressionPayload

2022-06-09 Thread GitBox
hudi-bot commented on PR #5825: URL: https://github.com/apache/hudi/pull/5825#issuecomment-1151920089 ## CI report: * 526a45bec3eb95921d25a59203d10f8bf9d9e2ce Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9203

[GitHub] [hudi] hudi-bot commented on pull request #5758: [HUDI-4194] upgrade confluent version to 7.1.1

2022-06-09 Thread GitBox
hudi-bot commented on PR #5758: URL: https://github.com/apache/hudi/pull/5758#issuecomment-1151919980 ## CI report: * 7baa7196dbd5fe1416614aac6d8054b67cc91b25 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9205

[jira] [Updated] (HUDI-4219) Merge Into when update expression "col=s.col+2" on precombine cause exception

2022-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4219: - Labels: pull-request-available (was: ) > Merge Into when update expression "col=s.col+2" on preco

[GitHub] [hudi] shenjiayu17 opened a new pull request, #5828: [HUDI-4219] Merge Into when update expression "col=s.col+2" on precombine cause exception

2022-06-09 Thread GitBox
shenjiayu17 opened a new pull request, #5828: URL: https://github.com/apache/hudi/pull/5828 ## What is the purpose of the pull request This PR fix a repeated calculation bug when Merge with precombine expression. Detail is in https://issues.apache.org/jira/browse/HUDI-4219

[jira] [Created] (HUDI-4220) Create a utility to convert json records to avro

2022-06-09 Thread Vinoth Govindarajan (Jira)
Vinoth Govindarajan created HUDI-4220: - Summary: Create a utility to convert json records to avro Key: HUDI-4220 URL: https://issues.apache.org/jira/browse/HUDI-4220 Project: Apache Hudi

[GitHub] [hudi] luoyajun10 commented on pull request #5727: [HUDI-3863] Add UT for drop partition column in deltastreamer testsuite

2022-06-09 Thread GitBox
luoyajun10 commented on PR #5727: URL: https://github.com/apache/hudi/pull/5727#issuecomment-1151900749 @hudi-bot run_azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] XuQianJin-Stars closed issue #5812: [SUPPORT]Same primary key with different _hoodie_record_key

2022-06-09 Thread GitBox
XuQianJin-Stars closed issue #5812: [SUPPORT]Same primary key with different _hoodie_record_key URL: https://github.com/apache/hudi/issues/5812 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[jira] [Updated] (HUDI-4219) Merge Into when update expression "col=s.col+2" on precombine cause exception

2022-06-09 Thread Jiayu Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayu Shen updated HUDI-4219: - Description: Merge sql: {code:java} merge into target_table as t using source_table as s on t.primary_key

[jira] [Created] (HUDI-4219) Merge Into when update expression "col=s.col+2" on precombine cause exception

2022-06-09 Thread Jiayu Shen (Jira)
Jiayu Shen created HUDI-4219: Summary: Merge Into when update expression "col=s.col+2" on precombine cause exception Key: HUDI-4219 URL: https://issues.apache.org/jira/browse/HUDI-4219 Project: Apache Hud

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-09 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1151892631 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 5e3ada3e2362faef132aa49587b746081d16fe08 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5788: [HUDI-4207] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an e…

2022-06-09 Thread GitBox
hudi-bot commented on PR #5788: URL: https://github.com/apache/hudi/pull/5788#issuecomment-1151888235 ## CI report: * 02b3550eb789013073e4d200ab5ec556199f6bb2 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9145

[GitHub] [hudi] hudi-bot commented on pull request #5758: [HUDI-4194] upgrade confluent version to 7.1.1

2022-06-09 Thread GitBox
hudi-bot commented on PR #5758: URL: https://github.com/apache/hudi/pull/5758#issuecomment-1151888184 ## CI report: * c7ed9757fc4c3bd2c62b86ebe88381ed1ef76f04 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9193

[GitHub] [hudi] hudi-bot commented on pull request #5827: [HUDI-4218] The tableExists method should print the correct exception information when an exception occurs

2022-06-09 Thread GitBox
hudi-bot commented on PR #5827: URL: https://github.com/apache/hudi/pull/5827#issuecomment-1151885823 ## CI report: * 15e2111dd38e234f7648be667c6f5a579fd05fd6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9204

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-09 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1151885697 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 5e3ada3e2362faef132aa49587b746081d16fe08 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5788: [HUDI-4207] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an e…

2022-06-09 Thread GitBox
hudi-bot commented on PR #5788: URL: https://github.com/apache/hudi/pull/5788#issuecomment-1151885750 ## CI report: * 02b3550eb789013073e4d200ab5ec556199f6bb2 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9145

[GitHub] [hudi] hudi-bot commented on pull request #5758: [HUDI-4194] upgrade confluent version to 7.1.1

2022-06-09 Thread GitBox
hudi-bot commented on PR #5758: URL: https://github.com/apache/hudi/pull/5758#issuecomment-1151885651 ## CI report: * c7ed9757fc4c3bd2c62b86ebe88381ed1ef76f04 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9193

[GitHub] [hudi] KnightChess commented on a diff in pull request #5825: [HUDI-4217] improve repeat init object in ExpressionPayload

2022-06-09 Thread GitBox
KnightChess commented on code in PR #5825: URL: https://github.com/apache/hudi/pull/5825#discussion_r894120312 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/command/payload/SqlTypedRecord.scala: ## @@ -17,27 +17,59 @@ package org.apache.s

[GitHub] [hudi] hudi-bot commented on pull request #5827: [HUDI-4218] The tableExists method should print the correct exception information when an exception occurs

2022-06-09 Thread GitBox
hudi-bot commented on PR #5827: URL: https://github.com/apache/hudi/pull/5827#issuecomment-1151883020 ## CI report: * 15e2111dd38e234f7648be667c6f5a579fd05fd6 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] LinMingQiang commented on a diff in pull request #5788: [HUDI-4207] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an e…

2022-06-09 Thread GitBox
LinMingQiang commented on code in PR #5788: URL: https://github.com/apache/hudi/pull/5788#discussion_r894112596 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieMergeHandle.java: ## @@ -116,8 +117,14 @@ public HoodieMergeHandle(HoodieWriteConfig config

[GitHub] [hudi] danny0405 commented on pull request #5696: [HUDI-4158] Add reader heartbeat for cleaning strategy

2022-06-09 Thread GitBox
danny0405 commented on PR #5696: URL: https://github.com/apache/hudi/pull/5696#issuecomment-1151870051 > @danny0405 : Can you add description to the PR please and fill in template. I'm hesitating whether it is valuable to do this feature, the reader heartbeats that affecting the write

[GitHub] [hudi] boneanxs commented on a diff in pull request #5825: [HUDI-4217] improve repeat init object in ExpressionPayload

2022-06-09 Thread GitBox
boneanxs commented on code in PR #5825: URL: https://github.com/apache/hudi/pull/5825#discussion_r894110805 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/command/payload/SqlTypedRecord.scala: ## @@ -17,27 +17,59 @@ package org.apache.spar

[jira] [Updated] (HUDI-4218) The tableExists method should print the correct exception information when an exception occurs

2022-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4218: - Labels: pull-request-available (was: ) > The tableExists method should print the correct exceptio

[GitHub] [hudi] dongkelun opened a new pull request, #5827: [HUDI-4218] The tableExists method should print the correct exceptioninformation when an exception occurs

2022-06-09 Thread GitBox
dongkelun opened a new pull request, #5827: URL: https://github.com/apache/hudi/pull/5827 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[GitHub] [hudi] boneanxs commented on pull request #5722: [WIP][HUDI-4170] Make user can use hoodie.datasource.read.paths to read necessary files

2022-06-09 Thread GitBox
boneanxs commented on PR #5722: URL: https://github.com/apache/hudi/pull/5722#issuecomment-1151855102 > may I know why this is WIP @nsivabalan Break this into two different PRs as they solve different issues, after https://github.com/apache/hudi/pull/5723 merged, I'll rebase this. -

[jira] [Updated] (HUDI-4218) The tableExists method should print the correct exception information when an exception occurs

2022-06-09 Thread Jira
[ https://issues.apache.org/jira/browse/HUDI-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 董可伦 updated HUDI-4218: -- Description: In the existing version, when an exception occurs in this method, the following exception information will

[GitHub] [hudi] hudi-bot commented on pull request #5825: [HUDI-4217] improve repeat init object in ExpressionPayload

2022-06-09 Thread GitBox
hudi-bot commented on PR #5825: URL: https://github.com/apache/hudi/pull/5825#issuecomment-1151852794 ## CI report: * 526a45bec3eb95921d25a59203d10f8bf9d9e2ce Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9203

[GitHub] [hudi] hudi-bot commented on pull request #5825: [HUDI-4217] improve repeat init object in ExpressionPayload

2022-06-09 Thread GitBox
hudi-bot commented on PR #5825: URL: https://github.com/apache/hudi/pull/5825#issuecomment-1151850397 ## CI report: * 526a45bec3eb95921d25a59203d10f8bf9d9e2ce UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Created] (HUDI-4218) The tableExists method should print the correct exception information when an exception occurs

2022-06-09 Thread Jira
董可伦 created HUDI-4218: - Summary: The tableExists method should print the correct exception information when an exception occurs Key: HUDI-4218 URL: https://issues.apache.org/jira/browse/HUDI-4218 Project: Apache

[GitHub] [hudi] njalan opened a new issue, #5826: Hudi table statistics is not proper by analyze table table compute statistics

2022-06-09 Thread GitBox
njalan opened a new issue, #5826: URL: https://github.com/apache/hudi/issues/5826 Collect the hudi table statistics by running analyze table compute statistics; It shows numRows is **629345953** but actual row count is **87095918**. It is much more then actual row count --

[GitHub] [hudi] KnightChess commented on pull request #5825: [HUDI-4217] improve repeat init object in ExpressionPayload

2022-06-09 Thread GitBox
KnightChess commented on PR #5825: URL: https://github.com/apache/hudi/pull/5825#issuecomment-1151848950 before: https://user-images.githubusercontent.com/20125927/172977646-ccbab8e2-8252-48bc-913d-6e2ba48ddeb0.png";> after: https://user-images.githubusercontent.com/20125927/1729

[jira] [Updated] (HUDI-4217) improve repeat init object in ExpressionPayload

2022-06-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4217: - Labels: pull-request-available (was: ) > improve repeat init object in ExpressionPayload > --

[GitHub] [hudi] KnightChess opened a new pull request, #5825: [HUDI-4217] improve repeat init object in ExpressionPayload

2022-06-09 Thread GitBox
KnightChess opened a new pull request, #5825: URL: https://github.com/apache/hudi/pull/5825 ## What is the purpose of the pull request improve repeat init object in ExpressionPayload, it cose lots of cpu time ## Brief change log *(for example:)* - *Modify AnnotationL

[GitHub] [hudi] hudi-bot commented on pull request #5727: [HUDI-3863] Add UT for drop partition column in deltastreamer testsuite

2022-06-09 Thread GitBox
hudi-bot commented on PR #5727: URL: https://github.com/apache/hudi/pull/5727#issuecomment-1151844612 ## CI report: * e45a2b36733acc7bff16dc02ec872c1363946c6b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9026

[GitHub] [hudi] YuweiXiao commented on pull request #5771: [HUDI-4071] Relax record key requirement and write with minimal options

2022-06-09 Thread GitBox
YuweiXiao commented on PR #5771: URL: https://github.com/apache/hudi/pull/5771#issuecomment-1151844365 > good point @YuweiXiao . But I am not sure if we can do that. after few commits, if user wishes to add upsert records, we may need the bloom filter index. May be we can take it as another

[GitHub] [hudi] hudi-bot commented on pull request #5802: Support Hadoop 3.x Hive 3.x Spark 3.x (squash)

2022-06-09 Thread GitBox
hudi-bot commented on PR #5802: URL: https://github.com/apache/hudi/pull/5802#issuecomment-1151841389 ## CI report: * 2e52ebe2593339cdc3864052ccce4df5f62857b2 UNKNOWN * b4f79d95e716973de2c3ec049c36d23bb6c2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-09 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1151841288 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 5e3ada3e2362faef132aa49587b746081d16fe08 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5727: [HUDI-3863] Add UT for drop partition column in deltastreamer testsuite

2022-06-09 Thread GitBox
hudi-bot commented on PR #5727: URL: https://github.com/apache/hudi/pull/5727#issuecomment-1151841176 ## CI report: * e45a2b36733acc7bff16dc02ec872c1363946c6b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9026

[jira] [Commented] (HUDI-4217) improve repeat init object in ExpressionPayload

2022-06-09 Thread KnightChess (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552500#comment-17552500 ] KnightChess commented on HUDI-4217: --- the flame graph [^flamegraph4.svg] > improve repe

[jira] [Updated] (HUDI-4217) improve repeat init object in ExpressionPayload

2022-06-09 Thread KnightChess (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KnightChess updated HUDI-4217: -- Attachment: (was: image-2022-06-10-10-07-16-145.png) > improve repeat init object in ExpressionPaylo

[jira] [Updated] (HUDI-4217) improve repeat init object in ExpressionPayload

2022-06-09 Thread KnightChess (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KnightChess updated HUDI-4217: -- Attachment: flamegraph4.svg > improve repeat init object in ExpressionPayload >

[jira] [Updated] (HUDI-4217) improve repeat init object in ExpressionPayload

2022-06-09 Thread KnightChess (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KnightChess updated HUDI-4217: -- Attachment: image-2022-06-10-10-07-45-715.png > improve repeat init object in ExpressionPayload > --

[jira] [Created] (HUDI-4217) improve repeat init object in ExpressionPayload

2022-06-09 Thread KnightChess (Jira)
KnightChess created HUDI-4217: - Summary: improve repeat init object in ExpressionPayload Key: HUDI-4217 URL: https://issues.apache.org/jira/browse/HUDI-4217 Project: Apache Hudi Issue Type: Impro

[jira] [Commented] (HUDI-4217) improve repeat init object in ExpressionPayload

2022-06-09 Thread KnightChess (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17552499#comment-17552499 ] KnightChess commented on HUDI-4217: --- !image-2022-06-10-10-07-45-715.png! > improve repe

[GitHub] [hudi] luoyajun10 commented on pull request #5727: [HUDI-3863] Add UT for drop partition column in deltastreamer testsuite

2022-06-09 Thread GitBox
luoyajun10 commented on PR #5727: URL: https://github.com/apache/hudi/pull/5727#issuecomment-1151827568 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] leobiscassi commented on pull request #5647: Update the docs for Distributed File System (DFS) section on Hudi Delta Streamer page

2022-06-09 Thread GitBox
leobiscassi commented on PR #5647: URL: https://github.com/apache/hudi/pull/5647#issuecomment-1151758686 Thanks @nsivabalan! 🎉 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [hudi] hudi-bot commented on pull request #5802: Support Hadoop 3.x Hive 3.x Spark 3.x (squash)

2022-06-09 Thread GitBox
hudi-bot commented on PR #5802: URL: https://github.com/apache/hudi/pull/5802#issuecomment-1151743529 ## CI report: * c443624ac6175950caa7f2ac1b6a6de9b8e92ab8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9198

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-09 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1151743474 ## CI report: * 5e3cfef3641cb5493d73e21773c2a9aad9b7d2bb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9195

[GitHub] [hudi] hudi-bot commented on pull request #5802: Support Hadoop 3.x Hive 3.x Spark 3.x (squash)

2022-06-09 Thread GitBox
hudi-bot commented on PR #5802: URL: https://github.com/apache/hudi/pull/5802#issuecomment-1151738804 ## CI report: * c443624ac6175950caa7f2ac1b6a6de9b8e92ab8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9198

[GitHub] [hudi] hudi-bot commented on pull request #5786: Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-06-09 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1151738763 ## CI report: * 5e3cfef3641cb5493d73e21773c2a9aad9b7d2bb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9195

[GitHub] [hudi] bkosuru opened a new issue, #5824: HoodieDeltaStreamer does not work with AvroKafkaSource and FilebasedSchemaProvider

2022-06-09 Thread GitBox
bkosuru opened a new issue, #5824: URL: https://github.com/apache/hudi/issues/5824 Hello, HoodieDeltaStreamer does not work with AvroKafkaSource and FilebasedSchemaProvider. It still expects schema.registry.url Hudi version 0.10.1 **To Reproduce** Kafka-source.properties

[GitHub] [hudi] nsivabalan commented on pull request #5659: [HUDI-4137] SnowflakeSyncTool MVP implementation to integrate with Snowflake

2022-06-09 Thread GitBox
nsivabalan commented on PR #5659: URL: https://github.com/apache/hudi/pull/5659#issuecomment-1151724408 @prasannarajaperumal : Can you review this when you can. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] nsivabalan commented on pull request #5659: [HUDI-4137] SnowflakeSyncTool MVP implementation to integrate with Snowflake

2022-06-09 Thread GitBox
nsivabalan commented on PR #5659: URL: https://github.com/apache/hudi/pull/5659#issuecomment-1151723727 @vinothchandar : You may want to review this sometime. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[hudi] branch master updated: [HUDI-3889] Do not validate table config if save mode is set to Overwrite (#5619)

2022-06-09 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 2b3a85528a [HUDI-3889] Do not validate table co

[GitHub] [hudi] nsivabalan merged pull request #5619: [HUDI-3889] Do not validate table config if save mode is set to Overwrite

2022-06-09 Thread GitBox
nsivabalan merged PR #5619: URL: https://github.com/apache/hudi/pull/5619 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apach

[GitHub] [hudi] nsivabalan commented on pull request #5630: [HUDI-3994] - Added support for initializing DeltaStreamer without a …

2022-06-09 Thread GitBox
nsivabalan commented on PR #5630: URL: https://github.com/apache/hudi/pull/5630#issuecomment-1151706873 @codope : can you review this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [hudi] nsivabalan commented on pull request #5643: [WIP][HUDI-4071] Change defaults for some of the configs

2022-06-09 Thread GitBox
nsivabalan commented on PR #5643: URL: https://github.com/apache/hudi/pull/5643#issuecomment-1151705860 @codope : whats the follow up on this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [hudi] nsivabalan commented on pull request #5647: Update the docs for Distributed File System (DFS) section on Hudi Delta Streamer page

2022-06-09 Thread GitBox
nsivabalan commented on PR #5647: URL: https://github.com/apache/hudi/pull/5647#issuecomment-1151705717 thanks for the contribution! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[hudi] branch asf-site updated: Update the docs for Distributed File System (DFS) section on Hudi Delta Streamer page (#5647)

2022-06-09 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new e326b3fbe1 Update the docs for Distributed

[GitHub] [hudi] nsivabalan merged pull request #5647: Update the docs for Distributed File System (DFS) section on Hudi Delta Streamer page

2022-06-09 Thread GitBox
nsivabalan merged PR #5647: URL: https://github.com/apache/hudi/pull/5647 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apach

  1   2   3   >