[GitHub] [hudi] zhuanshenbsj1 commented on pull request #7159: [HUDI-5173]Skip if there is only one file in clusteringGroup

2022-12-12 Thread GitBox
zhuanshenbsj1 commented on PR #7159: URL: https://github.com/apache/hudi/pull/7159#issuecomment-1347877944 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] waywtdcc commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution

2022-12-12 Thread GitBox
waywtdcc commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1347854543 Hope this pr can be merged into 0.12.2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] codope commented on a diff in pull request #7437: [HUDI-5366] Closing metadata writer from within writeClient

2022-12-12 Thread GitBox
codope commented on code in PR #7437: URL: https://github.com/apache/hudi/pull/7437#discussion_r1046736411 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java: ## @@ -1125,6 +1130,14 @@ private HoodieData

[GitHub] [hudi] zhuanshenbsj1 commented on a diff in pull request #7159: [HUDI-5173]Skip if there is only one file in clusteringGroup

2022-12-12 Thread GitBox
zhuanshenbsj1 commented on code in PR #7159: URL: https://github.com/apache/hudi/pull/7159#discussion_r1046699321 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/cdc/TestCDCDataFrameSuite.scala: ## @@ -118,6 +118,7 @@ class TestCDCDataFrameSuite

[GitHub] [hudi] zhuanshenbsj1 commented on a diff in pull request #7159: [HUDI-5173]Skip if there is only one file in clusteringGroup

2022-12-12 Thread GitBox
zhuanshenbsj1 commented on code in PR #7159: URL: https://github.com/apache/hudi/pull/7159#discussion_r1046731112 ## hudi-hadoop-mr/src/test/java/org/apache/hudi/hadoop/realtime/TestHoodieRealtimeRecordReader.java: ## @@ -141,6 +141,7 @@ private void setHiveColumnNameProps(List

[GitHub] [hudi] hudi-bot commented on pull request #7345: [HUDI-3378] RFC46 rebase

2022-12-12 Thread GitBox
hudi-bot commented on PR #7345: URL: https://github.com/apache/hudi/pull/7345#issuecomment-1347828520 ## CI report: * e5f1dba84479f08417f25f53a79f6dae4425ba23 UNKNOWN * 29e31dd516112fa9a38463a9fedccb423db589cb Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7345: [HUDI-3378] RFC46 rebase

2022-12-12 Thread GitBox
hudi-bot commented on PR #7345: URL: https://github.com/apache/hudi/pull/7345#issuecomment-1347824795 ## CI report: * e5f1dba84479f08417f25f53a79f6dae4425ba23 UNKNOWN * f559ebdc000ac712c15ce2d7b1f6fda3302dfabf Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7345: [HUDI-3378] RFC46 rebase

2022-12-12 Thread GitBox
hudi-bot commented on PR #7345: URL: https://github.com/apache/hudi/pull/7345#issuecomment-1347821193 ## CI report: * e5f1dba84479f08417f25f53a79f6dae4425ba23 UNKNOWN * f559ebdc000ac712c15ce2d7b1f6fda3302dfabf Azure:

svn commit: r58689 - /dev/hudi/KEYS

2022-12-12 Thread sivabalan
Author: sivabalan Date: Tue Dec 13 06:46:05 2022 New Revision: 58689 Log: Adding satish's gpg keys Modified: dev/hudi/KEYS Modified: dev/hudi/KEYS == --- dev/hudi/KEYS (original) +++ dev/hudi/KEYS Tue Dec 13

[GitHub] [hudi] hudi-bot commented on pull request #7394: [HUDI-5262] Allow hoodie.datasource.write.keygenerator.class to be used in spark-sql create table

2022-12-12 Thread GitBox
hudi-bot commented on PR #7394: URL: https://github.com/apache/hudi/pull/7394#issuecomment-1347817544 ## CI report: * 43a31c8ce9849f487e521c1c9b467dd4eada6331 UNKNOWN * 6d3d125caa257a3b290ae286dd77499a39683750 Azure:

[hudi] branch asf-site updated: [DOCS] Update community sync schedule and fix broken links (#7442)

2022-12-12 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 226ff1ffd1f [DOCS] Update community sync

[GitHub] [hudi] xushiyan merged pull request #7442: [DOCS] Update community sync schedule and fix broken links

2022-12-12 Thread GitBox
xushiyan merged PR #7442: URL: https://github.com/apache/hudi/pull/7442 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] zhuanshenbsj1 commented on a diff in pull request #7159: [HUDI-5173]Skip if there is only one file in clusteringGroup

2022-12-12 Thread GitBox
zhuanshenbsj1 commented on code in PR #7159: URL: https://github.com/apache/hudi/pull/7159#discussion_r1046699321 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/cdc/TestCDCDataFrameSuite.scala: ## @@ -118,6 +118,7 @@ class TestCDCDataFrameSuite

[GitHub] [hudi] zhuanshenbsj1 commented on a diff in pull request #7159: [HUDI-5173]Skip if there is only one file in clusteringGroup

2022-12-12 Thread GitBox
zhuanshenbsj1 commented on code in PR #7159: URL: https://github.com/apache/hudi/pull/7159#discussion_r1046698488 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/cdc/TestCDCDataFrameSuite.scala: ## @@ -118,6 +118,7 @@ class TestCDCDataFrameSuite

[GitHub] [hudi] bhasudha opened a new pull request, #7442: [DOCS] Update community sync schedule and fix broken links

2022-12-12 Thread GitBox
bhasudha opened a new pull request, #7442: URL: https://github.com/apache/hudi/pull/7442 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any

[GitHub] [hudi] hudi-bot commented on pull request #7440: [HUDI-5377] Add call stack information to lock file

2022-12-12 Thread GitBox
hudi-bot commented on PR #7440: URL: https://github.com/apache/hudi/pull/7440#issuecomment-1347769648 ## CI report: * 67e64ca0d35342d303f5c0027db72ec4c14f1890 UNKNOWN * 3ae5c2f76e605c9674d216cb87279bb662f07e2f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7438: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

2022-12-12 Thread GitBox
hudi-bot commented on PR #7438: URL: https://github.com/apache/hudi/pull/7438#issuecomment-1347769625 ## CI report: * 5c821f53d8eef00588491421dd751e3bb04866fb Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7437: [HUDI-5366] Closing metadata writer from within writeClient

2022-12-12 Thread GitBox
hudi-bot commented on PR #7437: URL: https://github.com/apache/hudi/pull/7437#issuecomment-1347769590 ## CI report: * 7aae826c0ffc9be3dbb72e48a38c5a595d2fe4bb Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7423: [MINOR] Adding optimization rule to appropriately push down filters into the `HoodieFileIndex`

2022-12-12 Thread GitBox
hudi-bot commented on PR #7423: URL: https://github.com/apache/hudi/pull/7423#issuecomment-1347769543 ## CI report: * c6623fc8d2a5c5eb71181bc5c458bfdbc976d15a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7440: [HUDI-5377] Add call stack information to lock file

2022-12-12 Thread GitBox
hudi-bot commented on PR #7440: URL: https://github.com/apache/hudi/pull/7440#issuecomment-1347766446 ## CI report: * 67e64ca0d35342d303f5c0027db72ec4c14f1890 UNKNOWN * 3ae5c2f76e605c9674d216cb87279bb662f07e2f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7441: [HUDI-5378] Remove minlog.Log

2022-12-12 Thread GitBox
hudi-bot commented on PR #7441: URL: https://github.com/apache/hudi/pull/7441#issuecomment-1347766468 ## CI report: * 4aceef648f1ec5513df5283945f2ba3e42733ae4 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7438: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

2022-12-12 Thread GitBox
hudi-bot commented on PR #7438: URL: https://github.com/apache/hudi/pull/7438#issuecomment-1347766413 ## CI report: * baa62578663a77cc37725533fad04e4b75a47e1a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7437: [HUDI-5366] Closing metadata writer from within writeClient

2022-12-12 Thread GitBox
hudi-bot commented on PR #7437: URL: https://github.com/apache/hudi/pull/7437#issuecomment-1347766367 ## CI report: * 7aae826c0ffc9be3dbb72e48a38c5a595d2fe4bb Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7423: [MINOR] Adding optimization rule to appropriately push down filters into the `HoodieFileIndex`

2022-12-12 Thread GitBox
hudi-bot commented on PR #7423: URL: https://github.com/apache/hudi/pull/7423#issuecomment-1347766281 ## CI report: * c6623fc8d2a5c5eb71181bc5c458bfdbc976d15a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7383: [HUDI-4432] Checkpoint management for muti-writer scenario

2022-12-12 Thread GitBox
hudi-bot commented on PR #7383: URL: https://github.com/apache/hudi/pull/7383#issuecomment-1347766161 ## CI report: * bcb09ed13fc86a7b68219384161ed0c6a8ee8556 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7383: [HUDI-4432] Checkpoint management for muti-writer scenario

2022-12-12 Thread GitBox
hudi-bot commented on PR #7383: URL: https://github.com/apache/hudi/pull/7383#issuecomment-1347762210 ## CI report: * bcb09ed13fc86a7b68219384161ed0c6a8ee8556 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7355: [HUDI-5308] [testing]Hive3 query returns null when the where clause has a partition field

2022-12-12 Thread GitBox
hudi-bot commented on PR #7355: URL: https://github.com/apache/hudi/pull/7355#issuecomment-1347762103 ## CI report: * be82fc49989f5262d833fb2b803fd6ea69af8d0c Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7441: [HUDI-5378] Remove minlog.Log

2022-12-12 Thread GitBox
hudi-bot commented on PR #7441: URL: https://github.com/apache/hudi/pull/7441#issuecomment-1347762441 ## CI report: * 4aceef648f1ec5513df5283945f2ba3e42733ae4 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7366: [HUDI-5318] Fix partition pruning for clustering scheduling

2022-12-12 Thread GitBox
hudi-bot commented on PR #7366: URL: https://github.com/apache/hudi/pull/7366#issuecomment-1347762156 ## CI report: * 3f6572349834d904a697fbd8c8546f56a7f2844a Azure:

[hudi] branch master updated: [HUDI-5351] Handle populateMetaFields when repartitioning in sort partitioner (#7411)

2022-12-12 Thread codope
This is an automated email from the ASF dual-hosted git repository. codope pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new ae426bc483f [HUDI-5351] Handle populateMetaFields

[GitHub] [hudi] codope merged pull request #7411: [HUDI-5351] Handle populateMetaFields when repartitioning in sort partitioner

2022-12-12 Thread GitBox
codope merged PR #7411: URL: https://github.com/apache/hudi/pull/7411 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] codope commented on pull request #7411: [HUDI-5351] Handle populateMetaFields when repartitioning in sort partitioner

2022-12-12 Thread GitBox
codope commented on PR #7411: URL: https://github.com/apache/hudi/pull/7411#issuecomment-1347745239 https://user-images.githubusercontent.com/16440354/207229581-83e9c594-b690-44a9-8894-2df6791ae683.png;> CI succeeded for the latest commit. -- This is an automated message from

[GitHub] [hudi] danny0405 commented on a diff in pull request #7397: [HUDI-5205] Upgrade Flink to 1.16.0

2022-12-12 Thread GitBox
danny0405 commented on code in PR #7397: URL: https://github.com/apache/hudi/pull/7397#discussion_r1046653338 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java: ## @@ -291,19 +291,19 @@ public void

[hudi] branch master updated (5beadbfbe54 -> ef721d0af7d)

2022-12-12 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 5beadbfbe54 [HUDI-5373] Different fileids are assigned to the same bucket (#7433) add ef721d0af7d

[GitHub] [hudi] nsivabalan merged pull request #6793: [HUDI-4917] Optimized the way to get HoodieBaseFile of loadColumnRangesFromFiles of Bloom Index

2022-12-12 Thread GitBox
nsivabalan merged PR #6793: URL: https://github.com/apache/hudi/pull/6793 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] nsivabalan commented on pull request #7438: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

2022-12-12 Thread GitBox
nsivabalan commented on PR #7438: URL: https://github.com/apache/hudi/pull/7438#issuecomment-1347735635 @danny0405 : no issues from querying standpoint. might have some perf hit, but no correctness or failures. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] hudi-bot commented on pull request #7440: [HUDI-5377] Add call stack information to lock file

2022-12-12 Thread GitBox
hudi-bot commented on PR #7440: URL: https://github.com/apache/hudi/pull/7440#issuecomment-1347720835 ## CI report: * 67e64ca0d35342d303f5c0027db72ec4c14f1890 UNKNOWN * 3ae5c2f76e605c9674d216cb87279bb662f07e2f Azure:

[jira] [Updated] (HUDI-5378) Remove minlog.Log

2022-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5378: - Labels: pull-request-available (was: ) > Remove minlog.Log > - > >

[GitHub] [hudi] cxzl25 opened a new pull request, #7441: [HUDI-5378] Remove minlog.Log

2022-12-12 Thread GitBox
cxzl25 opened a new pull request, #7441: URL: https://github.com/apache/hudi/pull/7441 ### Change Logs Remove minlog.Log ### Impact Use the correct log4j configuration ### Risk level (write none, low medium or high below) ### Documentation Update

[GitHub] [hudi] hudi-bot commented on pull request #7440: [HUDI-5377] Add call stack information to lock file

2022-12-12 Thread GitBox
hudi-bot commented on PR #7440: URL: https://github.com/apache/hudi/pull/7440#issuecomment-1347713314 ## CI report: * 67e64ca0d35342d303f5c0027db72ec4c14f1890 UNKNOWN * 3ae5c2f76e605c9674d216cb87279bb662f07e2f UNKNOWN Bot commands @hudi-bot supports the

[GitHub] [hudi] hudi-bot commented on pull request #7438: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

2022-12-12 Thread GitBox
hudi-bot commented on PR #7438: URL: https://github.com/apache/hudi/pull/7438#issuecomment-1347713244 ## CI report: * baa62578663a77cc37725533fad04e4b75a47e1a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7394: [HUDI-5262] Allow hoodie.datasource.write.keygenerator.class to be used in spark-sql create table

2022-12-12 Thread GitBox
hudi-bot commented on PR #7394: URL: https://github.com/apache/hudi/pull/7394#issuecomment-1347712770 ## CI report: * 43a31c8ce9849f487e521c1c9b467dd4eada6331 UNKNOWN * bbe54597ed63dcf9eb94b84cdd4f80d45c49634f Azure:

[jira] [Created] (HUDI-5378) Remove minlog.Log

2022-12-12 Thread dzcxzl (Jira)
dzcxzl created HUDI-5378: Summary: Remove minlog.Log Key: HUDI-5378 URL: https://issues.apache.org/jira/browse/HUDI-5378 Project: Apache Hudi Issue Type: Improvement Reporter: dzcxzl

[GitHub] [hudi] hudi-bot commented on pull request #7440: [HUDI-5377] Add call stack information to lock file

2022-12-12 Thread GitBox
hudi-bot commented on PR #7440: URL: https://github.com/apache/hudi/pull/7440#issuecomment-1347708193 ## CI report: * 67e64ca0d35342d303f5c0027db72ec4c14f1890 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7438: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

2022-12-12 Thread GitBox
hudi-bot commented on PR #7438: URL: https://github.com/apache/hudi/pull/7438#issuecomment-1347708169 ## CI report: * baa62578663a77cc37725533fad04e4b75a47e1a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7394: [HUDI-5262] Allow hoodie.datasource.write.keygenerator.class to be used in spark-sql create table

2022-12-12 Thread GitBox
hudi-bot commented on PR #7394: URL: https://github.com/apache/hudi/pull/7394#issuecomment-1347708063 ## CI report: * bb40c512b05286e266eb5b05e2f31b9ea926 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7394: [HUDI-5262] Allow hoodie.datasource.write.keygenerator.class to be used in spark-sql create table

2022-12-12 Thread GitBox
hudi-bot commented on PR #7394: URL: https://github.com/apache/hudi/pull/7394#issuecomment-1347704997 ## CI report: * bb40c512b05286e266eb5b05e2f31b9ea926 Azure:

[jira] [Updated] (HUDI-5377) Add call stack information to lock file

2022-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5377: - Labels: pull-request-available (was: ) > Add call stack information to lock file >

[GitHub] [hudi] LinMingQiang opened a new pull request, #7440: [HUDI-5377] Add call stack information to lock file

2022-12-12 Thread GitBox
LinMingQiang opened a new pull request, #7440: URL: https://github.com/apache/hudi/pull/7440 ### Change Logs Add call stack information to lock file. ### Impact When Occ is enabled, Sometimes an exception is thrown 'Unable to acquire lock', We need to know which step

[GitHub] [hudi] zhuanshenbsj1 commented on a diff in pull request #7159: [HUDI-5173]Skip if there is only one file in clusteringGroup

2022-12-12 Thread GitBox
zhuanshenbsj1 commented on code in PR #7159: URL: https://github.com/apache/hudi/pull/7159#discussion_r1046629024 ## hudi-hadoop-mr/src/test/java/org/apache/hudi/hadoop/realtime/TestHoodieRealtimeRecordReader.java: ## @@ -141,6 +141,7 @@ private void setHiveColumnNameProps(List

[jira] [Assigned] (HUDI-5377) Add call stack information to lock file

2022-12-12 Thread HunterXHunter (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HunterXHunter reassigned HUDI-5377: --- Assignee: HunterXHunter > Add call stack information to lock file >

[GitHub] [hudi] codope commented on a diff in pull request #7437: [HUDI-5366] Closing metadata writer from within writeClient

2022-12-12 Thread GitBox
codope commented on code in PR #7437: URL: https://github.com/apache/hudi/pull/7437#discussion_r1046622218 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java: ## @@ -752,6 +752,7 @@ public void

[jira] [Updated] (HUDI-5377) Add call stack information to lock file

2022-12-12 Thread HunterXHunter (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HunterXHunter updated HUDI-5377: Description: When Occ is enabled, Sometimes an exception is thrown 'Unable  to acquire lock', We

[GitHub] [hudi] danny0405 commented on a diff in pull request #7437: [HUDI-5366] Closing metadata writer from within writeClient

2022-12-12 Thread GitBox
danny0405 commented on code in PR #7437: URL: https://github.com/apache/hudi/pull/7437#discussion_r1046617576 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java: ## @@ -1125,6 +1130,14 @@ private HoodieData

[GitHub] [hudi] danny0405 commented on a diff in pull request #7437: [HUDI-5366] Closing metadata writer from within writeClient

2022-12-12 Thread GitBox
danny0405 commented on code in PR #7437: URL: https://github.com/apache/hudi/pull/7437#discussion_r1046617209 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java: ## @@ -752,6 +752,7 @@ public void

[jira] [Created] (HUDI-5377) Add call stack information to lock file

2022-12-12 Thread HunterXHunter (Jira)
HunterXHunter created HUDI-5377: --- Summary: Add call stack information to lock file Key: HUDI-5377 URL: https://issues.apache.org/jira/browse/HUDI-5377 Project: Apache Hudi Issue Type:

[GitHub] [hudi] danny0405 commented on pull request #7438: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

2022-12-12 Thread GitBox
danny0405 commented on PR #7438: URL: https://github.com/apache/hudi/pull/7438#issuecomment-1347672319 Thanks for the fix, what is the affect without this fix, the user can not query the latest result set if the file index is cached ? -- This is an automated message from the Apache Git

[GitHub] [hudi] danny0405 commented on issue #6260: [SUPPORT]Caused by: java.util.NoSuchElementException: No value present in Option

2022-12-12 Thread GitBox
danny0405 commented on issue #6260: URL: https://github.com/apache/hudi/issues/6260#issuecomment-1347668956 Take a look at this PR: https://github.com/apache/hudi/pull/6766 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] danny0405 commented on a diff in pull request #7159: [HUDI-5173]Skip if there is only one file in clusteringGroup

2022-12-12 Thread GitBox
danny0405 commented on code in PR #7159: URL: https://github.com/apache/hudi/pull/7159#discussion_r1046605266 ## hudi-hadoop-mr/src/test/java/org/apache/hudi/hadoop/realtime/TestHoodieRealtimeRecordReader.java: ## @@ -141,6 +141,7 @@ private void setHiveColumnNameProps(List

[GitHub] [hudi] hudi-bot commented on pull request #7394: [HUDI-5262] Allow hoodie.datasource.write.keygenerator.class to be used in spark-sql create table

2022-12-12 Thread GitBox
hudi-bot commented on PR #7394: URL: https://github.com/apache/hudi/pull/7394#issuecomment-1347667491 ## CI report: * bb40c512b05286e266eb5b05e2f31b9ea926 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7366: [HUDI-5318] Fix partition pruning for clustering scheduling

2022-12-12 Thread GitBox
hudi-bot commented on PR #7366: URL: https://github.com/apache/hudi/pull/7366#issuecomment-1347667416 ## CI report: * 419d479d3469507566ad7d856f41ffb2182d7765 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7355: [HUDI-5308] [testing]Hive3 query returns null when the where clause has a partition field

2022-12-12 Thread GitBox
hudi-bot commented on PR #7355: URL: https://github.com/apache/hudi/pull/7355#issuecomment-1347667377 ## CI report: * 34c111a0fe150fe513fea39697976da06a912f5c Azure:

[jira] [Commented] (HUDI-5373) Different fileids are assigned to the same bucket

2022-12-12 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17646400#comment-17646400 ] Danny Chen commented on HUDI-5373: -- Fixed via master branch: 5beadbfbe544e513ae2391e534a0ad8443566e9a >

[jira] [Resolved] (HUDI-5373) Different fileids are assigned to the same bucket

2022-12-12 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-5373. -- > Different fileids are assigned to the same bucket > -- >

[jira] [Updated] (HUDI-5373) Different fileids are assigned to the same bucket

2022-12-12 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-5373: - Fix Version/s: 0.12.2 0.13.0 > Different fileids are assigned to the same bucket >

[hudi] branch master updated (13a8e5c7297 -> 5beadbfbe54)

2022-12-12 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 13a8e5c7297 [HUDI-5348] Cache file slices in HoodieBackedTableMetadata (#7436) add 5beadbfbe54 [HUDI-5373]

[GitHub] [hudi] danny0405 merged pull request #7433: [HUDI-5373] Different fileids are assigned to the same bucket

2022-12-12 Thread GitBox
danny0405 merged PR #7433: URL: https://github.com/apache/hudi/pull/7433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #7394: [HUDI-5262] Allow hoodie.datasource.write.keygenerator.class to be used in spark-sql create table

2022-12-12 Thread GitBox
hudi-bot commented on PR #7394: URL: https://github.com/apache/hudi/pull/7394#issuecomment-1347663548 ## CI report: * 17a887b98e0dd10d71a596ea87382911f3fdcef7 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7366: [HUDI-5318] Fix partition pruning for clustering scheduling

2022-12-12 Thread GitBox
hudi-bot commented on PR #7366: URL: https://github.com/apache/hudi/pull/7366#issuecomment-1347663469 ## CI report: * 419d479d3469507566ad7d856f41ffb2182d7765 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7355: [HUDI-5308] [testing]Hive3 query returns null when the where clause has a partition field

2022-12-12 Thread GitBox
hudi-bot commented on PR #7355: URL: https://github.com/apache/hudi/pull/7355#issuecomment-1347663412 ## CI report: * 34c111a0fe150fe513fea39697976da06a912f5c Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7438: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

2022-12-12 Thread GitBox
hudi-bot commented on PR #7438: URL: https://github.com/apache/hudi/pull/7438#issuecomment-1347660023 ## CI report: * baa62578663a77cc37725533fad04e4b75a47e1a Azure:

[GitHub] [hudi] aizain commented on issue #7375: [SUPPORT] Hudi 0.12.1 support for Spark Structured Streaming. read clustering metadata replace avro file error. Unrecognized token 'Obj^A^B^Vavro'

2022-12-12 Thread GitBox
aizain commented on issue #7375: URL: https://github.com/apache/hudi/issues/7375#issuecomment-1347658226 thanks~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] danny0405 commented on a diff in pull request #7175: [HUDI-5191] Fix compatibility with avro 1.10

2022-12-12 Thread GitBox
danny0405 commented on code in PR #7175: URL: https://github.com/apache/hudi/pull/7175#discussion_r1046588788 ## .github/workflows/bot.yml: ## @@ -73,6 +73,14 @@ jobs: run: | HUDI_VERSION=$(mvn help:evaluate -Dexpression=project.version -q -DforceStdout)

[GitHub] [hudi] danny0405 commented on issue #6588: [SUPPORT]Caused by: java.lang.ClassNotFoundException: org.apache.hudi.org.apache.avro.util.Utf8

2022-12-12 Thread GitBox
danny0405 commented on issue #6588: URL: https://github.com/apache/hudi/issues/6588#issuecomment-1347638244 @xushiyan Did you know the background that the spark-bundle does not include avro as a dependency ? -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] loukey-lj commented on pull request #7433: [HUDI-5373] Different fileids are assigned to the same bucket

2022-12-12 Thread GitBox
loukey-lj commented on PR #7433: URL: https://github.com/apache/hudi/pull/7433#issuecomment-1347636220 @danny0405 Please review the code for me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] danny0405 commented on issue #6588: [SUPPORT]Caused by: java.lang.ClassNotFoundException: org.apache.hudi.org.apache.avro.util.Utf8

2022-12-12 Thread GitBox
danny0405 commented on issue #6588: URL: https://github.com/apache/hudi/issues/6588#issuecomment-1347633205 It seems you did not shade the avro correctly for your spark bundle jar -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] danny0405 commented on a diff in pull request #7394: [HUDI-5262] Allow hoodie.datasource.write.keygenerator.class to be used in spark-sql create table

2022-12-12 Thread GitBox
danny0405 commented on code in PR #7394: URL: https://github.com/apache/hudi/pull/7394#discussion_r1046580467 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/catalyst/catalog/HoodieCatalogTable.scala: ## @@ -245,6 +245,10 @@ class

[GitHub] [hudi] daihw commented on issue #6588: [SUPPORT]Caused by: java.lang.ClassNotFoundException: org.apache.hudi.org.apache.avro.util.Utf8

2022-12-12 Thread GitBox
daihw commented on issue #6588: URL: https://github.com/apache/hudi/issues/6588#issuecomment-1347627637 > I solved this problem by adding the following configuration in Packaging/Hudi-spark-bundle/pom.xml > > ``` > ... > org.apache.avro:avro > ... > ... > >

[GitHub] [hudi] hudi-bot commented on pull request #7394: [HUDI-5262] Allow hoodie.datasource.write.keygenerator.class to be used in spark-sql create table

2022-12-12 Thread GitBox
hudi-bot commented on PR #7394: URL: https://github.com/apache/hudi/pull/7394#issuecomment-1347605174 ## CI report: * 17a887b98e0dd10d71a596ea87382911f3fdcef7 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7411: [HUDI-5351] Handle populateMetaFields when repartitioning in sort partitioner

2022-12-12 Thread GitBox
hudi-bot commented on PR #7411: URL: https://github.com/apache/hudi/pull/7411#issuecomment-1347600350 ## CI report: * a2739c7a7cc5f6ebd38a4b1c4be46a7a652f1d38 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7437: [HUDI-5366] Closing metadata writer from within writeClient

2022-12-12 Thread GitBox
hudi-bot commented on PR #7437: URL: https://github.com/apache/hudi/pull/7437#issuecomment-1347600547 ## CI report: * 7aae826c0ffc9be3dbb72e48a38c5a595d2fe4bb Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7394: [HUDI-5262] Allow hoodie.datasource.write.keygenerator.class to be used in spark-sql create table

2022-12-12 Thread GitBox
hudi-bot commented on PR #7394: URL: https://github.com/apache/hudi/pull/7394#issuecomment-1347600245 ## CI report: * 17a887b98e0dd10d71a596ea87382911f3fdcef7 Azure:

[hudi] branch master updated: [HUDI-5348] Cache file slices in HoodieBackedTableMetadata (#7436)

2022-12-12 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 13a8e5c7297 [HUDI-5348] Cache file slices in

[GitHub] [hudi] nsivabalan merged pull request #7436: [HUDI-5348] Cache file slices in HoodieBackedTableMetadata

2022-12-12 Thread GitBox
nsivabalan merged PR #7436: URL: https://github.com/apache/hudi/pull/7436 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7436: [HUDI-5348] Cache file slices in HoodieBackedTableMetadata

2022-12-12 Thread GitBox
nsivabalan commented on code in PR #7436: URL: https://github.com/apache/hudi/pull/7436#discussion_r1046561322 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadata.java: ## @@ -379,7 +386,8 @@ private HoodieRecord composeRecord(GenericRecord avroReco

[GitHub] [hudi] jonvex commented on issue #7351: [SUPPORT] The keygenerator.class value set when using SparkSQL to create a table does not finally take effect in hoodie.properties

2022-12-12 Thread GitBox
jonvex commented on issue #7351: URL: https://github.com/apache/hudi/issues/7351#issuecomment-1347568412 PR's are ready for review and then we can close this out -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7035: [HUDI-5075] Adding support to rollback residual clustering after disabling clustering

2022-12-12 Thread GitBox
nsivabalan commented on code in PR #7035: URL: https://github.com/apache/hudi/pull/7035#discussion_r1046543459 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java: ## @@ -588,6 +588,19 @@ protected void

[jira] [Updated] (HUDI-5376) Update quickstart guide for hudi hoodie.datasource.write.keygenerator.class spark-sql change

2022-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5376: - Labels: pull-request-available (was: ) > Update quickstart guide for hudi

[GitHub] [hudi] jonvex opened a new pull request, #7439: [HUDI-5376] Remove incorrect spark-sql keygen info from quickstart guide

2022-12-12 Thread GitBox
jonvex opened a new pull request, #7439: URL: https://github.com/apache/hudi/pull/7439 ### Change Logs since 0.11.1 keygen logic in spark-sql is the same as everywhere else but the quickstart guide was never updated. ### Impact Documentation is correct now. ###

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7436: [HUDI-5348] Cache file slices in HoodieBackedTableMetadata

2022-12-12 Thread GitBox
nsivabalan commented on code in PR #7436: URL: https://github.com/apache/hudi/pull/7436#discussion_r1046539085 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadata.java: ## @@ -379,7 +386,8 @@ private HoodieRecord composeRecord(GenericRecord avroReco

[jira] [Created] (HUDI-5376) Update quickstart guide for hudi hoodie.datasource.write.keygenerator.class spark-sql change

2022-12-12 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-5376: - Summary: Update quickstart guide for hudi hoodie.datasource.write.keygenerator.class spark-sql change Key: HUDI-5376 URL: https://issues.apache.org/jira/browse/HUDI-5376

[jira] [Updated] (HUDI-5262) When creating table in spark-sql setting wrong keygenerator config does not warn

2022-12-12 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-5262: -- Status: Patch Available (was: In Progress) > When creating table in spark-sql setting wrong

[jira] [Updated] (HUDI-5262) When creating table in spark-sql setting wrong keygenerator config does not warn

2022-12-12 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-5262: -- Status: In Progress (was: Open) > When creating table in spark-sql setting wrong keygenerator

[jira] [Assigned] (HUDI-5262) When creating table in spark-sql setting wrong keygenerator config does not warn

2022-12-12 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-5262: - Assignee: Jonathan Vexler > When creating table in spark-sql setting wrong keygenerator

[GitHub] [hudi] hudi-bot commented on pull request #7438: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

2022-12-12 Thread GitBox
hudi-bot commented on PR #7438: URL: https://github.com/apache/hudi/pull/7438#issuecomment-1347535112 ## CI report: * baa62578663a77cc37725533fad04e4b75a47e1a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7436: [HUDI-5348] Cache file slices in HoodieBackedTableMetadata

2022-12-12 Thread GitBox
hudi-bot commented on PR #7436: URL: https://github.com/apache/hudi/pull/7436#issuecomment-1347513477 ## CI report: * 96b2aff47666ae63124f1a7601167388b501fe1b Azure:

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7175: [HUDI-5191] Fix compatibility with avro 1.10

2022-12-12 Thread GitBox
alexeykudinkin commented on code in PR #7175: URL: https://github.com/apache/hudi/pull/7175#discussion_r1046493214 ## .github/workflows/bot.yml: ## @@ -73,6 +73,14 @@ jobs: run: | HUDI_VERSION=$(mvn help:evaluate -Dexpression=project.version -q

[GitHub] [hudi] hudi-bot commented on pull request #7438: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

2022-12-12 Thread GitBox
hudi-bot commented on PR #7438: URL: https://github.com/apache/hudi/pull/7438#issuecomment-1347432717 ## CI report: * baa62578663a77cc37725533fad04e4b75a47e1a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7437: [HUDI-5366] Closing metadata writer from within writeClient

2022-12-12 Thread GitBox
hudi-bot commented on PR #7437: URL: https://github.com/apache/hudi/pull/7437#issuecomment-1347432690 ## CI report: * 7aae826c0ffc9be3dbb72e48a38c5a595d2fe4bb Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7437: [HUDI-5366] Closing metadata writer from within writeClient

2022-12-12 Thread GitBox
hudi-bot commented on PR #7437: URL: https://github.com/apache/hudi/pull/7437#issuecomment-1347427053 ## CI report: * 7aae826c0ffc9be3dbb72e48a38c5a595d2fe4bb UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

  1   2   3   >