Re: [PR] [HUDI-7710] Use compaction.requested during conflict resolution [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11151: URL: https://github.com/apache/hudi/pull/11151#issuecomment-2094637684 ## CI report: * c68b630ed8b878dffc4df1f1074d6fa3987899d9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[PR] [HUDI-7710] Replace compaction.inflight during conflict resolution [hudi]

2024-05-04 Thread via GitHub
linliu-code opened a new pull request, #11151: URL: https://github.com/apache/hudi/pull/11151 ### Change Logs During conflict resolution between an ingestion writer and compaction, if the compaction is in `inflight` state, original logic tries to extract the compaction plan from

Re: [PR] [HUDI-7701] Metadata table initailization with pending instants [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11137: URL: https://github.com/apache/hudi/pull/11137#issuecomment-2094573804 ## CI report: * adc1380cb496881fd2f1c8b30aa059759c7c5c9c Azure:

Re: [PR] [HUDI-7701] Metadata table initailization with pending instants [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11137: URL: https://github.com/apache/hudi/pull/11137#issuecomment-2094535016 ## CI report: * a668de4b47df64e2d09b8c1bd0a172271c41a7e3 Azure:

Re: [PR] [HUDI-7701] Metadata table initailization with pending instants [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11137: URL: https://github.com/apache/hudi/pull/11137#issuecomment-2094533717 ## CI report: * a668de4b47df64e2d09b8c1bd0a172271c41a7e3 Azure:

Re: [PR] [MINOR] Use parent as the glob path when full file path specified [hudi]

2024-05-04 Thread via GitHub
the-other-tim-brown commented on code in PR #11150: URL: https://github.com/apache/hudi/pull/11150#discussion_r1590187272 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/clustering/run/strategy/MultipleSparkJobExecutionStrategy.java: ## @@ -457,9 +457,10

Re: [PR] [MINOR] Use parent as the glob path when full file path specified [hudi]

2024-05-04 Thread via GitHub
danny0405 commented on code in PR #11150: URL: https://github.com/apache/hudi/pull/11150#discussion_r1590186996 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/clustering/run/strategy/MultipleSparkJobExecutionStrategy.java: ## @@ -457,9 +457,10 @@ private

Re: [PR] [HUDI-7710] Remove compaction.inflight from conflict resolution [hudi]

2024-05-04 Thread via GitHub
danny0405 commented on code in PR #11148: URL: https://github.com/apache/hudi/pull/11148#discussion_r1590186936 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/SimpleConcurrentFileWritesConflictResolutionStrategy.java: ## @@ -68,6 +69,7 @@

Re: [PR] update fork count [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11107: URL: https://github.com/apache/hudi/pull/11107#issuecomment-2094397899 ## CI report: * 48122188bc0ee8f85d1d14aee3d5c320f2fb7b29 Azure:

Re: [PR] [MINOR] Use parent as the glob path when full file path specified [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11150: URL: https://github.com/apache/hudi/pull/11150#issuecomment-2094365713 ## CI report: * 353708c54b454bf3749596f74267970f1c332b7b Azure:

Re: [PR] update fork count [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11107: URL: https://github.com/apache/hudi/pull/11107#issuecomment-2094354296 ## CI report: * 9757330d1ed3ff1afb3bc1b08b0f3ece78917045 Azure:

Re: [PR] update fork count [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11107: URL: https://github.com/apache/hudi/pull/11107#issuecomment-2094352389 ## CI report: * 9757330d1ed3ff1afb3bc1b08b0f3ece78917045 Azure:

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2094350107 ## CI report: * 4d3fc1c3ff0254f545803f93ed361e448245ffaa Azure:

Re: [PR] [HUDI-7710] Remove compaction.inflight from conflict resolution [hudi]

2024-05-04 Thread via GitHub
yihua commented on code in PR #11148: URL: https://github.com/apache/hudi/pull/11148#discussion_r1590072865 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/SimpleConcurrentFileWritesConflictResolutionStrategy.java: ## @@ -68,6 +69,7 @@ public

Re: [PR] [MINOR] Use parent as the glob path when full file path specified [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11150: URL: https://github.com/apache/hudi/pull/11150#issuecomment-2094339138 ## CI report: * 11abd3eb1b9418d9013f820e3779f56c50810dfd Azure:

Re: [PR] [MINOR] Use parent as the glob path when full file path specified [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11150: URL: https://github.com/apache/hudi/pull/11150#issuecomment-2094337137 ## CI report: * 11abd3eb1b9418d9013f820e3779f56c50810dfd Azure:

Re: [PR] [MINOR] Use parent as the glob path when full file path specified [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11150: URL: https://github.com/apache/hudi/pull/11150#issuecomment-2094335218 ## CI report: * 11abd3eb1b9418d9013f820e3779f56c50810dfd Azure:

Re: [PR] [HUDI-7711] Fix MultiTableStreamer can deal with path of properties files [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11149: URL: https://github.com/apache/hudi/pull/11149#issuecomment-2094335208 ## CI report: * bb03750d5e951785c6205f501d463614cc3315cf Azure:

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2094335199 ## CI report: * 7bb8334732cdbdd3cba9868ea66c2c0817559981 Azure:

Re: [PR] [MINOR] Use parent as the glob path when full file path specified [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11150: URL: https://github.com/apache/hudi/pull/11150#issuecomment-2094313377 ## CI report: * 11abd3eb1b9418d9013f820e3779f56c50810dfd Azure:

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2094313307 ## CI report: * 7bb8334732cdbdd3cba9868ea66c2c0817559981 Azure:

Re: [PR] [MINOR] Use parent as the glob path when full file path specified [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11150: URL: https://github.com/apache/hudi/pull/11150#issuecomment-2094309158 ## CI report: * 11abd3eb1b9418d9013f820e3779f56c50810dfd UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7711] Fix MultiTableStreamer can deal with path of properties files [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11149: URL: https://github.com/apache/hudi/pull/11149#issuecomment-2094305741 ## CI report: * bb03750d5e951785c6205f501d463614cc3315cf Azure:

[PR] [MINOR] Use parent as the glob path when full file path specified [hudi]

2024-05-04 Thread via GitHub
the-other-tim-brown opened a new pull request, #11150: URL: https://github.com/apache/hudi/pull/11150 ### Change Logs - Fix usages of the glob paths to take in partition level paths instead of file level paths in clustering and metadata writing ### Impact - Fixes a bug

Re: [PR] [HUDI-7711] Fix MultiTableStreamer can deal with path of properties files [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11149: URL: https://github.com/apache/hudi/pull/11149#issuecomment-2094288851 ## CI report: * bb03750d5e951785c6205f501d463614cc3315cf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[jira] [Updated] (HUDI-7711) Fix MultiTableStreamer can deal with path of properties file for each streamer

2024-05-04 Thread Jihwan Lee (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihwan Lee updated HUDI-7711: - Description: HudiMultiTableStreamer initializes common configs, then deepcopy related fields into each

[PR] [HUDI-7711] Fix MultiTableStreamer can deal with path of properties files [hudi]

2024-05-04 Thread via GitHub
hwani3142 opened a new pull request, #11149: URL: https://github.com/apache/hudi/pull/11149 ### Change Logs fix copy logic on MultiTableStreamer ### Impact HoodieMultiTableStreamer ### Risk level (write none, low medium or high below) low ###

[jira] [Updated] (HUDI-7711) Fix MultiTableStreamer can deal with path of properties file for each streamer

2024-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7711: - Labels: pull-request-available (was: ) > Fix MultiTableStreamer can deal with path of properties

[jira] [Created] (HUDI-7711) Fix MultiTableStreamer can deal with path of properties file for each streamer

2024-05-04 Thread Jihwan Lee (Jira)
Jihwan Lee created HUDI-7711: Summary: Fix MultiTableStreamer can deal with path of properties file for each streamer Key: HUDI-7711 URL: https://issues.apache.org/jira/browse/HUDI-7711 Project: Apache

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2094105336 ## CI report: * 7bb8334732cdbdd3cba9868ea66c2c0817559981 Azure:

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2094089132 ## CI report: * fd5383cabb77ad3afc075ee1545e65c7e0613855 Azure:

[jira] [Closed] (HUDI-7710) BugFix: Remove compaction.inflight from conflict resolution

2024-05-04 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu closed HUDI-7710. - Resolution: Fixed > BugFix: Remove compaction.inflight from conflict resolution >

Re: [PR] [HUDI-7652] Add new `HoodieMergeKey` API to support simple and composite keys [hudi]

2024-05-04 Thread via GitHub
danny0405 commented on code in PR #11077: URL: https://github.com/apache/hudi/pull/11077#discussion_r1589929342 ## hudi-common/src/main/java/org/apache/hudi/common/model/HoodieSimpleMergeKey.java: ## @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] [HUDI-7652] Add new `HoodieMergeKey` API to support simple and composite keys [hudi]

2024-05-04 Thread via GitHub
danny0405 commented on code in PR #11077: URL: https://github.com/apache/hudi/pull/11077#discussion_r1589929165 ## hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java: ## @@ -81,7 +83,7 @@ public class HoodieMergedLogRecordScanner

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2094076123 ## CI report: * fd5383cabb77ad3afc075ee1545e65c7e0613855 Azure:

(hudi) branch master updated (8911aa2d3c7 -> 1c7f8376ade)

2024-05-04 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 8911aa2d3c7 [HUDI-7576] Improve efficiency of getRelativePartitionPath, reduce computation of partitionPath in

Re: [PR] [HUDI-7710] Remove `compaction.inflight` from conflict resolution [hudi]

2024-05-04 Thread via GitHub
danny0405 merged PR #11148: URL: https://github.com/apache/hudi/pull/11148 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7710] Remove `compaction.inflight` from conflict resolution [hudi]

2024-05-04 Thread via GitHub
danny0405 commented on code in PR #11148: URL: https://github.com/apache/hudi/pull/11148#discussion_r1589927822 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/SimpleConcurrentFileWritesConflictResolutionStrategy.java: ## @@ -68,6 +69,7 @@

Re: [PR] [HUDI-7710] Remove `compaction.inflight` from conflict resolution [hudi]

2024-05-04 Thread via GitHub
hudi-bot commented on PR #11148: URL: https://github.com/apache/hudi/pull/11148#issuecomment-2094072154 ## CI report: * 82ace4ec10ccae4108bed6f67674390f905eee7f Azure:

(hudi-rs) branch main updated: ci: fix failing check and test case (#10)

2024-05-04 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/hudi-rs.git The following commit(s) were added to refs/heads/main by this push: new 82c1dce ci: fix failing check and test case