Re: [PR] [HUDI-7710] Remove `compaction.inflight` from conflict resolution [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11148: URL: https://github.com/apache/hudi/pull/11148#issuecomment-2094024555 ## CI report: * 82ace4ec10ccae4108bed6f67674390f905eee7f Azure:

Re: [PR] [HUDI-7710] Remove `compaction.inflight` from conflict resolution [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11148: URL: https://github.com/apache/hudi/pull/11148#issuecomment-2094020901 ## CI report: * 82ace4ec10ccae4108bed6f67674390f905eee7f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[jira] [Updated] (HUDI-7710) BugFix: Remove compaction.inflight from conflict resolution

2024-05-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7710: - Labels: pull-request-available (was: ) > BugFix: Remove compaction.inflight from conflict

[PR] [HUDI-7710] Remove `compaction.inflight` from conflict resolution [hudi]

2024-05-03 Thread via GitHub
linliu-code opened a new pull request, #11148: URL: https://github.com/apache/hudi/pull/11148 ### Change Logs We filter it from `SimpleConcurrentFileWritesConflictResolutionStrategy` class. ### Impact Fix a buggy process. ### Risk level (write none, low medium or

[jira] [Created] (HUDI-7710) BugFix: Remove compaction.inflight from conflict resolution

2024-05-03 Thread Lin Liu (Jira)
Lin Liu created HUDI-7710: - Summary: BugFix: Remove compaction.inflight from conflict resolution Key: HUDI-7710 URL: https://issues.apache.org/jira/browse/HUDI-7710 Project: Apache Hudi Issue Type:

(hudi-rs) branch main updated: ci: setup ci for license file and headers (#2)

2024-05-03 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/hudi-rs.git The following commit(s) were added to refs/heads/main by this push: new bd4e51f ci: setup ci for license file and

[jira] [Closed] (HUDI-7576) Avoid recomputing partition path in AbstractFileSystemView

2024-05-03 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-7576. Reviewers: Danny Chen Resolution: Fixed Fixed via master branch:

(hudi) branch master updated: [HUDI-7576] Improve efficiency of getRelativePartitionPath, reduce computation of partitionPath in AbstractTableFileSystemView (#11001)

2024-05-03 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 8911aa2d3c7 [HUDI-7576] Improve efficiency of

Re: [PR] [HUDI-7576] Improve efficiency of getRelativePartitionPath, reduce computation of partitionPath in AbstractTableFileSystemView [hudi]

2024-05-03 Thread via GitHub
danny0405 merged PR #11001: URL: https://github.com/apache/hudi/pull/11001 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(hudi-rs) branch main updated: feat: initial rust implementation to integrate with datafusion (#1)

2024-05-03 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/hudi-rs.git The following commit(s) were added to refs/heads/main by this push: new 0236839 feat: initial rust implementation to

(hudi-rs) branch main created (now 44845ec)

2024-05-03 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/hudi-rs.git at 44845ec first commit This branch includes the following new commits: new 44845ec first commit The 1

(hudi-rs) 01/01: first commit

2024-05-03 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/hudi-rs.git commit 44845eccd7b6d852f357bb3ce3f4baf70d16fbd8 Author: Shiyan Xu AuthorDate: Fri May 3 15:56:17 2024 -0500 first commit

Re: [PR] [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport [hudi]

2024-05-03 Thread via GitHub
yihua closed pull request #11145: [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport URL: https://github.com/apache/hudi/pull/11145 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport [hudi]

2024-05-03 Thread via GitHub
yihua commented on PR #11145: URL: https://github.com/apache/hudi/pull/11145#issuecomment-2093676794 Closing this testing-only PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport [hudi]

2024-05-03 Thread via GitHub
yihua commented on PR #11145: URL: https://github.com/apache/hudi/pull/11145#issuecomment-2093645802 All tests pass in CI. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11145: URL: https://github.com/apache/hudi/pull/11145#issuecomment-2093615888 ## CI report: * faa874d80c82027265eaf6ef8e8d3e25084c7ab3 UNKNOWN * 7d6e2ddd19284d0f299cd72c052f9b25e788dcbf Azure:

Re: [PR] [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11145: URL: https://github.com/apache/hudi/pull/11145#issuecomment-2093606707 ## CI report: * de25156a48ef35b211b71121225754a267806e79 Azure:

Re: [PR] [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11145: URL: https://github.com/apache/hudi/pull/11145#issuecomment-2093532967 ## CI report: * de25156a48ef35b211b71121225754a267806e79 Azure:

Re: [PR] [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11145: URL: https://github.com/apache/hudi/pull/11145#issuecomment-2093522407 ## CI report: * de25156a48ef35b211b71121225754a267806e79 Azure:

(hudi) branch release-0.14.1-spark35-scala213 updated (faa874d80c8 -> 7d6e2ddd192)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git from faa874d80c8 Always use built jars for bundle validation add 7d6e2ddd192 [HUDI-7475]

Re: [PR] [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11145: URL: https://github.com/apache/hudi/pull/11145#issuecomment-2093512578 ## CI report: * de25156a48ef35b211b71121225754a267806e79 Azure:

Re: [PR] [HUDI-7146] Implement secondary index creation [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11129: URL: https://github.com/apache/hudi/pull/11129#issuecomment-2093512470 ## CI report: * f39d566fd99b405c4c7b34f2e1c2d5056b9a6d27 Azure:

(hudi) branch release-0.14.1-spark35-scala213 updated (1673e650d74 -> faa874d80c8)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git discard 1673e650d74 Always use built jars for bundle validation add faa874d80c8 Always use built

(hudi) branch release-0.14.1-spark35-scala213 updated (de25156a48e -> 1673e650d74)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git from de25156a48e [HUDI-7513] Add jackson-module-scala to spark bundle (#10877) add 1673e650d74

Re: [PR] [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11145: URL: https://github.com/apache/hudi/pull/11145#issuecomment-2093451238 ## CI report: * de25156a48ef35b211b71121225754a267806e79 Azure:

Re: [PR] [HUDI-7146] Implement secondary index creation [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11129: URL: https://github.com/apache/hudi/pull/11129#issuecomment-2093451065 ## CI report: * 0274004b842a332f57c1104de44e4e262ff2942d Azure:

Re: [PR] [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11145: URL: https://github.com/apache/hudi/pull/11145#issuecomment-2093437235 ## CI report: * de25156a48ef35b211b71121225754a267806e79 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7146] Implement secondary index creation [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11129: URL: https://github.com/apache/hudi/pull/11129#issuecomment-2093437096 ## CI report: * 0274004b842a332f57c1104de44e4e262ff2942d Azure:

[jira] [Updated] (HUDI-7146) Implement secondary index

2024-05-03 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7146: -- Status: Patch Available (was: In Progress) > Implement secondary index > - > >

Re: [PR] [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport [hudi]

2024-05-03 Thread via GitHub
yihua commented on PR #11145: URL: https://github.com/apache/hudi/pull/11145#issuecomment-2093397546 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [HUDI-7146][WIP] Implement secondary index update and delete [hudi]

2024-05-03 Thread via GitHub
codope opened a new pull request, #11146: URL: https://github.com/apache/hudi/pull/11146 ### Change Logs This PR is stacked on https://github.com/apache/hudi/pull/11077 and https://github.com/apache/hudi/pull/11129 ### Impact Support secondary index update and delete

[PR] [MINOR][TESTING][DO NOT MERGE] Release 0.14.1 with Spark 3.5 and Scala 2.13 suppport [hudi]

2024-05-03 Thread via GitHub
yihua opened a new pull request, #11145: URL: https://github.com/apache/hudi/pull/11145 ### Change Logs Testing only. ### Impact none ### Risk level none ### Documentation Update none ### Contributor's checklist - [ ] Read

(hudi) 02/03: Upgrade version to 0.14.1-1

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 060a9aaab9406154f55733583125faa99be24176 Author: Y Ethan Guo AuthorDate: Fri May 3 08:05:04 2024

(hudi) 01/03: Revert "[HUDI-7001] ComplexAvroKeyGenerator should represent single record key as the value string without composing the key field name (#9936)"

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 1d385cab2c08b5f86c3ae18417ebb115645f3f74 Author: Y Ethan Guo AuthorDate: Fri May 3 08:03:22 2024

(hudi) branch release-0.14.1-spark35-scala213 updated (0f783f1a66f -> de25156a48e)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git from 0f783f1a66f [HUDI-6868] Support extracting passwords from credential store for Hive Sync

(hudi) 03/03: [HUDI-7513] Add jackson-module-scala to spark bundle (#10877)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit de25156a48ef35b211b71121225754a267806e79 Author: Manu <36392121+x...@users.noreply.github.com>

Re: [PR] [HUDI-7576] Improve efficiency of getRelativePartitionPath, reduce computation of partitionPath in AbstractTableFileSystemView [hudi]

2024-05-03 Thread via GitHub
the-other-tim-brown commented on PR #11001: URL: https://github.com/apache/hudi/pull/11001#issuecomment-2093274714 @danny0405 can you take another look when you get a chance? I have updated a few spots in the code -- This is an automated message from the Apache Git Service. To respond to

[jira] [Closed] (HUDI-6110) Hudi DOAP file error

2024-05-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-6110. Fix Version/s: (was: 0.15.0) Resolution: Not A Problem > Hudi DOAP file error >

Re: [PR] [HUDI-7576] Improve efficiency of getRelativePartitionPath, reduce computation of partitionPath in AbstractTableFileSystemView [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11001: URL: https://github.com/apache/hudi/pull/11001#issuecomment-2093221282 ## CI report: * 22f01c9e071a9f92747f4af966c9f63056c7216d UNKNOWN * dd662ffe2c332f7744093d3099ab2c085974ec3e Azure:

Re: [PR] [HUDI-7652] Add new `HoodieMergeKey` API to support simple and composite keys [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11077: URL: https://github.com/apache/hudi/pull/11077#issuecomment-2093206172 ## CI report: * 1c75aafef62c6d5ce9d6204d29ba00c8fc0460d1 Azure:

(hudi) 06/40: [HUDI-6092] Set the timeout for the forked JVM (#10496)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit e534a86d1ec9ae9d6109020bc43bcc063cb162b5 Author: Lin Liu

(hudi) 34/40: [MINOR] Publish test results from the containerized job to Azure (#10818)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 4b1dcbac07ece54a29005136fb1c780cbf3217f5 Author: Y Ethan Guo AuthorDate: Wed Mar 6 11:07:36 2024

(hudi) 18/40: [MINOR] Disable hdfs for hudi-utilities tests (#10663)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit d57db9dd32df337b181edfcfdf3041297fb5f28b Author: Lin Liu

(hudi) 35/40: [HUDI-7473] Rebalance CI (#10805)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 3bfeb7d8457f2ed61b3e851e9fa661e2ba6ad21f Author: Y Ethan Guo AuthorDate: Fri May 3 02:38:29 2024

(hudi) 10/40: [HUDI-6902] Shutdown metric hooks properly (#10520)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 0fe615a0fd0385906612d291bd9231c839abb702 Author: Lin Liu

(hudi) 30/40: [HUDI-7465] Split tests in CI further to reduce total CI elapsed time (#10795)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit d4be3c0add5692e6561ec042829c532e02970f9a Author: Y Ethan Guo AuthorDate: Sat Mar 2 13:59:58 2024

(hudi) 21/40: [MINOR] Recontainerize 4th module (#10720)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 200dc704474277254c2416db653f34f9f252cf97 Author: Lin Liu

(hudi) 27/40: [HUDI-7438] Fix workflow condition for issue_comment events (#10749)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit e4a810957ca0cf20f7083e02f476bed458c3a789 Author: Y Ethan Guo AuthorDate: Sat Feb 24 21:53:56 2024

(hudi) 15/40: [HUDI-7375] Disable a flaky test method (#10627)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit b0b83a2e9253246b09263e992db52f011138a37e Author: Lin Liu

(hudi) 36/40: [HUDI-7694] Unify bijection-avro dependency version (#11132)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit ca1c4005a39bc76915347067394d9ae4ecfc1001 Author: Y Ethan Guo AuthorDate: Tue Apr 30 18:35:02 2024

(hudi) 26/40: [HUDI-7438] Improve the filtering of PRs and pagination in scheduled workflow (#10747)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 61939468979144e83700085dcb984dca964f6d53 Author: Y Ethan Guo AuthorDate: Sat Feb 24 21:53:39 2024

(hudi) 22/40: [MINOR] Move release candidate validation to a separate GitHub action (#10729)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 347093eab82af2b9dc54baae57ee86cc73455b2b Author: Y Ethan Guo AuthorDate: Thu Feb 22 17:00:41 2024

(hudi) 24/40: [HUDI-7438] Add write permission of commit statuses in Azure CI check (#10745)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 4739bf2444afdf68736dfb09ca8c2b9bed9a0058 Author: Y Ethan Guo AuthorDate: Sat Feb 24 10:55:32 2024

(hudi) 39/40: [HUDI-7362] Fix hudi partition base path scheme to s3 (#10596)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 68eee6111d3adaf16e99ec090a25ee920e5f1cb0 Author: Nicolas Paris AuthorDate: Thu Feb 15 16:55:27

(hudi) 25/40: [HUDI-7438] Reimplement Azure CI report check with open PRs (#10746)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit f3a6e9092e887e6e41e5d015f2da1f98e73e3d49 Author: Y Ethan Guo AuthorDate: Sat Feb 24 20:00:27 2024

(hudi) 03/40: [MINOR] Turning on publishing of test results to Azure Devops (#10477)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 2fc01e29cc223f9d2baba667a37bd0e4b8e96359 Author: vinoth chandar AuthorDate: Thu Jan 11 10:38:31

(hudi) 16/40: [HUDI-6902] Containerize the Azure CI (#10512)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 2a5fd3cf999de19c4e15518e0657d4f4deb2e00a Author: Lin Liu

(hudi) 40/40: [HUDI-6868] Support extracting passwords from credential store for Hive Sync (#10577)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 0f783f1a66fb2a0650901a354cdfd829b8f1f0d5 Author: Aditya Goenka

(hudi) 11/40: [MINOR] Reduce UT spark-datasource test times (#10547)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 8b62b63bbca33255e3ceb87b49b680f06af7d750 Author: vinoth chandar AuthorDate: Tue Jan 23 10:24:29

(hudi) 32/40: [HUDI-7471] Use existing util method to get Spark conf in tests (#10802)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit b85f72f6d8eebc5f8a16a7bf36774650c6b8b191 Author: Y Ethan Guo AuthorDate: Sun Mar 3 22:09:12 2024

(hudi) 19/40: [MINOR] Fix zookeeper session expiration bug (#10671)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 8aebd827d2614cb8d874ce29d77bb7764fb31dab Author: Lin Liu

(hudi) 37/40: [HUDI-7702] Remove unused method in ReflectUtil (#11135)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit af38c325f6495a468542dd8627f06cf094f7a480 Author: Y Ethan Guo AuthorDate: Wed May 1 22:21:00 2024

(hudi) 29/40: [HUDI-7463] Bump Spark 3.5 version to Spark 3.5.1 (#10788)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 0ef0faf21ee0aafc41b166c1ddd94e8148de7448 Author: Shawn Chang

(hudi) 33/40: [MINOR] Fix Azure publishing of JUnit results (#10817)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit db71a79cc4cb24080508b4b63aefa18b8550d5b8 Author: Y Ethan Guo AuthorDate: Tue Mar 5 22:13:31 2024

(hudi) 31/40: [HUDI-7469] Reduce redundant tests with Hudi record types (#10800)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit e65cd7d1c4bd4f803e72bf11f9bd3d4a0c4a4be2 Author: Y Ethan Guo AuthorDate: Sat Mar 2 21:56:54 2024

(hudi) 28/40: [HUDI-7438] Fix issue number fetch in Azure CI check (#10751)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 80a69b899539d435cef4494abcda036b4de55a9b Author: Y Ethan Guo AuthorDate: Sun Feb 25 09:10:32 2024

(hudi) 23/40: [HUDI-7438] Add GitHub action to check Azure CI report (#10731)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit bf83e7ce74c89413618b6fffdb4662dea4289dac Author: Y Ethan Guo AuthorDate: Thu Feb 22 21:44:14 2024

(hudi) 20/40: [HUDI-6902] Release resources safely (#10688)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit c3d350d881afe3808f73a72019dc84b6301b0238 Author: Lin Liu

(hudi) 13/40: [HUDI-6902] Fix a test about timestamp format (#10606)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 432dc470c7117d9c3fe8fdc1c396befe238c1f9c Author: Lin Liu

(hudi) 12/40: [HUDI-6902] Disable a flaky test (#10551)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 9697864efda8b5e1f35967beef322681422d6c51 Author: Lin Liu

(hudi) 04/40: [HUDI-6902] Use mvnw command for hadoo-mr test (#10474)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 8d83e393f7a13599e96114d6d41476bd9d49fa0a Author: Lin Liu

(hudi) 14/40: [Hudi-6902] Fix the timestamp format in hive test (#10610)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit b25e9ffcfbaf0a54840758269fb6c746848f3107 Author: Lin Liu

(hudi) 17/40: [MINOR] Disable Containers the Azure CI (#10662)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 5676a8fb87a4337f9d8c5fb34a1e2946b83240ff Author: Lin Liu

(hudi) 07/40: [MINOR] Clean default Hadoop configuration values in tests (#10495)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 0063da8b0562edcf77216be2a193fae3e9fba496 Author: Lin Liu

(hudi) 05/40: [HUDI-6902] Give minimum memory for unit tests (#10469)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 585552db1c42e06373adfce04db0b892ab878fe1 Author: Lin Liu

(hudi) 08/40: [HUDI-7296] Reduce CI Time by Minimizing Duplicate Code Coverage in Tests (#10492)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 415c0660a25ac0951901579d8f2e64c1c44a8603 Author: Jon Vexler AuthorDate: Wed Jan 17 16:17:19 2024

(hudi) 09/40: [HUDI-6902] Fix a unit test (#10513)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit ca264aad783584103649ba91e22993fad8d57a0c Author: Lin Liu

(hudi) 02/40: [HUDI-7113] Update release scripts and docs for Spark 3.5 support (#10123)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 36e53ca5be155c9419a237392a305ea0e87879af Author: Y Ethan Guo AuthorDate: Fri Nov 17 11:20:57 2023

(hudi) branch release-0.14.1-spark35-scala213 created (now 0f783f1a66f)

2024-05-03 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch release-0.14.1-spark35-scala213 in repository https://gitbox.apache.org/repos/asf/hudi.git at 0f783f1a66f [HUDI-6868] Support extracting passwords from credential store for Hive Sync

Re: [PR] [HUDI-7652] Add new `HoodieMergeKey` API to support simple and composite keys [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11077: URL: https://github.com/apache/hudi/pull/11077#issuecomment-2093123901 ## CI report: * d3106b9f36566b322d3c8a5b401cce88b9ca1382 Azure:

Re: [PR] [HUDI-7576] Improve efficiency of getRelativePartitionPath, reduce computation of partitionPath in AbstractTableFileSystemView [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11001: URL: https://github.com/apache/hudi/pull/11001#issuecomment-2093123543 ## CI report: * 22f01c9e071a9f92747f4af966c9f63056c7216d UNKNOWN * b0a72b4e20ebaa87727b44642d5d11f5f78021bf Azure:

Re: [PR] [HUDI-7652] Add new `HoodieMergeKey` API to support simple and composite keys [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11077: URL: https://github.com/apache/hudi/pull/11077#issuecomment-2093110081 ## CI report: * d3106b9f36566b322d3c8a5b401cce88b9ca1382 Azure:

Re: [PR] [HUDI-7576] Improve efficiency of getRelativePartitionPath, reduce computation of partitionPath in AbstractTableFileSystemView [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11001: URL: https://github.com/apache/hudi/pull/11001#issuecomment-2093109712 ## CI report: * 22f01c9e071a9f92747f4af966c9f63056c7216d UNKNOWN * b0a72b4e20ebaa87727b44642d5d11f5f78021bf Azure:

[I] [SUPPORT] Error using the property hoodie.datasource.write.drop.partition.columns [hudi]

2024-05-03 Thread via GitHub
jamb2024 opened a new issue, #11144: URL: https://github.com/apache/hudi/issues/11144 Hi. I am developing a process to ingest data from my hdfs using Hudi. I want to partition the data using a custom keygenerator class where the partition key will be a tuple columnName@NumPartitions.

(hudi) branch master updated: [MINOR] Fix flaky test testMetadataRollbackWithCompaction (#11143)

2024-05-03 Thread codope
This is an automated email from the ASF dual-hosted git repository. codope pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 5e2290e260a [MINOR] Fix flaky test

Re: [PR] [MINOR] Fix flaky test testMetadataRollbackWithCompaction [hudi]

2024-05-03 Thread via GitHub
codope merged PR #11143: URL: https://github.com/apache/hudi/pull/11143 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [MINOR] Fix flaky test testMetadataRollbackWithCompaction [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11143: URL: https://github.com/apache/hudi/pull/11143#issuecomment-2092712916 ## CI report: * 749b387a810b2aff79a4fa8317ed7281a6a50b98 Azure:

[jira] [Resolved] (HUDI-6110) Hudi DOAP file error

2024-05-03 Thread Claude Warren (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Claude Warren resolved HUDI-6110. - > Hudi DOAP file error > > > Key: HUDI-6110 >

[jira] [Commented] (HUDI-6110) Hudi DOAP file error

2024-05-03 Thread Claude Warren (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843179#comment-17843179 ] Claude Warren commented on HUDI-6110: - [~xushiyan] I have rerun the code that attempts to import this

Re: [PR] [MINOR] Fix flaky test testMetadataRollbackWithCompaction [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11143: URL: https://github.com/apache/hudi/pull/11143#issuecomment-2092619411 ## CI report: * 749b387a810b2aff79a4fa8317ed7281a6a50b98 Azure:

Re: [PR] [MINOR] Fix flaky test testMetadataRollbackWithCompaction [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11143: URL: https://github.com/apache/hudi/pull/11143#issuecomment-2092608225 ## CI report: * 749b387a810b2aff79a4fa8317ed7281a6a50b98 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [I] [SUPPORT] ClassCastException when reading a Hudi dataset with a timestamp partition field [hudi]

2024-05-03 Thread via GitHub
ad1happy2go commented on issue #11140: URL: https://github.com/apache/hudi/issues/11140#issuecomment-2092586965 Thanks for raising this @harichandanp . I was able to reproduce the issue and it looks like a valid bug. Created jira for tracking the fix -

[jira] [Created] (HUDI-7709) Class Cast Exception while reading the data using TimestampBasedKeyGenerator

2024-05-03 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7709: --- Summary: Class Cast Exception while reading the data using TimestampBasedKeyGenerator Key: HUDI-7709 URL: https://issues.apache.org/jira/browse/HUDI-7709 Project:

[PR] [MINOR] Fix flaky test testMetadataRollbackWithCompaction [hudi]

2024-05-03 Thread via GitHub
danny0405 opened a new pull request, #11143: URL: https://github.com/apache/hudi/pull/11143 ### Change Logs We better use the completion time to compare the instant sequence. ### Impact none ### Risk level (write none, low medium or high below) none

[jira] [Closed] (HUDI-7362) Athena does not support s3a partition scheme anymore leading to missing data

2024-05-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-7362. Resolution: Fixed > Athena does not support s3a partition scheme anymore leading to missing data >

[jira] [Assigned] (HUDI-7362) Athena does not support s3a partition scheme anymore leading to missing data

2024-05-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-7362: Assignee: nicolas paris > Athena does not support s3a partition scheme anymore leading to missing

[jira] [Updated] (HUDI-7362) Athena does not support s3a partition scheme anymore leading to missing data

2024-05-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-7362: - Priority: Blocker (was: Major) > Athena does not support s3a partition scheme anymore leading to

[jira] [Updated] (HUDI-7362) Athena does not support s3a partition scheme anymore leading to missing data

2024-05-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-7362: - Fix Version/s: 0.15.0 > Athena does not support s3a partition scheme anymore leading to missing data >

Re: [PR] [HUDI-7652] Add new `HoodieMergeKey` API to support simple and composite keys [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11077: URL: https://github.com/apache/hudi/pull/11077#issuecomment-2092505635 ## CI report: * d3106b9f36566b322d3c8a5b401cce88b9ca1382 Azure:

Re: [PR] [HUDI-7652] Add new `HoodieMergeKey` API to support simple and composite keys [hudi]

2024-05-03 Thread via GitHub
hudi-bot commented on PR #11077: URL: https://github.com/apache/hudi/pull/11077#issuecomment-2092443509 ## CI report: * 7ee2125aa1fa318c177a689282996d510a75ac52 Azure:

  1   2   >