Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10909: URL: https://github.com/apache/hudi/pull/10909#issuecomment-2092181639 ## CI report: * 78efc7ca1cc033e445086b925cae48204d214871 Azure:

Re: [PR] [HUDI-7508] Avoid collecting records in HoodieStreamerUtils.createHoodieRecords and JsonKafkaSource mapPartitions [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10872: URL: https://github.com/apache/hudi/pull/10872#issuecomment-2092180728 ## CI report: * ac7713c64afa1d2406463c8563a065362c95ecda Azure:

Re: [PR] [HUDI-7701] Metadata table initailization with pending instants [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11137: URL: https://github.com/apache/hudi/pull/11137#issuecomment-2092096715 ## CI report: * fe7584c435e0ba03e9176cf5e7cc331d9a0052d7 Azure:

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2092096740 ## CI report: * fd5383cabb77ad3afc075ee1545e65c7e0613855 Azure:

Re: [PR] [HUDI-7701] Metadata table initailization with pending instants [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11137: URL: https://github.com/apache/hudi/pull/11137#issuecomment-2092086614 ## CI report: * fe7584c435e0ba03e9176cf5e7cc331d9a0052d7 Azure:

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2092079871 ## CI report: * 14896f28dc869895f9f7897354e2807c52140607 Azure:

Re: [PR] [HUDI-7523] Add HOODIE_SPARK_DATASOURCE_OPTIONS to be used in HoodieIncrSource [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10900: URL: https://github.com/apache/hudi/pull/10900#issuecomment-2092079595 ## CI report: * 5fefa9e02c016d50b2f2b1fda2c9c89f2df7d620 Azure:

(hudi) branch master updated: [HUDI-7686] Add tests on the util methods for type cast of configuration instances (#11121)

2024-05-02 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new feb82e61a06 [HUDI-7686] Add tests on the util

Re: [PR] [HUDI-7686] Add tests on the util methods for type cast of configuration instances [hudi]

2024-05-02 Thread via GitHub
yihua merged PR #11121: URL: https://github.com/apache/hudi/pull/11121 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
ksoullpwk commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2092071157 Do we have a plan to apply the Scala 2.13 support for older Spark versions? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Updated] (HUDI-7708) Support cleaning archived commits

2024-05-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-7708: - Description: currently archived commits in 0.x can take up a lot storage space and users are not sure if

[jira] [Created] (HUDI-7708) Support cleaning archived commits

2024-05-02 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-7708: Summary: Support cleaning archived commits Key: HUDI-7708 URL: https://issues.apache.org/jira/browse/HUDI-7708 Project: Apache Hudi Issue Type: Improvement

Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10909: URL: https://github.com/apache/hudi/pull/10909#issuecomment-2092056966 ## CI report: * b5ebcf8de8abc367918e5ab570be4bcd52b33208 Azure:

Re: [PR] [HUDI-7523] Add HOODIE_SPARK_DATASOURCE_OPTIONS to be used in HoodieIncrSource [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10900: URL: https://github.com/apache/hudi/pull/10900#issuecomment-2092056931 ## CI report: * 6800d009ebd79b21a6134aab7db352ab5d5d1ae3 Azure:

Re: [PR] [HUDI-7508] Avoid collecting records in HoodieStreamerUtils.createHoodieRecords and JsonKafkaSource mapPartitions [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10872: URL: https://github.com/apache/hudi/pull/10872#issuecomment-2092056890 ## CI report: * 629e91bc0267c0728b98326eb84072965c600205 Azure:

Re: [PR] [HUDI-7429] Fixing average record size estimation for delta commits [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10763: URL: https://github.com/apache/hudi/pull/10763#issuecomment-2092056831 ## CI report: * 34711f0b4fd724a5a6631b4fdacd90acebe53ca1 Azure:

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2092052949 ## CI report: * d6d48bad055f3f2b41a974f69031a49013c7175a Azure:

Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10909: URL: https://github.com/apache/hudi/pull/10909#issuecomment-2092052645 ## CI report: * b5ebcf8de8abc367918e5ab570be4bcd52b33208 Azure:

Re: [PR] [HUDI-7523] Add HOODIE_SPARK_DATASOURCE_OPTIONS to be used in HoodieIncrSource [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10900: URL: https://github.com/apache/hudi/pull/10900#issuecomment-2092052606 ## CI report: * 6800d009ebd79b21a6134aab7db352ab5d5d1ae3 Azure:

Re: [PR] [HUDI-7429] Fixing average record size estimation for delta commits [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10763: URL: https://github.com/apache/hudi/pull/10763#issuecomment-2092052479 ## CI report: * 95411f507afa43c6e5bf95e8bf1f87bbc03beb49 Azure:

Re: [PR] [HUDI-7508] Avoid collecting records in HoodieStreamerUtils.createHoodieRecords and JsonKafkaSource mapPartitions [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10872: URL: https://github.com/apache/hudi/pull/10872#issuecomment-2092052549 ## CI report: * 629e91bc0267c0728b98326eb84072965c600205 Azure:

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2092049159 ## CI report: * d6d48bad055f3f2b41a974f69031a49013c7175a Azure:

Re: [PR] [HUDI-7686] Add tests on the util methods for type cast of configuration instances [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11121: URL: https://github.com/apache/hudi/pull/11121#issuecomment-2092049104 ## CI report: * 9ebc7b514587fec7a1d2b9ca559d9cf655dbb6b0 Azure:

Re: [PR] [HUDI-7532] Include only compaction instants for lastCompaction in getDeltaCommitsSinceLatestCompaction [hudi]

2024-05-02 Thread via GitHub
yihua commented on PR #10915: URL: https://github.com/apache/hudi/pull/10915#issuecomment-2092034933 @nsivabalan could you rebase the PR on the latest master and address the review comments? -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [HUDI-7501] Use source profile for S3 and GCS sources [hudi]

2024-05-02 Thread via GitHub
yihua commented on PR #10861: URL: https://github.com/apache/hudi/pull/10861#issuecomment-2092032092 @vinishjail97 could you rebase this PR on the latest master? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2092027530 ## CI report: * d6d48bad055f3f2b41a974f69031a49013c7175a Azure:

[jira] [Updated] (HUDI-7704) Unify test client storage classes with duplicate code

2024-05-02 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7704: Status: In Progress (was: Open) > Unify test client storage classes with duplicate code >

[jira] [Resolved] (HUDI-7540) Check for gaps on storing inserts on log files

2024-05-02 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-7540. -- > Check for gaps on storing inserts on log files > -- >

[jira] [Updated] (HUDI-7234) Handle both inserts and updates in log blocks for partial updates

2024-05-02 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-7234: - Description: Inserts can be written to log blocks, e.g., Flink.  We need to handle such case for

[jira] [Closed] (HUDI-7540) Check for gaps on storing inserts on log files

2024-05-02 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-7540. Resolution: Invalid > Check for gaps on storing inserts on log files >

[jira] [Updated] (HUDI-7229) Enable partial updates for CDC work payload

2024-05-02 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-7229: - Description: OLTP workloads on upstream databases, often update/delete/insert different columns

[jira] [Commented] (HUDI-7229) Enable partial updates for CDC work payload

2024-05-02 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843110#comment-17843110 ] Vinoth Chandar commented on HUDI-7229: -- Punting this to 1.1  # [1.1] Implement support on top of

Re: [PR] [MINOR] remove unnecessary lines from java test [hudi]

2024-05-02 Thread via GitHub
danny0405 merged PR #11139: URL: https://github.com/apache/hudi/pull/11139 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(hudi) branch master updated: [MINOR] remove unnecessary lines from java test (#11139)

2024-05-02 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a0ea78fdd8d [MINOR] remove unnecessary lines

[jira] [Updated] (HUDI-7229) Enable partial updates for CDC work payload

2024-05-02 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-7229: - Fix Version/s: 1.1.0 (was: 1.0.0) > Enable partial updates for CDC work

(hudi) branch master updated (3930119544d -> aff11ac2c2f)

2024-05-02 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 3930119544d [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration (#11130) add aff11ac2c2f [HUDI-7688]

Re: [PR] [HUDI-7688] Stop retry inflate if encounter InterruptedIOException [hudi]

2024-05-02 Thread via GitHub
danny0405 merged PR #11125: URL: https://github.com/apache/hudi/pull/11125 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2092023164 ## CI report: * d6d48bad055f3f2b41a974f69031a49013c7175a Azure:

Re: [PR] [HUDI-7429] Fixing average record size estimation for delta commits [hudi]

2024-05-02 Thread via GitHub
yihua commented on code in PR #10763: URL: https://github.com/apache/hudi/pull/10763#discussion_r1588601099 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/AverageRecordSizeUtils.java: ## @@ -0,0 +1,90 @@ +/* + * Licensed to the Apache

[jira] [Commented] (HUDI-7671) Make Hudi timeline backward compatible

2024-05-02 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843109#comment-17843109 ] Vinoth Chandar commented on HUDI-7671: -- balaji - this may be a dupe.  > Make Hudi timeline backward

[jira] [Updated] (HUDI-7671) Make Hudi timeline backward compatible

2024-05-02 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-7671: - Epic Link: HUDI-6242 > Make Hudi timeline backward compatible >

[jira] [Assigned] (HUDI-7671) Make Hudi timeline backward compatible

2024-05-02 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-7671: Assignee: Balaji Varadarajan (was: Danny Chen) > Make Hudi timeline backward compatible >

[jira] [Updated] (HUDI-7678) Finalize the Merger APIs and make a plan for moving over all existing built-in, custom payloads.

2024-05-02 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-7678: - Description: With the move towards making partial updates a first class citizen, that does not

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2091995502 ## CI report: * d6d48bad055f3f2b41a974f69031a49013c7175a Azure:

Re: [PR] [HUDI-7686] Add tests on the util methods for type cast of configuration instances [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11121: URL: https://github.com/apache/hudi/pull/11121#issuecomment-2091995443 ## CI report: * 6ada8df1f7a64c852ea031b634a160b2db92850b Azure:

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
yihua merged PR #11130: URL: https://github.com/apache/hudi/pull/11130 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11142: URL: https://github.com/apache/hudi/pull/11142#issuecomment-2091987890 ## CI report: * d6d48bad055f3f2b41a974f69031a49013c7175a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091987760 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * 9a2450a1bb4454ddc2c86791ce112201f431627a UNKNOWN *

Re: [PR] [HUDI-7686] Add tests on the util methods for type cast of configuration instances [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11121: URL: https://github.com/apache/hudi/pull/11121#issuecomment-2091987642 ## CI report: * 6ada8df1f7a64c852ea031b634a160b2db92850b Azure:

[jira] [Updated] (HUDI-7707) Enable bundle validation on Java 8 and 11

2024-05-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7707: - Labels: pull-request-available (was: ) > Enable bundle validation on Java 8 and 11 >

[PR] [HUDI-7707] Enable bundle validation on Java 8 and 11 [hudi]

2024-05-02 Thread via GitHub
yihua opened a new pull request, #11142: URL: https://github.com/apache/hudi/pull/11142 ### Change Logs Bundle validation with Java 8 and 11 are somehow skipped in GH CI. This PR reenables them by fixing the `bot.yml`. ### Impact Improves bundle validation coverage.

[jira] [Updated] (HUDI-7707) Enable bundle validation on Java 8 and 11

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7707: Status: Patch Available (was: In Progress) > Enable bundle validation on Java 8 and 11 >

[jira] [Updated] (HUDI-7707) Enable bundle validation on Java 8 and 11

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7707: Story Points: 0 > Enable bundle validation on Java 8 and 11 > - > >

[jira] [Updated] (HUDI-7702) Remove unused method in ReflectUtil

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7702: Story Points: 0.5 > Remove unused method in ReflectUtil > --- > >

[jira] [Updated] (HUDI-7707) Enable bundle validation on Java 8 and 11

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7707: Status: In Progress (was: Open) > Enable bundle validation on Java 8 and 11 >

[jira] [Closed] (HUDI-7702) Remove unused method in ReflectUtil

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7702. --- Resolution: Fixed > Remove unused method in ReflectUtil > --- > >

[jira] [Updated] (HUDI-7707) Enable bundle validation on Java 8 and 11

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7707: Story Points: 0.5 (was: 0) > Enable bundle validation on Java 8 and 11 >

[jira] [Closed] (HUDI-7706) Improve validation in PARTITION_STATS index test

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7706. --- Resolution: Fixed > Improve validation in PARTITION_STATS index test >

[jira] [Updated] (HUDI-7707) Enable bundle validation on Java 8 and 11

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7707: Sprint: Sprint 2023-04-26 > Enable bundle validation on Java 8 and 11 >

[jira] [Updated] (HUDI-7707) Enable bundle validation on Java 8 and 11

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7707: Description: Bundle validation with Java 8 and 11 are somehow skipped in GH CI.  They should be enabled.

[jira] [Updated] (HUDI-7707) Enable bundle validation on Java 8 and 11

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7707: Attachment: Screenshot 2024-05-02 at 17.41.02.png > Enable bundle validation on Java 8 and 11 >

[jira] [Assigned] (HUDI-7707) Enable bundle validation on Java 8 and 11

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-7707: --- Assignee: Ethan Guo > Enable bundle validation on Java 8 and 11 >

[jira] [Updated] (HUDI-7707) Enable bundle validation on Java 8 and 11

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7707: Fix Version/s: 0.15.0 1.0.0 > Enable bundle validation on Java 8 and 11 >

[jira] [Created] (HUDI-7707) Enable bundle validation on Java 8 and 11

2024-05-02 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-7707: --- Summary: Enable bundle validation on Java 8 and 11 Key: HUDI-7707 URL: https://issues.apache.org/jira/browse/HUDI-7707 Project: Apache Hudi Issue Type: Improvement

Re: [PR] [HUDI-7686] Add tests on the util methods for type cast of configuration instances [hudi]

2024-05-02 Thread via GitHub
yihua commented on code in PR #11121: URL: https://github.com/apache/hudi/pull/11121#discussion_r1588552025 ## hudi-io/src/test/java/org/apache/hudi/io/storage/BaseTestStorageConfiguration.java: ## @@ -71,13 +72,25 @@ public abstract class BaseTestStorageConfiguration {

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091943286 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * 9a2450a1bb4454ddc2c86791ce112201f431627a UNKNOWN *

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091937900 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * 9a2450a1bb4454ddc2c86791ce112201f431627a UNKNOWN *

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
yihua commented on code in PR #11130: URL: https://github.com/apache/hudi/pull/11130#discussion_r1588541644 ## hudi-spark-datasource/hudi-spark3.5.x/src/test/java/org/apache/hudi/spark3/internal/TestReflectUtil.java: ## @@ -42,7 +44,7 @@ public void

[jira] [Updated] (HUDI-7695) Add docs on Spark 3.5 and Scala 2.13

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7695: Sprint: Sprint 2023-04-26 > Add docs on Spark 3.5 and Scala 2.13 > > >

[jira] [Updated] (HUDI-7702) Remove unused method in ReflectUtil

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7702: Sprint: Sprint 2023-04-26 > Remove unused method in ReflectUtil > --- > >

[jira] [Updated] (HUDI-7705) Column name is wrong when generating partition stats index key

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7705: Sprint: Sprint 2023-04-26 > Column name is wrong when generating partition stats index key >

[jira] [Updated] (HUDI-7706) Improve validation in PARTITION_STATS index test

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7706: Sprint: Sprint 2023-04-26 > Improve validation in PARTITION_STATS index test >

[jira] [Updated] (HUDI-7706) Improve validation in PARTITION_STATS index test

2024-05-02 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7706: Story Points: 1 > Improve validation in PARTITION_STATS index test >

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091896712 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * 9a2450a1bb4454ddc2c86791ce112201f431627a UNKNOWN *

Re: [PR] [HUDI-7587] Make bundle dependencies for storage abstraction in correct order [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11131: URL: https://github.com/apache/hudi/pull/11131#issuecomment-2091884462 ## CI report: * 834aad2a8b073a221e68fb3c960200f684b84dfd Azure:

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091837042 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * 9a2450a1bb4454ddc2c86791ce112201f431627a UNKNOWN *

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091829624 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * 9a2450a1bb4454ddc2c86791ce112201f431627a UNKNOWN *

Re: [PR] [HUDI-7587] Make bundle dependencies for storage abstraction in correct order [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11131: URL: https://github.com/apache/hudi/pull/11131#issuecomment-2091820661 ## CI report: * c0a81f2890f9b066738fdf74cad9edf79cae0fda Azure:

Re: [I] [SUPPORT] is it possible to read/write hudi files with another programming language? [hudi]

2024-05-02 Thread via GitHub
xushiyan commented on issue #7446: URL: https://github.com/apache/hudi/issues/7446#issuecomment-2091776935 @vinothchandar yes. gonna take care of repo logistics and dev setup to make the repo ready for new contributors. Also preparing issues to work on. -- This is an automated message

Re: [PR] [HUDI-7587] Make bundle dependencies for storage abstraction in correct order [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11131: URL: https://github.com/apache/hudi/pull/11131#issuecomment-2091675567 ## CI report: * c0a81f2890f9b066738fdf74cad9edf79cae0fda Azure:

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091632448 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * bf6aaf244d52cc66e7c93d7a8a02502e9941 Azure:

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091590841 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * bf6aaf244d52cc66e7c93d7a8a02502e9941 Azure:

Re: [PR] [HUDI-7706] Improve validation in PARTITION_STATS index test [hudi]

2024-05-02 Thread via GitHub
yihua merged PR #11141: URL: https://github.com/apache/hudi/pull/11141 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(hudi) branch master updated (156e7604f8d -> 65f4b594c28)

2024-05-02 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 156e7604f8d [HUDI-4372] Enable matadata table by default for flink (#11124) add 65f4b594c28 [HUDI-7706] Improve

Re: [PR] [HUDI-7587] Make bundle dependencies for storage abstraction in correct order [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11131: URL: https://github.com/apache/hudi/pull/11131#issuecomment-2091556390 ## CI report: * c0a81f2890f9b066738fdf74cad9edf79cae0fda Azure:

Re: [PR] [HUDI-7706] Improve validation in PARTITION_STATS index test [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11141: URL: https://github.com/apache/hudi/pull/11141#issuecomment-2091556714 ## CI report: * 3b9f0a272b58a7eb8f63ad20edd047b4aa740ccf Azure:

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091556140 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * bf6aaf244d52cc66e7c93d7a8a02502e9941 Azure:

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091473097 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * bf6aaf244d52cc66e7c93d7a8a02502e9941 Azure:

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091461817 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * d33ea2a54ba42ccb221156b9013889b7b6b0af94 Azure:

Re: [PR] [HUDI-7587] Make bundle dependencies for storage abstraction in correct order [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11131: URL: https://github.com/apache/hudi/pull/11131#issuecomment-2091448728 ## CI report: * b88fa88e1a946edf8da8f0686345fe06fd0f55ce Azure:

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091448670 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * d33ea2a54ba42ccb221156b9013889b7b6b0af94 Azure:

Re: [PR] [HUDI-7706] Improve validation in PARTITION_STATS index test [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11141: URL: https://github.com/apache/hudi/pull/11141#issuecomment-2091343302 ## CI report: * 3b9f0a272b58a7eb8f63ad20edd047b4aa740ccf Azure:

Re: [PR] [HUDI-7587] Make bundle dependencies for storage abstraction in correct order [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11131: URL: https://github.com/apache/hudi/pull/11131#issuecomment-2091343002 ## CI report: * b88fa88e1a946edf8da8f0686345fe06fd0f55ce Azure:

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091342715 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * e869465714018ad7085a175529dfc8f700ee867c Azure:

Re: [PR] [HUDI-7706] Improve validation in PARTITION_STATS index test [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11141: URL: https://github.com/apache/hudi/pull/11141#issuecomment-2091302414 ## CI report: * 3b9f0a272b58a7eb8f63ad20edd047b4aa740ccf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091302055 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * e869465714018ad7085a175529dfc8f700ee867c Azure:

Re: [PR] [HUDI-7587] Make bundle dependencies for storage abstraction in correct order [hudi]

2024-05-02 Thread via GitHub
jonvex commented on code in PR #11131: URL: https://github.com/apache/hudi/pull/11131#discussion_r1588149891 ## hudi-common/src/test/java/org/apache/hudi/common/testutils/HoodieTestUtils.java: ## @@ -68,7 +68,8 @@ public class HoodieTestUtils { public static final String[]

Re: [PR] [MINOR] remove unnecessary lines from java test [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11139: URL: https://github.com/apache/hudi/pull/11139#issuecomment-2091284961 ## CI report: * 069377621b3112a0280529fb15845afa9d58f991 Azure:

Re: [PR] [HUDI-7587] Make bundle dependencies for storage abstraction in correct order [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11131: URL: https://github.com/apache/hudi/pull/11131#issuecomment-2091284841 ## CI report: * b88fa88e1a946edf8da8f0686345fe06fd0f55ce Azure:

Re: [PR] [HUDI-6296] Add Scala 2.13 support for Spark 3.5 integration [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #11130: URL: https://github.com/apache/hudi/pull/11130#issuecomment-2091284743 ## CI report: * edf2bf30a2ddbd48db9452f34b1ac716bd2ebe18 UNKNOWN * b1598f5861c2b90da91ad33dc360533728ef7163 UNKNOWN * e869465714018ad7085a175529dfc8f700ee867c Azure:

  1   2   >