(hudi) annotated tag release-1.0.0-beta1-rc1 updated (2bc5518c138 -> e97aa6ccb56)

2023-11-10 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to annotated tag release-1.0.0-beta1-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git *** WARNING: tag release-1.0.0-beta1-rc1 was modified! *** from 2bc5518c138 (commit) to e97aa6c

[jira] [Closed] (HUDI-7074) Flink incremental query for non-blocking concurrency control

2023-11-10 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7074. - Resolution: Fixed > Flink incremental query for non-blocking concurrency control > ---

[jira] [Updated] (HUDI-6787) Integrate FileGroupReader with HoodieMergeOnReadSnapshotReader and RealtimeCompactedRecordReader for Hive

2023-11-10 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-6787: -- Fix Version/s: 1.0.0 (was: 1.0.0-beta1) > Integrate FileGroupReader with HoodieMe

Re: [PR] [HUDI-7074] Flink incremental query for non-blocking concurrency control [hudi]

2023-11-10 Thread via GitHub
danny0405 commented on code in PR #10053: URL: https://github.com/apache/hudi/pull/10053#discussion_r1390137807 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieMergedReadHandle.java: ## @@ -99,7 +99,7 @@ private Option getLatestFileSlice() { &&

(hudi) branch master updated (c260bce03ec -> 796ac8697e7)

2023-11-10 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from c260bce03ec [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 (#9998) add 796ac8697e7

Re: [PR] [HUDI-7074] Flink incremental query for non-blocking concurrency control [hudi]

2023-11-10 Thread via GitHub
danny0405 merged PR #10053: URL: https://github.com/apache/hudi/pull/10053 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apac

Re: [PR] [HUDI-7074] Flink incremental query for non-blocking concurrency control [hudi]

2023-11-10 Thread via GitHub
danny0405 commented on code in PR #10053: URL: https://github.com/apache/hudi/pull/10053#discussion_r1390137560 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java: ## @@ -1000,7 +1000,9 @@ private static List getPartitionFileSlices(HoodieTableMet

Re: [PR] [HUDI-7074] Flink incremental query for non-blocking concurrency control [hudi]

2023-11-10 Thread via GitHub
codope commented on code in PR #10053: URL: https://github.com/apache/hudi/pull/10053#discussion_r1390135823 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java: ## @@ -1000,7 +1000,9 @@ private static List getPartitionFileSlices(HoodieTableMetaCl

Re: [PR] [HUDI-7082] Add Flink 1.14 and Spark 3.13 docker image script [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10066: URL: https://github.com/apache/hudi/pull/10066#issuecomment-1806697318 ## CI report: * 8c32f7bc02016c301288575fabc9db2eac46aaab Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-5936] Fix serialization problem when FileStatus is not serializable [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10065: URL: https://github.com/apache/hudi/pull/10065#issuecomment-1806674537 ## CI report: * dc9735093064e2f15277330d56012cf7835604da UNKNOWN * f7d0cf8adf8e80204fe9de5f231d062ae43e6787 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

svn commit: r65210 - in /dev/hudi/hudi-1.0.0-beta1-rc1: ./ hudi-1.0.0-beta1-rc1.src.tgz hudi-1.0.0-beta1-rc1.src.tgz.asc hudi-1.0.0-beta1-rc1.src.tgz.sha512

2023-11-10 Thread yihua
Author: yihua Date: Sat Nov 11 04:24:11 2023 New Revision: 65210 Log: Add Apache Hudi 1.0.0-beta1 RC1 source release Added: dev/hudi/hudi-1.0.0-beta1-rc1/ dev/hudi/hudi-1.0.0-beta1-rc1/hudi-1.0.0-beta1-rc1.src.tgz (with props) dev/hudi/hudi-1.0.0-beta1-rc1/hudi-1.0.0-beta1-rc1.src.t

(hudi) branch master updated: [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 (#9998)

2023-11-10 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new c260bce03ec [HUDI-7076] Turn on new features by def

Re: [PR] [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 [hudi]

2023-11-10 Thread via GitHub
yihua merged PR #9998: URL: https://github.com/apache/hudi/pull/9998 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

Re: [PR] [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 [hudi]

2023-11-10 Thread via GitHub
yihua commented on PR #9998: URL: https://github.com/apache/hudi/pull/9998#issuecomment-1806641779 The fourth task (`UT FT other modules`) in Azure CI passes in #10055 based on the same set of changes. https://github.com/apache/hudi/assets/2497195/74e488c8-aaa3-45b9-9f3c-9a3227dc81c9";>

Re: [PR] [HUDI-7082] Add Flink 1.14 and Spark 3.13 docker image script [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10066: URL: https://github.com/apache/hudi/pull/10066#issuecomment-1806641536 ## CI report: * 8c32f7bc02016c301288575fabc9db2eac46aaab Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [MINOR] Fix testRenamePartition [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10064: URL: https://github.com/apache/hudi/pull/10064#issuecomment-1806641517 ## CI report: * 4ab080293d7d6c5d93e0353397fe516ec47dd9a5 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-5936] Fix serialization problem when FileStatus is not serializable [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10065: URL: https://github.com/apache/hudi/pull/10065#issuecomment-1806616830 ## CI report: * 2c42b4127fa90eb1f5de9948b5a6bec9ed27662e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7082] Add Flink 1.14 and Spark 3.13 docker image script [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10066: URL: https://github.com/apache/hudi/pull/10066#issuecomment-1806638295 ## CI report: * 8c32f7bc02016c301288575fabc9db2eac46aaab UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #9998: URL: https://github.com/apache/hudi/pull/9998#issuecomment-1806638210 ## CI report: * d1f415b1400e0ff853e38b48fdaa7a9fe7aa44d3 UNKNOWN * f7f4a9e3342020e4a1472f5a3b59d25f9c1ec090 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806635356 ## CI report: * bfebcd456acf943c525ca2830ab864098a802e9a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7072] Remove support for Flink 1.13 [hudi]

2023-11-10 Thread via GitHub
danny0405 commented on PR #10052: URL: https://github.com/apache/hudi/pull/10052#issuecomment-1806635003 Can you reference PR: https://github.com/apache/hudi/pull/5072, the redundants between 1.13 and 1.14 can be moved back to `hudi-flink` module I think. -- This is an automated message

[PR] [HUDI-7082] Add Flink 1.14 and Spark 3.13 docker image script [hudi]

2023-11-10 Thread via GitHub
danny0405 opened a new pull request, #10066: URL: https://github.com/apache/hudi/pull/10066 ### Change Logs We are gonna remove the support for flink 1.13, so update the bundle validation scripts. ### Impact none ### Risk level (write none, low medium or high bel

[jira] [Updated] (HUDI-7082) Add Flink 1.14 and Spark 3.13 docker image script

2023-11-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7082: - Labels: pull-request-available (was: ) > Add Flink 1.14 and Spark 3.13 docker image script >

[jira] [Created] (HUDI-7082) Add Flink 1.14 and Spark 3.13 docker image script

2023-11-10 Thread Danny Chen (Jira)
Danny Chen created HUDI-7082: Summary: Add Flink 1.14 and Spark 3.13 docker image script Key: HUDI-7082 URL: https://issues.apache.org/jira/browse/HUDI-7082 Project: Apache Hudi Issue Type: Impro

Re: [PR] [HUDI-5936] Fix serialization problem when FileStatus is not serializable [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10065: URL: https://github.com/apache/hudi/pull/10065#issuecomment-1806615305 ## CI report: * 2c42b4127fa90eb1f5de9948b5a6bec9ed27662e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-5936] Fix serialization problem when FileStatus is not serializable [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10065: URL: https://github.com/apache/hudi/pull/10065#issuecomment-1806604213 ## CI report: * 2c42b4127fa90eb1f5de9948b5a6bec9ed27662e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

(hudi) branch master updated: [MINOR] Disable reader for test with enum (#10061)

2023-11-10 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 558281ed430 [MINOR] Disable reader for test with en

Re: [PR] [MINOR] Disable reader for test with enum [hudi]

2023-11-10 Thread via GitHub
yihua merged PR #10061: URL: https://github.com/apache/hudi/pull/10061 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o

Re: [PR] [HUDI-5936] Fix serialization problem when FileStatus is not serializable [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10065: URL: https://github.com/apache/hudi/pull/10065#issuecomment-1806600513 ## CI report: * 2c42b4127fa90eb1f5de9948b5a6bec9ed27662e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [MINOR] Disable reader for test with enum [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10061: URL: https://github.com/apache/hudi/pull/10061#issuecomment-1806600476 ## CI report: * 1b2a9288f4d10a0c68336eaf97770b165a3bc773 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-5936] Fix serialization problem when FileStatus is not serializable [hudi]

2023-11-10 Thread via GitHub
CTTY commented on PR #10065: URL: https://github.com/apache/hudi/pull/10065#issuecomment-1806598734 Reopened this because this behavior as we are seeing another exception triggered on a different method which is not fixed -- This is an automated message from the Apache Git Service. To res

Re: [PR] [HUDI-5936] Fix serialization problem when FileStatus is not serializable [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10065: URL: https://github.com/apache/hudi/pull/10065#issuecomment-1806596299 ## CI report: * 2c42b4127fa90eb1f5de9948b5a6bec9ed27662e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806596253 ## CI report: * Unknown: [CANCELED](TBD) * bfebcd456acf943c525ca2830ab864098a802e9a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d70

Re: [PR] [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #9998: URL: https://github.com/apache/hudi/pull/9998#issuecomment-1806596160 ## CI report: * d1f415b1400e0ff853e38b48fdaa7a9fe7aa44d3 UNKNOWN * 4cabc36a8ca585b4b1f4ff845145618a70f67174 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

Re: [PR] [MINOR] disable reader for test with enum [hudi]

2023-11-10 Thread via GitHub
yihua commented on code in PR #10061: URL: https://github.com/apache/hudi/pull/10061#discussion_r1390059295 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/HoodieIncrSource.java: ## @@ -128,10 +130,16 @@ public static class Config { HoodieIncrSourceCo

Re: [PR] [HUDI-6658] inject filters for incremental query [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10063: URL: https://github.com/apache/hudi/pull/10063#issuecomment-1806592047 ## CI report: * dad8fa7cc5f3c3ff65fd0cd9024866083a67db61 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [MINOR][Testing] Test hudi-cli module [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10060: URL: https://github.com/apache/hudi/pull/10060#issuecomment-1806592026 ## CI report: * dded663cc76f356a4b37941edeaf9dba3adf5c37 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806591999 ## CI report: * Unknown: [CANCELED](TBD) * bfebcd456acf943c525ca2830ab864098a802e9a UNKNOWN Bot commands @hudi-bot supports the following commands: -

Re: [PR] [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #9998: URL: https://github.com/apache/hudi/pull/9998#issuecomment-1806591889 ## CI report: * d1f415b1400e0ff853e38b48fdaa7a9fe7aa44d3 UNKNOWN * 647c783c527a1b18e47feaee3fb7335b37fe5f26 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
yihua commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806582292 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [HUDI-5936] Fix serialization problem when FileStatus is not serializable [hudi]

2023-11-10 Thread via GitHub
CTTY opened a new pull request, #10065: URL: https://github.com/apache/hudi/pull/10065 ### Change Logs Original PR: #8190 ### Impact _Describe any public API or user-facing feature change or any performance impact._ ### Risk level (write none, low medium or high

Re: [PR] [MINOR] Fix testRenamePartition [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10064: URL: https://github.com/apache/hudi/pull/10064#issuecomment-1806565749 ## CI report: * 4ab080293d7d6c5d93e0353397fe516ec47dd9a5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [MINOR][Testing] Test hudi-cli module [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10060: URL: https://github.com/apache/hudi/pull/10060#issuecomment-1806565674 ## CI report: * f70767fb0cf87e383474adc127779f6d31990742 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #9998: URL: https://github.com/apache/hudi/pull/9998#issuecomment-1806565428 ## CI report: * d1f415b1400e0ff853e38b48fdaa7a9fe7aa44d3 UNKNOWN * 647c783c527a1b18e47feaee3fb7335b37fe5f26 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

Re: [PR] [MINOR] Fix testRenamePartition [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10064: URL: https://github.com/apache/hudi/pull/10064#issuecomment-1806561197 ## CI report: * 4ab080293d7d6c5d93e0353397fe516ec47dd9a5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [MINOR] disable reader for test with enum [hudi]

2023-11-10 Thread via GitHub
yihua commented on code in PR #10061: URL: https://github.com/apache/hudi/pull/10061#discussion_r1390017284 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/HoodieIncrSource.java: ## @@ -128,10 +130,16 @@ public static class Config { HoodieIncrSourceCo

Re: [PR] [HUDI-6613] implement inmemory file index to allow for glob paths [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10062: URL: https://github.com/apache/hudi/pull/10062#issuecomment-1806556765 ## CI report: * 6be57a2edc36106e71c267ad111fa1db4e9bf32a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [MINOR][Testing] Test hudi-cli module [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10060: URL: https://github.com/apache/hudi/pull/10060#issuecomment-1806556736 ## CI report: * f70767fb0cf87e383474adc127779f6d31990742 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806556723 ## CI report: * f70767fb0cf87e383474adc127779f6d31990742 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

[PR] [MINOR] Fix testRenamePartition [hudi]

2023-11-10 Thread via GitHub
linliu-code opened a new pull request, #10064: URL: https://github.com/apache/hudi/pull/10064 ### Change Logs Fix unit test: testRenamePartition ### Impact Fix the unit test. ### Risk level (write none, low medium or high below) Low. ### Contribut

Re: [PR] [HUDI-6658] inject filters for incremental query [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10063: URL: https://github.com/apache/hudi/pull/10063#issuecomment-1806528256 ## CI report: * dad8fa7cc5f3c3ff65fd0cd9024866083a67db61 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-6613] implement inmemory file index to allow for glob paths [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10062: URL: https://github.com/apache/hudi/pull/10062#issuecomment-1806528229 ## CI report: * 6be57a2edc36106e71c267ad111fa1db4e9bf32a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #9998: URL: https://github.com/apache/hudi/pull/9998#issuecomment-1806527945 ## CI report: * d1f415b1400e0ff853e38b48fdaa7a9fe7aa44d3 UNKNOWN * 647c783c527a1b18e47feaee3fb7335b37fe5f26 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

Re: [PR] [HUDI-6658] inject filters for incremental query [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10063: URL: https://github.com/apache/hudi/pull/10063#issuecomment-1806523593 ## CI report: * dad8fa7cc5f3c3ff65fd0cd9024866083a67db61 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-6613] implement inmemory file index to allow for glob paths [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10062: URL: https://github.com/apache/hudi/pull/10062#issuecomment-1806523558 ## CI report: * 6be57a2edc36106e71c267ad111fa1db4e9bf32a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [MINOR] disable reader for test with enum [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10061: URL: https://github.com/apache/hudi/pull/10061#issuecomment-1806518111 ## CI report: * 1b2a9288f4d10a0c68336eaf97770b165a3bc773 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

[jira] [Updated] (HUDI-6658) Implement MOR Incremental for new file format

2023-11-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6658: - Labels: pull-request-available (was: ) > Implement MOR Incremental for new file format >

[PR] [HUDI-6658] inject filters for incremental query [hudi]

2023-11-10 Thread via GitHub
jonvex opened a new pull request, #10063: URL: https://github.com/apache/hudi/pull/10063 ### Change Logs only spark 3.3 currently. want to see how ci runs ### Impact incremental query will work much better including df.count() should be correct. ### Risk level (wr

[jira] [Assigned] (HUDI-6658) Implement MOR Incremental for new file format

2023-11-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-6658: - Assignee: Jonathan Vexler > Implement MOR Incremental for new file format > -

Re: [PR] [HUDI-0000] do not merge. Testing batch reading [hudi]

2023-11-10 Thread via GitHub
jonvex closed pull request #10039: [HUDI-] do not merge. Testing batch reading URL: https://github.com/apache/hudi/pull/10039 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[PR] [HUDI-6613] implement inmemory file index to allow for glob paths [hudi]

2023-11-10 Thread via GitHub
jonvex opened a new pull request, #10062: URL: https://github.com/apache/hudi/pull/10062 ### Change Logs implement inmemory file index to allow for queries with glob paths ### Impact improve new reader ### Risk level (write none, low medium or high below) lo

Re: [PR] [HUDI-0000] DO NOT MERGE Fix incr errors new reader [hudi]

2023-11-10 Thread via GitHub
jonvex closed pull request #9954: [HUDI-] DO NOT MERGE Fix incr errors new reader URL: https://github.com/apache/hudi/pull/9954 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[jira] [Updated] (HUDI-6613) New file format does not work with in memory index

2023-11-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6613: - Labels: pull-request-available (was: ) > New file format does not work with in memory index > ---

[jira] [Assigned] (HUDI-6613) New file format does not work with in memory index

2023-11-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-6613: - Assignee: Jonathan Vexler > New file format does not work with in memory index >

[jira] [Updated] (HUDI-6613) New file format does not work with in memory index

2023-11-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-6613: -- Status: In Progress (was: Open) > New file format does not work with in memory index >

Re: [PR] [MINOR][Testing] Test hudi-cli module [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10060: URL: https://github.com/apache/hudi/pull/10060#issuecomment-1806479127 ## CI report: * f70767fb0cf87e383474adc127779f6d31990742 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [MINOR] disable reader for test with enum [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10061: URL: https://github.com/apache/hudi/pull/10061#issuecomment-1806479164 ## CI report: * 1b2a9288f4d10a0c68336eaf97770b165a3bc773 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [MINOR][Testing] Test hudi-cli module [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10060: URL: https://github.com/apache/hudi/pull/10060#issuecomment-1806468044 ## CI report: * f70767fb0cf87e383474adc127779f6d31990742 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #9998: URL: https://github.com/apache/hudi/pull/9998#issuecomment-1806467419 ## CI report: * d1f415b1400e0ff853e38b48fdaa7a9fe7aa44d3 UNKNOWN * 3b32f34ca7b86153850a6dea50b3de2c488b1b61 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806467914 ## CI report: * 3fff661e4b61f2eec4148b3eb93110c8cdc8c8e1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

[PR] [MINOR] disable reader for test with enum [hudi]

2023-11-10 Thread via GitHub
jonvex opened a new pull request, #10061: URL: https://github.com/apache/hudi/pull/10061 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806460194 ## CI report: * 3fff661e4b61f2eec4148b3eb93110c8cdc8c8e1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #9998: URL: https://github.com/apache/hudi/pull/9998#issuecomment-1806459953 ## CI report: * d1f415b1400e0ff853e38b48fdaa7a9fe7aa44d3 UNKNOWN * 3b32f34ca7b86153850a6dea50b3de2c488b1b61 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[jira] [Created] (HUDI-7081) Hoodie FilegroupReader cannot read Enums from MOR avro log blocks

2023-11-10 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7081: - Summary: Hoodie FilegroupReader cannot read Enums from MOR avro log blocks Key: HUDI-7081 URL: https://issues.apache.org/jira/browse/HUDI-7081 Project: Apache Hudi

[PR] [MINOR][Testing] Test hudi-cli module [hudi]

2023-11-10 Thread via GitHub
yihua opened a new pull request, #10060: URL: https://github.com/apache/hudi/pull/10060 ### Change Logs As above ### Impact none ### Risk level none ### Documentation Update N/A ### Contributor's checklist - [ ] Read through [contributor's g

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806397370 ## CI report: * 3fff661e4b61f2eec4148b3eb93110c8cdc8c8e1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

(hudi) branch master updated (a91bdece2c1 -> 256bbe9d455)

2023-11-10 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from a91bdece2c1 [HUDI-7079] Disable new file format for metadata table (#10058) add 256bbe9d455 [MINOR] Disable reader

Re: [PR] [MINOR] disable reader in schema evo test [hudi]

2023-11-10 Thread via GitHub
yihua merged PR #10059: URL: https://github.com/apache/hudi/pull/10059 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o

[PR] [MINOR] disable reader in schema evo test [hudi]

2023-11-10 Thread via GitHub
jonvex opened a new pull request, #10059: URL: https://github.com/apache/hudi/pull/10059 ### Change Logs disable new reader explicitly ### Impact not supported currently so will pass even if reader is enabled by default ### Risk level (write none, low medium or hi

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806338086 ## CI report: * 6dc1594a35d786c6efbf944f36c41b6e51e4acf1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #9998: URL: https://github.com/apache/hudi/pull/9998#issuecomment-1806337863 ## CI report: * d1f415b1400e0ff853e38b48fdaa7a9fe7aa44d3 UNKNOWN * 3b32f34ca7b86153850a6dea50b3de2c488b1b61 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

Re: [PR] [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #9998: URL: https://github.com/apache/hudi/pull/9998#issuecomment-1806329969 ## CI report: * d1f415b1400e0ff853e38b48fdaa7a9fe7aa44d3 UNKNOWN * 3b32f34ca7b86153850a6dea50b3de2c488b1b61 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[jira] [Updated] (HUDI-7080) Re-enable a few tests with new Spark file format and file group reader

2023-11-10 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7080: Fix Version/s: 1.0.0 > Re-enable a few tests with new Spark file format and file group reader >

[jira] [Created] (HUDI-7080) Re-enable a few tests with new Spark file format and file group reader

2023-11-10 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-7080: --- Summary: Re-enable a few tests with new Spark file format and file group reader Key: HUDI-7080 URL: https://issues.apache.org/jira/browse/HUDI-7080 Project: Apache Hudi

Re: [PR] [MINOR][TESTING] Enable new configs by default for 1.0.0-beta - 2 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10054: URL: https://github.com/apache/hudi/pull/10054#issuecomment-1806257277 ## CI report: * 8f2e512d3591980d75d06bfb1086ac854b12745c UNKNOWN * 321ee11654d9e2627e6677179b3c9c26e233c538 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806239544 ## CI report: * 021fbdb5dfe7b04a087815adf6afa51a27686523 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806231902 ## CI report: * 021fbdb5dfe7b04a087815adf6afa51a27686523 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7076] Turn on new features by default through configs for 1.0.0-beta1 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #9998: URL: https://github.com/apache/hudi/pull/9998#issuecomment-1806231530 ## CI report: * d1f415b1400e0ff853e38b48fdaa7a9fe7aa44d3 UNKNOWN * 3b32f34ca7b86153850a6dea50b3de2c488b1b61 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

Re: [PR] [HUDI-7074] Flink incremental query for non-blocking concurrency control [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10053: URL: https://github.com/apache/hudi/pull/10053#issuecomment-1806209456 ## CI report: * 240ab68dc60b1d30983a6b1c7a497e9d5b4d4e16 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [HUDI-7079] disable new file format for metadata table [hudi]

2023-11-10 Thread via GitHub
yihua merged PR #10058: URL: https://github.com/apache/hudi/pull/10058 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o

(hudi) branch master updated: [HUDI-7079] Disable new file format for metadata table (#10058)

2023-11-10 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a91bdece2c1 [HUDI-7079] Disable new file format for

Re: [PR] [HUDI-7079] disable new file format for metadata table [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10058: URL: https://github.com/apache/hudi/pull/10058#issuecomment-1806157600 ## CI report: * 2227bae3742151691a638a70c94c9d44118be13a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806157555 ## CI report: * 021fbdb5dfe7b04a087815adf6afa51a27686523 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

Re: [PR] [MINOR][TESTING] Enable new configs by default for 1.0.0-beta - 2 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10054: URL: https://github.com/apache/hudi/pull/10054#issuecomment-1806157511 ## CI report: * 8f2e512d3591980d75d06bfb1086ac854b12745c UNKNOWN * 7be659422f59706308364bdab2ce3e78a2f08812 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7079] disable new file format for metadata table [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10058: URL: https://github.com/apache/hudi/pull/10058#issuecomment-1806147191 ## CI report: * 2227bae3742151691a638a70c94c9d44118be13a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [MINOR][TESTING] Enable new configs by default for 1.0.0-beta - 2 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10054: URL: https://github.com/apache/hudi/pull/10054#issuecomment-1806147053 ## CI report: * 8f2e512d3591980d75d06bfb1086ac854b12745c UNKNOWN * 7be659422f59706308364bdab2ce3e78a2f08812 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [MINOR][TESTING] Enable configs testing 3 [hudi]

2023-11-10 Thread via GitHub
hudi-bot commented on PR #10055: URL: https://github.com/apache/hudi/pull/10055#issuecomment-1806147122 ## CI report: * 021fbdb5dfe7b04a087815adf6afa51a27686523 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=20

[jira] [Updated] (HUDI-7079) Disable new file reader for metadata table

2023-11-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7079: - Labels: pull-request-available (was: ) > Disable new file reader for metadata table > ---

[PR] [HUDI-7079] disable new file format for metadata table [hudi]

2023-11-10 Thread via GitHub
jonvex opened a new pull request, #10058: URL: https://github.com/apache/hudi/pull/10058 ### Change Logs Disable the new file format for the metadata table because we haven't implemented hfile base files yet. Also made new method for duplicated code ### Impact metadata t

[jira] [Created] (HUDI-7079) Disable new file reader for metadata table

2023-11-10 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7079: - Summary: Disable new file reader for metadata table Key: HUDI-7079 URL: https://issues.apache.org/jira/browse/HUDI-7079 Project: Apache Hudi Issue Type: Im

  1   2   >