Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

codope commented on code in PR #11162: URL: https://github.com/apache/hudi/pull/11162#discussion_r1629990583 ## hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/HoodieSparkFunctionalIndexClient.java: ## @@ -85,6 +85,7 @@ public void create(HoodieTableMetaCli

[jira] [Created] (HUDI-7836) Support secondary index to be created on multiple fields

Sagar Sumit created HUDI-7836: - Summary: Support secondary index to be created on multiple fields Key: HUDI-7836 URL: https://issues.apache.org/jira/browse/HUDI-7836 Project: Apache Hudi Issue Ty

Re: [PR] [HUDI-7834] Create placeholder table versions. Introduce new hoodie table property to track initial table version when table was created. This is needed to identify if the table was originall

codope commented on code in PR #11406: URL: https://github.com/apache/hudi/pull/11406#discussion_r1629979770 ## hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java: ## @@ -623,6 +624,8 @@ private static void initTableMetaClient(StorageConfiguration

Re: [PR] [MINOR] Add logs whenever fallback to fs listing even with MDT enabled [hudi]

nsivabalan commented on code in PR #11407: URL: https://github.com/apache/hudi/pull/11407#discussion_r1629971578 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadata.java: ## @@ -131,7 +136,7 @@ static HoodieTableMetadata create(HoodieEngineContext engineCo

Re: [PR] [MINOR] Add logs whenever fallback to fs listing even with MDT enabled [hudi]

hudi-bot commented on PR #11407: URL: https://github.com/apache/hudi/pull/11407#issuecomment-2153061903 ## CI report: * 43e3d35b9b859a9c6532a24fbab9017d2bb6d322 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2153061229 ## CI report: * b342d8f8e10f77419bf1bd0bc9f626a596ad65f9 UNKNOWN * bb3bff3f12c7472714f86aad930737238c1a310d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2153048128 ## CI report: * b342d8f8e10f77419bf1bd0bc9f626a596ad65f9 UNKNOWN * bb3bff3f12c7472714f86aad930737238c1a310d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

[PR] [MINOR] Add logs whenever fallback to fs listing even with MDT enabled [hudi]

codope opened a new pull request, #11407: URL: https://github.com/apache/hudi/pull/11407 ### Change Logs Logging enhancement to help with debugging ### Impact Minor. This should only occasionally fallback so logs should not bloat. ### Risk level (write none, low me

[jira] [Created] (HUDI-7835) Spark context not stopped properly if the test had some exception that was ignored

Sagar Sumit created HUDI-7835: - Summary: Spark context not stopped properly if the test had some exception that was ignored Key: HUDI-7835 URL: https://issues.apache.org/jira/browse/HUDI-7835 Project: Apa

Re: [PR] [HUDI-7567] Add schema evolution to the filegroup reader [hudi]

hudi-bot commented on PR #10957: URL: https://github.com/apache/hudi/pull/10957#issuecomment-2152950084 ## CI report: * c98242b22fb2518c0cc93c037df558037030500f UNKNOWN * 76836bc57b9a150c244b855c41285b68ef191c68 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7567] Add schema evolution to the filegroup reader [hudi]

hudi-bot commented on PR #10957: URL: https://github.com/apache/hudi/pull/10957#issuecomment-2152936291 ## CI report: * c98242b22fb2518c0cc93c037df558037030500f UNKNOWN * 1e677e9b8b5d79cb23e85f2577407f9be840c762 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2152811360 ## CI report: * b342d8f8e10f77419bf1bd0bc9f626a596ad65f9 UNKNOWN * bb3bff3f12c7472714f86aad930737238c1a310d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2152695612 ## CI report: * b342d8f8e10f77419bf1bd0bc9f626a596ad65f9 UNKNOWN * 19b6362eb1d0e7c2ea15465964bef441b441106f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2152676340 ## CI report: * b342d8f8e10f77419bf1bd0bc9f626a596ad65f9 UNKNOWN * 19b6362eb1d0e7c2ea15465964bef441b441106f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [I] [SUPPORT] Unable to Use DynamoDB Based Lock with Hudi PySpark Job Locally [hudi]

soumilshah1995 commented on issue #11391: URL: https://github.com/apache/hudi/issues/11391#issuecomment-2152368822 yes I know its some jar issue as usual let me try older version to see if that works I have to just brute force here lol trying different versions -- This is an automate

Re: [I] [SUPPORT]hudi way of doing bucket index cannot be used to improve query engines queries such join and filter [hudi]

cono commented on issue #11204: URL: https://github.com/apache/hudi/issues/11204#issuecomment-2152342411 This is really useful feature to have. We want to use Hudi at work, but unfortunately we have couple of bucketed/sorted tables, and this is definitely a stopper for us to migrate to H

Re: [PR] [HUDI-7830] Add predicate filter pruning for snapshot queries in hudi related sources [hudi]

hudi-bot commented on PR #11396: URL: https://github.com/apache/hudi/pull/11396#issuecomment-2152262001 ## CI report: * 6e0f4bd6ff26b79f061bf3c107ed797ea4f3314a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] [HUDI-7830] Add predicate filter pruning for snapshot queries in hudi related sources [hudi]

hudi-bot commented on PR #11396: URL: https://github.com/apache/hudi/pull/11396#issuecomment-2152077460 ## CI report: * d39943c1608d0a18e25e8b13f9bf6900c684253f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

[jira] [Closed] (HUDI-7827) Bump io.airlift:aircompressor from 0.25 to 0.27

[ https://issues.apache.org/jira/browse/HUDI-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geser Dugarov closed HUDI-7827. --- Resolution: Fixed Fixed in master, d0c7de050a8900a29f5d127093b378b96f9c5158 > Bump io.airlift:aircomp

Re: [PR] [HUDI-7830] Add predicate filter pruning for snapshot queries in hudi related sources [hudi]

hudi-bot commented on PR #11396: URL: https://github.com/apache/hudi/pull/11396#issuecomment-2151941295 ## CI report: * d39943c1608d0a18e25e8b13f9bf6900c684253f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2151826829 ## CI report: * b342d8f8e10f77419bf1bd0bc9f626a596ad65f9 UNKNOWN * 19b6362eb1d0e7c2ea15465964bef441b441106f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7834] Create placeholder table versions. Introduce new hoodie table property to track initial table version when table was created. This is needed to identify if the table was originall

hudi-bot commented on PR #11406: URL: https://github.com/apache/hudi/pull/11406#issuecomment-2151812964 ## CI report: * e8a80e29e51c84a3403906d2acf0aeee24dedda4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] Fix missing serDe properties post migration from hiveSync to glueSync [hudi]

hudi-bot commented on PR #11404: URL: https://github.com/apache/hudi/pull/11404#issuecomment-2151812909 ## CI report: * fcafb8766c4b27557d1c40398ce28d8de8aec724 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] Fix missing serDe properties post migration from hiveSync to glueSync [hudi]

danny0405 commented on code in PR #11404: URL: https://github.com/apache/hudi/pull/11404#discussion_r1629080125 ## hudi-aws/src/main/java/org/apache/hudi/aws/sync/AWSGlueCatalogSyncClient.java: ## @@ -844,6 +848,66 @@ public String generatePushDownFilter(List writtenPartitions,

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

danny0405 commented on code in PR #11162: URL: https://github.com/apache/hudi/pull/11162#discussion_r1629072945 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/common/HoodieSparkEngineContext.java: ## @@ -229,6 +231,13 @@ public void cancelAllJobs() {

Re: [PR] [HUDI-7834] Create placeholder table versions. Introduce new hoodie table property to track initial table version when table was created. This is needed to identify if the table was originall

hudi-bot commented on PR #11406: URL: https://github.com/apache/hudi/pull/11406#issuecomment-2151721570 ## CI report: * e8a80e29e51c84a3403906d2acf0aeee24dedda4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2151720640 ## CI report: * b342d8f8e10f77419bf1bd0bc9f626a596ad65f9 UNKNOWN * 8a9986ae4b8712c0e2e700aeb40a1e4c041fde0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7834] Create placeholder table versions. Introduce new hoodie table property to track initial table version when table was created. This is needed to identify if the table was originall

hudi-bot commented on PR #11406: URL: https://github.com/apache/hudi/pull/11406#issuecomment-2151706424 ## CI report: * e8a80e29e51c84a3403906d2acf0aeee24dedda4 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2151705351 ## CI report: * b342d8f8e10f77419bf1bd0bc9f626a596ad65f9 UNKNOWN * 8a9986ae4b8712c0e2e700aeb40a1e4c041fde0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

[jira] [Updated] (HUDI-7834) Setup table versions to differentiate HUDI 0.16.x and 1.0-beta versions

[ https://issues.apache.org/jira/browse/HUDI-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7834: - Labels: pull-request-available (was: ) > Setup table versions to differentiate HUDI 0.16.x and 1.

[PR] [HUDI-7834] Create placeholder table versions. Introduce new hoodie table property to track initial table version when table was created. This is needed to identify if the table was originally a

bvaradar opened a new pull request, #11406: URL: https://github.com/apache/hudi/pull/11406 [HUDI-7834] Create placeholder table versions. Introduce new hoodie table property to track initial table version when table was created. This is needed to identify if the table was originally a 0.x o

Re: [PR] Fix missing serDe properties post migration from hiveSync to glueSync [hudi]

hudi-bot commented on PR #11404: URL: https://github.com/apache/hudi/pull/11404#issuecomment-2151602367 ## CI report: * fcafb8766c4b27557d1c40398ce28d8de8aec724 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] Fix missing serDe properties post migration from hiveSync to glueSync [hudi]

hudi-bot commented on PR #11404: URL: https://github.com/apache/hudi/pull/11404#issuecomment-2151589165 ## CI report: * fcafb8766c4b27557d1c40398ce28d8de8aec724 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[I] [SUPPORT] The clean service can't clean historical version files after the savepoint instant when i set `hoodie.archive.beyond.savepoint=true` [hudi]

gfcoder opened a new issue, #11405: URL: https://github.com/apache/hudi/issues/11405 The clean service can't clean historical version files after the savepoint instant when i set `hoodie.archive.beyond.savepoint=true` **To Reproduce** 1. set hoodie.archive.beyond.savepoint=true

<    1   2   3