[jira] [Updated] (HUDI-7312) Spark3ParsePartitionUtil support inferPartitionColumnValue with all unnest type

[ https://issues.apache.org/jira/browse/HUDI-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7312: - Labels: pull-request-available (was: ) > Spark3ParsePartitionUtil support inferPartitionColumnVa

[PR] [HUDI-7312] Spark3ParsePartitionUtil support inferPartitionColumnValue with all unnest type [hudi]

xuzifu666 opened a new pull request, #10530: URL: https://github.com/apache/hudi/pull/10530 ### Change Logs Spark3ParsePartitionUtil support inferPartitionColumnValue with all unnest type ### Impact low ### Risk level (write none, low medium or high below)

Re: [PR] [HUDI-7308] LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started [hudi]

hudi-bot commented on PR #10523: URL: https://github.com/apache/hudi/pull/10523#issuecomment-1897977442 ## CI report: * 0a5d0e18ce17caa4192e567a0bec1fca305d0cd2 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7305] Fix cast exception for byte/short/float partitioned field [hudi]

hudi-bot commented on PR #10518: URL: https://github.com/apache/hudi/pull/10518#issuecomment-1897977351 ## CI report: * 910c6a7401d89a19c271073665b5ca328b0e50e3 UNKNOWN * a93b89d67abedd4b9fbc36be736cc4d2f3d24edf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7170] Implement HFile reader independent of HBase [hudi]

hudi-bot commented on PR #10241: URL: https://github.com/apache/hudi/pull/10241#issuecomment-1897975748 ## CI report: * 54195223d071f56c572aecee344a516fb41203df UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[jira] [Created] (HUDI-7312) Spark3ParsePartitionUtil support inferPartitionColumnValue with all unnest type

xy created HUDI-7312: Summary: Spark3ParsePartitionUtil support inferPartitionColumnValue with all unnest type Key: HUDI-7312 URL: https://issues.apache.org/jira/browse/HUDI-7312 Project: Apache Hudi I

Re: [PR] initial commit for web banner [hudi]

nfarah86 commented on PR #10529: URL: https://github.com/apache/hudi/pull/10529#issuecomment-1897971429 https://github.com/apache/hudi/assets/5392555/b46491d0-a290-4b46-b718-200b4f0fbe97";> This is the latest- did some header changes -- This is an automated message from the Apache

[PR] initial commit for web banner [hudi]

nfarah86 opened a new pull request, #10529: URL: https://github.com/apache/hudi/pull/10529 Updated the Hudi OSS site to include an event banner. Attached is the banner on how it resizes: https://github.com/apache/hudi/assets/5392555/0dbe5195-a728-4b21-a187-d1d6cd841aac";> https://

Re: [PR] [HUDI-7310] Optimize Column Stats Partition Pruning for Non-Partition Pruning Queries [hudi]

hudi-bot commented on PR #10528: URL: https://github.com/apache/hudi/pull/10528#issuecomment-1897929430 ## CI report: * 70c69652005098181a64aa8037480f766259f711 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

[jira] [Created] (HUDI-7311) Comparing date with date literal in string format causes class cast exception during filter push down

Yao Zhang created HUDI-7311: --- Summary: Comparing date with date literal in string format causes class cast exception during filter push down Key: HUDI-7311 URL: https://issues.apache.org/jira/browse/HUDI-7311

Re: [PR] [HUDI-6719]Fix data inconsistency issues caused by concurrent clustering and delete partition. [hudi]

majian1998 closed pull request #9472: [HUDI-6719]Fix data inconsistency issues caused by concurrent clustering and delete partition. URL: https://github.com/apache/hudi/pull/9472 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [PR] [HUDI-6574] Fix the problem that incremental clean cannot be executed when the earliest ActiveTimeline is a pending commit. [hudi]

majian1998 closed pull request #9243: [HUDI-6574] Fix the problem that incremental clean cannot be executed when the earliest ActiveTimeline is a pending commit. URL: https://github.com/apache/hudi/pull/9243 -- This is an automated message from the Apache Git Service. To respond to the messa

Re: [PR] [HUDI-7310] Optimize Column Stats Partition Pruning for Non-Partition Pruning Queries [hudi]

hudi-bot commented on PR #10528: URL: https://github.com/apache/hudi/pull/10528#issuecomment-1897921531 ## CI report: * 70c69652005098181a64aa8037480f766259f711 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-7308] LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started [hudi]

hudi-bot commented on PR #10523: URL: https://github.com/apache/hudi/pull/10523#issuecomment-1897921435 ## CI report: * 227a3dde1d6fc187d9d66a88e0480192b1bffa33 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7308] LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started [hudi]

hudi-bot commented on PR #10523: URL: https://github.com/apache/hudi/pull/10523#issuecomment-1897913534 ## CI report: * 227a3dde1d6fc187d9d66a88e0480192b1bffa33 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

[jira] [Updated] (HUDI-7310) Optimize Column Stats Partition Pruning for Non-Partition Pruning Queries

[ https://issues.apache.org/jira/browse/HUDI-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7310: - Labels: pull-request-available (was: ) > Optimize Column Stats Partition Pruning for Non-Partitio

[PR] [HUDI-7310] Optimize Column Stats Partition Pruning for Non-Partition Pruning Queries [hudi]

majian1998 opened a new pull request, #10528: URL: https://github.com/apache/hudi/pull/10528 In HUDI-7291, I applied the partition pruning conditions to the column stats earlier, reducing the amount of data during the data skipping process. However, for non-partitioned tables, or partitione

Re: [PR] [HUDI-7309] Disable constructing AND & OR filter predicates when filt… [hudi]

hudi-bot commented on PR #10524: URL: https://github.com/apache/hudi/pull/10524#issuecomment-189787 ## CI report: * 9f169afa2be35c4d7a0e462eea578b4bbcd50e3f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7305] Fix cast exception for byte/short/float partitioned field [hudi]

hudi-bot commented on PR #10518: URL: https://github.com/apache/hudi/pull/10518#issuecomment-1897869959 ## CI report: * 910c6a7401d89a19c271073665b5ca328b0e50e3 UNKNOWN * 1145c5f5bb7217641beae8724a9b6ae3c37f7e53 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

[jira] [Created] (HUDI-7310) Optimize Column Stats Partition Pruning for Non-Partition Pruning Queries

Ma Jian created HUDI-7310: - Summary: Optimize Column Stats Partition Pruning for Non-Partition Pruning Queries Key: HUDI-7310 URL: https://issues.apache.org/jira/browse/HUDI-7310 Project: Apache Hudi

Re: [PR] [HUDI-7309] Disable constructing AND & OR filter predicates when filt… [hudi]

hudi-bot commented on PR #10524: URL: https://github.com/apache/hudi/pull/10524#issuecomment-1897863235 ## CI report: * 9f169afa2be35c4d7a0e462eea578b4bbcd50e3f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7305] Fix cast exception for byte/short/float partitioned field [hudi]

hudi-bot commented on PR #10518: URL: https://github.com/apache/hudi/pull/10518#issuecomment-1897863170 ## CI report: * 910c6a7401d89a19c271073665b5ca328b0e50e3 UNKNOWN * 1145c5f5bb7217641beae8724a9b6ae3c37f7e53 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7170] Implement HFile reader independent of HBase [hudi]

hudi-bot commented on PR #10241: URL: https://github.com/apache/hudi/pull/10241#issuecomment-1897862648 ## CI report: * 54195223d071f56c572aecee344a516fb41203df Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7309] Disable constructing AND & OR filter predicates when filt… [hudi]

hudi-bot commented on PR #10524: URL: https://github.com/apache/hudi/pull/10524#issuecomment-1897853493 ## CI report: * 9f169afa2be35c4d7a0e462eea578b4bbcd50e3f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7305] Fix cast exception for byte/short/float partitioned field [hudi]

stream2000 commented on code in PR #10518: URL: https://github.com/apache/hudi/pull/10518#discussion_r1456922969 ## hudi-spark-datasource/hudi-spark3-common/src/main/scala/org/apache/spark/sql/execution/datasources/Spark3ParsePartitionUtil.scala: ## @@ -274,6 +274,8 @@ object Sp

Re: [PR] [MINOR] Added descriptive exception if column present in required avro schema is not present in hudi table [hudi]

hudi-bot commented on PR #10527: URL: https://github.com/apache/hudi/pull/10527#issuecomment-1897816640 ## CI report: * b943b1d18880206e5f3cdec32fd789c9a22afef0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7144] Build storage partition stats index and use it for data skipping [hudi]

hudi-bot commented on PR #10352: URL: https://github.com/apache/hudi/pull/10352#issuecomment-1897816221 ## CI report: * f8c89bcfeb969a48bc4c5b56c2b3e5104dc6e940 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [MINOR] Added descriptive exception if column present in required avro schema is not present in hudi table [hudi]

hudi-bot commented on PR #10527: URL: https://github.com/apache/hudi/pull/10527#issuecomment-1897809934 ## CI report: * b943b1d18880206e5f3cdec32fd789c9a22afef0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [MINOR] Fix flaky testMultiWriterWithAsyncTableServicesWithConflict test [hudi]

hudi-bot commented on PR #10526: URL: https://github.com/apache/hudi/pull/10526#issuecomment-1897803589 ## CI report: * 2a0209db41eb4247ed1447ab2907709a5d173719 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7218][Stacked on HUDI-7170] Integrate new HFile reader with file reader factory [hudi]

hudi-bot commented on PR #10330: URL: https://github.com/apache/hudi/pull/10330#issuecomment-1897802912 ## CI report: * 3bc5c381966197e816eba184466d337961c5d6e3 UNKNOWN * be59e316d1a57374870f030f9ee1a8343d947d50 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

[PR] [MINOR] Added descriptive exception if column present in required avro schema is not present in hudi table [hudi]

prathit06 opened a new pull request, #10527: URL: https://github.com/apache/hudi/pull/10527 ### Change Logs Describe context and summary for this change. While using `HoodieTableSource` we encountered `ArrayIndexOutOfBoundsException` due to passing avro schema containing column wh

Re: [PR] [HUDI-7308] LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started [hudi]

hudi-bot commented on PR #10523: URL: https://github.com/apache/hudi/pull/10523#issuecomment-1897766469 ## CI report: * 227a3dde1d6fc187d9d66a88e0480192b1bffa33 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7305] Fix cast exception for byte/short/float partitioned field [hudi]

hudi-bot commented on PR #10518: URL: https://github.com/apache/hudi/pull/10518#issuecomment-1897766419 ## CI report: * 910c6a7401d89a19c271073665b5ca328b0e50e3 UNKNOWN * 1145c5f5bb7217641beae8724a9b6ae3c37f7e53 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7308] LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started [hudi]

hudi-bot commented on PR #10523: URL: https://github.com/apache/hudi/pull/10523#issuecomment-1897761274 ## CI report: * 227a3dde1d6fc187d9d66a88e0480192b1bffa33 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7246] Fix Data Skipping Issue: No Results When Query Conditions Involve Both Columns with and without Column Stats [hudi]

hudi-bot commented on PR #10389: URL: https://github.com/apache/hudi/pull/10389#issuecomment-1897761014 ## CI report: * 248df7c04d611c5f521f309732aa21351161fa8b UNKNOWN * c9a0628af1011d68df4f7752520c45802990 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7246] Fix Data Skipping Issue: No Results When Query Conditions Involve Both Columns with and without Column Stats [hudi]

hudi-bot commented on PR #10389: URL: https://github.com/apache/hudi/pull/10389#issuecomment-1897754284 ## CI report: * 248df7c04d611c5f521f309732aa21351161fa8b UNKNOWN * c9a0628af1011d68df4f7752520c45802990 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-6902] Shutdown metric hooks properly [hudi]

hudi-bot commented on PR #10520: URL: https://github.com/apache/hudi/pull/10520#issuecomment-1897754588 ## CI report: * a8be064c7f9b7023b94fb543dc695c0ceeabc54c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-6902] Fix a unit test [hudi]

hudi-bot commented on PR #10513: URL: https://github.com/apache/hudi/pull/10513#issuecomment-1897754506 ## CI report: * 68d309fa245dfcfee4afa934e2b38f57d48fc05c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7146] Support non-unique keys for secondary index [hudi]

hudi-bot commented on PR #10211: URL: https://github.com/apache/hudi/pull/10211#issuecomment-1897753993 ## CI report: * d97a61842c678093b17ae5c42f95a1f4e2aa925f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-6217] Spark reads should skip record with delete operation metadata [hudi]

xuzifu666 commented on PR #10219: URL: https://github.com/apache/hudi/pull/10219#issuecomment-1897752890 @beyond1920 Hi，Thanks for the pr，we also occur the problem，and query only miss scenario of delete operation？such as insert or update date missing was not occur？ -- This is an automate

Re: [PR] [HUDI-7308] LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started [hudi]

kbuci commented on code in PR #10523: URL: https://github.com/apache/hudi/pull/10523#discussion_r1456838438 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/lock/LockManager.java: ## @@ -95,7 +97,10 @@ public void lock() { */ public void

Re: [PR] [HUDI-7302] Consistent hashing row writer support sorting [hudi]

stream2000 commented on PR #10515: URL: https://github.com/apache/hudi/pull/10515#issuecomment-1897743885 > Can we elaborate a little why we need the sort for consistent hashing? When we read Parquet files, sorting will help skip data using parquet row group metadata. Some users may

Re: [PR] [HUDI-7246] Fix Data Skipping Issue: No Results When Query Conditions Involve Both Columns with and without Column Stats [hudi]

majian1998 commented on PR #10389: URL: https://github.com/apache/hudi/pull/10389#issuecomment-1897728645 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [HUDI-7302] Consistent hashing row writer support sorting [hudi]

danny0405 commented on PR #10515: URL: https://github.com/apache/hudi/pull/10515#issuecomment-1897721096 Can we elaborate a little why we need the sort for consistent hashing? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [PR] [HUDI-7305] Fix cast exception for byte/short/float partitioned field [hudi]

danny0405 commented on code in PR #10518: URL: https://github.com/apache/hudi/pull/10518#discussion_r1456782018 ## hudi-spark-datasource/hudi-spark3-common/src/main/scala/org/apache/spark/sql/execution/datasources/Spark3ParsePartitionUtil.scala: ## @@ -274,6 +274,8 @@ object Spa

[jira] [Closed] (HUDI-7270) Support schema evolution by Flink SQL using HoodieCatalog

[ https://issues.apache.org/jira/browse/HUDI-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-7270. Resolution: Fixed Fixed via master branch: 8930e8ced1be7cfa379b2febfda563b96b212a5c > Support schema evolut

[jira] [Updated] (HUDI-7270) Support schema evolution by Flink SQL using HoodieCatalog

[ https://issues.apache.org/jira/browse/HUDI-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-7270: - Fix Version/s: 1.0.0 > Support schema evolution by Flink SQL using HoodieCatalog > ---

Re: [PR] [HUDI-7144] Build storage partition stats index and use it for data skipping [hudi]

hudi-bot commented on PR #10352: URL: https://github.com/apache/hudi/pull/10352#issuecomment-1897716875 ## CI report: * 6a4ed249aef165851a345bf8c515074efed92f80 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7218][Stacked on HUDI-7170] Integrate new HFile reader with file reader factory [hudi]

hudi-bot commented on PR #10330: URL: https://github.com/apache/hudi/pull/10330#issuecomment-1897716815 ## CI report: * 05cc24dad847219cacb50c6e62b196c07f323bcd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

(hudi) branch master updated: [HUDI-7270] Support schema evolution by Flink SQL using HoodieCatalog (#10494)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 8930e8ced1b [HUDI-7270] Support schema evolutio

Re: [PR] [HUDI-7270] Support schema evolution by Flink SQL using HoodieCatalog [hudi]

danny0405 merged PR #10494: URL: https://github.com/apache/hudi/pull/10494 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apac

Re: [PR] [MINOR] Fix flaky testMultiWriterWithAsyncTableServicesWithConflict test [hudi]

hudi-bot commented on PR #10526: URL: https://github.com/apache/hudi/pull/10526#issuecomment-1897705857 ## CI report: * 2a0209db41eb4247ed1447ab2907709a5d173719 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7303] Fix date field type unexpectedly convert to Long when usi… [hudi]

danny0405 commented on code in PR #10517: URL: https://github.com/apache/hudi/pull/10517#discussion_r1456767443 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/source/ExpressionPredicates.java: ## @@ -602,10 +602,10 @@ private static FilterPredicate toParquetP

Re: [PR] [HUDI-7218][Stacked on HUDI-7170] Integrate new HFile reader with file reader factory [hudi]

hudi-bot commented on PR #10330: URL: https://github.com/apache/hudi/pull/10330#issuecomment-1897705408 ## CI report: * 05cc24dad847219cacb50c6e62b196c07f323bcd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7146] Support non-unique keys for secondary index [hudi]

hudi-bot commented on PR #10211: URL: https://github.com/apache/hudi/pull/10211#issuecomment-1897705213 ## CI report: * d97a61842c678093b17ae5c42f95a1f4e2aa925f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7144] Build storage partition stats index and use it for data skipping [hudi]

hudi-bot commented on PR #10352: URL: https://github.com/apache/hudi/pull/10352#issuecomment-1897705494 ## CI report: * 6a4ed249aef165851a345bf8c515074efed92f80 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7170] Implement HFile reader independent of HBase [hudi]

hudi-bot commented on PR #10241: URL: https://github.com/apache/hudi/pull/10241#issuecomment-1897705264 ## CI report: * 0e94898672fb426904b8c03c311751fce2ad043a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [I] [SUPPORT] Migration partitionned table with complex key generator to 0.14.1 leads to duplicates when recordkey length =1 [hudi]

danny0405 commented on issue #10508: URL: https://github.com/apache/hudi/issues/10508#issuecomment-1897703822 @parisni We made this change for these reasons: 1. composite the field name with single key does not make sense 2. it is not consistent with the simple key generator, that m

Re: [PR] [HUDI-6902] Containerize the Azure tests [hudi]

hudi-bot commented on PR #10512: URL: https://github.com/apache/hudi/pull/10512#issuecomment-1897699543 ## CI report: * 0e5a63db2337ae435f17eb956460e22caeea65b3 UNKNOWN * 4d759f3b4d6629e738b9b1afe4157c514d6df182 UNKNOWN * a70247f32679a6441cea131e946acce6fd09523e UNKNOWN *

Re: [PR] [HUDI-6902] Try container for Azure tests [hudi]

hudi-bot commented on PR #10525: URL: https://github.com/apache/hudi/pull/10525#issuecomment-1897699694 ## CI report: * 5a1ebfc87621a619c10bbec5d850d1e2c879aaca UNKNOWN * fd12f19ece1b5cedc36de67b50eca22e1f38240f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [MINOR] Fix flaky testMultiWriterWithAsyncTableServicesWithConflict test [hudi]

hudi-bot commented on PR #10526: URL: https://github.com/apache/hudi/pull/10526#issuecomment-1897699724 ## CI report: * 2a0209db41eb4247ed1447ab2907709a5d173719 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-7218][Stacked on HUDI-7170] Integrate new HFile reader with file reader factory [hudi]

hudi-bot commented on PR #10330: URL: https://github.com/apache/hudi/pull/10330#issuecomment-1897699138 ## CI report: * 05cc24dad847219cacb50c6e62b196c07f323bcd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7170] Implement HFile reader independent of HBase [hudi]

hudi-bot commented on PR #10241: URL: https://github.com/apache/hudi/pull/10241#issuecomment-1897698970 ## CI report: * 0e94898672fb426904b8c03c311751fce2ad043a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7146] Support non-unique keys for secondary index [hudi]

hudi-bot commented on PR #10211: URL: https://github.com/apache/hudi/pull/10211#issuecomment-1897698892 ## CI report: * d97a61842c678093b17ae5c42f95a1f4e2aa925f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-7304] Change DataSourceInternalWriterHelper::onDataWriterCommit LOG level avoid large mertric messages [hudi]

xuzifu666 closed pull request #10516: [HUDI-7304] Change DataSourceInternalWriterHelper::onDataWriterCommit LOG level avoid large mertric messages URL: https://github.com/apache/hudi/pull/10516 -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] [HUDI-7309] Disable constructing AND & OR filter predicates when filt… [hudi]

danny0405 commented on code in PR #10524: URL: https://github.com/apache/hudi/pull/10524#discussion_r1456761992 ## hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/source/TestExpressionPredicates.java: ## @@ -164,4 +166,20 @@ public void testFilterPredicateFromExpr

Re: [PR] [HUDI-7308] LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started [hudi]

danny0405 commented on code in PR #10523: URL: https://github.com/apache/hudi/pull/10523#discussion_r1456759621 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/lock/LockManager.java: ## @@ -95,7 +97,10 @@ public void lock() { */ public v

Re: [PR] [HUDI-6902] Try container for Azure tests [hudi]

hudi-bot commented on PR #10525: URL: https://github.com/apache/hudi/pull/10525#issuecomment-1897692985 ## CI report: * 5a1ebfc87621a619c10bbec5d850d1e2c879aaca UNKNOWN * Unknown: [CANCELED](TBD) * fd12f19ece1b5cedc36de67b50eca22e1f38240f UNKNOWN Bot commands

Re: [PR] [HUDI-6902] Containerize the Azure tests [hudi]

hudi-bot commented on PR #10512: URL: https://github.com/apache/hudi/pull/10512#issuecomment-1897692822 ## CI report: * 0e5a63db2337ae435f17eb956460e22caeea65b3 UNKNOWN * 4d759f3b4d6629e738b9b1afe4157c514d6df182 UNKNOWN * a70247f32679a6441cea131e946acce6fd09523e UNKNOWN *

Re: [PR] [HUDI-7308] LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started [hudi]

danny0405 commented on code in PR #10523: URL: https://github.com/apache/hudi/pull/10523#discussion_r1456759141 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/lock/LockManager.java: ## @@ -54,6 +54,7 @@ public class LockManager implements Seri

Re: [I] [SUPPORT] MOR hudi 0.14, Bloom Filters are not being used on query time [hudi]

KnightChess commented on issue #10511: URL: https://github.com/apache/hudi/issues/10511#issuecomment-1897674210 @bk-mz yes, `set hoodie.datasource.query.type = read_optimized` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [PR] [HUDI-6503] Make TableServiceClient's txnManager consistent with Writ… [hudi]

Zouxxyy closed pull request #9255: [HUDI-6503] Make TableServiceClient's txnManager consistent with Writ… URL: https://github.com/apache/hudi/pull/9255 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [PR] [HUDI-6503] Make TableServiceClient's txnManager consistent with Writ… [hudi]

Zouxxyy commented on PR #9255: URL: https://github.com/apache/hudi/pull/9255#issuecomment-1897668441 Close it because it no need, see https://github.com/apache/hudi/pull/9255#issuecomment-1650870862 -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [PR] [HUDI-6503] Make TableServiceClient's txnManager consistent with Writ… [hudi]

Zouxxyy commented on code in PR #9255: URL: https://github.com/apache/hudi/pull/9255#discussion_r1456741819 ## hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/TestHoodieClientMultiWriter.java: ## @@ -481,6 +481,7 @@ public void testMultiWriterWithAsyncTableSe

[PR] [MINOR] Fix flaky testMultiWriterWithAsyncTableServicesWithConflict test [hudi]

Zouxxyy opened a new pull request, #10526: URL: https://github.com/apache/hudi/pull/10526 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performanc

Re: [PR] [HUDI-6902] Try container for Azure tests [hudi]

hudi-bot commented on PR #10525: URL: https://github.com/apache/hudi/pull/10525#issuecomment-1897655904 ## CI report: * 5a1ebfc87621a619c10bbec5d850d1e2c879aaca UNKNOWN * Unknown: [CANCELED](TBD) Bot commands @hudi-bot supports the following commands:

Re: [PR] [HUDI-7309] Disable constructing AND & OR filter predicates when filt… [hudi]

hudi-bot commented on PR #10524: URL: https://github.com/apache/hudi/pull/10524#issuecomment-1897655824 ## CI report: * 9f169afa2be35c4d7a0e462eea578b4bbcd50e3f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7308] LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started [hudi]

hudi-bot commented on PR #10523: URL: https://github.com/apache/hudi/pull/10523#issuecomment-1897655791 ## CI report: * 227a3dde1d6fc187d9d66a88e0480192b1bffa33 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=22

Re: [PR] [HUDI-7305] Fix cast exception for byte/short/float partitioned field [hudi]

hudi-bot commented on PR #10518: URL: https://github.com/apache/hudi/pull/10518#issuecomment-1897655732 ## CI report: * 910c6a7401d89a19c271073665b5ca328b0e50e3 UNKNOWN * 5aa2b8fe26da7ae69c2ef8151f266f323a41dc53 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-6902] Containerize the Azure tests [hudi]

hudi-bot commented on PR #10512: URL: https://github.com/apache/hudi/pull/10512#issuecomment-1897655651 ## CI report: * 0e5a63db2337ae435f17eb956460e22caeea65b3 UNKNOWN * 4d759f3b4d6629e738b9b1afe4157c514d6df182 UNKNOWN * a70247f32679a6441cea131e946acce6fd09523e UNKNOWN *

Re: [PR] [HUDI-6902] Containerize the Azure tests [hudi]

linliu-code commented on PR #10512: URL: https://github.com/apache/hudi/pull/10512#issuecomment-1897654028 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] [HUDI-6902] Try container for Azure tests [hudi]

linliu-code commented on PR #10525: URL: https://github.com/apache/hudi/pull/10525#issuecomment-1897652324 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] [HUDI-6902] Try container for Azure tests [hudi]

hudi-bot commented on PR #10525: URL: https://github.com/apache/hudi/pull/10525#issuecomment-1897647502 ## CI report: * 5a1ebfc87621a619c10bbec5d850d1e2c879aaca UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-7309] Disable constructing AND & OR filter predicates when filt… [hudi]

hudi-bot commented on PR #10524: URL: https://github.com/apache/hudi/pull/10524#issuecomment-1897647473 ## CI report: * 9f169afa2be35c4d7a0e462eea578b4bbcd50e3f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-7305] Fix cast exception for byte/short/float partitioned field [hudi]

hudi-bot commented on PR #10518: URL: https://github.com/apache/hudi/pull/10518#issuecomment-1897647406 ## CI report: * 910c6a7401d89a19c271073665b5ca328b0e50e3 UNKNOWN * 5aa2b8fe26da7ae69c2ef8151f266f323a41dc53 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-6902] Containerize the Azure tests [hudi]

hudi-bot commented on PR #10512: URL: https://github.com/apache/hudi/pull/10512#issuecomment-1897647314 ## CI report: * 0e5a63db2337ae435f17eb956460e22caeea65b3 UNKNOWN * 4d759f3b4d6629e738b9b1afe4157c514d6df182 UNKNOWN * a70247f32679a6441cea131e946acce6fd09523e UNKNOWN *

Re: [PR] [HUDI-7246] Fix Data Skipping Issue: No Results When Query Conditions Involve Both Columns with and without Column Stats [hudi]

hudi-bot commented on PR #10389: URL: https://github.com/apache/hudi/pull/10389#issuecomment-1897647012 ## CI report: * 248df7c04d611c5f521f309732aa21351161fa8b UNKNOWN * c9a0628af1011d68df4f7752520c45802990 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7170] Implement HFile reader independent of HBase [hudi]

yihua commented on code in PR #10241: URL: https://github.com/apache/hudi/pull/10241#discussion_r1456726505 ## hudi-io/src/main/java/org/apache/hudi/io/hfile/HFileReaderImpl.java: ## @@ -0,0 +1,284 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more

Re: [PR] [HUDI-6902] Containerize the Azure tests [hudi]

hudi-bot commented on PR #10512: URL: https://github.com/apache/hudi/pull/10512#issuecomment-1897639920 ## CI report: * 0e5a63db2337ae435f17eb956460e22caeea65b3 UNKNOWN * 4d759f3b4d6629e738b9b1afe4157c514d6df182 UNKNOWN * a70247f32679a6441cea131e946acce6fd09523e UNKNOWN *

Re: [PR] [HUDI-7246] Fix Data Skipping Issue: No Results When Query Conditions Involve Both Columns with and without Column Stats [hudi]

hudi-bot commented on PR #10389: URL: https://github.com/apache/hudi/pull/10389#issuecomment-1897639696 ## CI report: * 248df7c04d611c5f521f309732aa21351161fa8b UNKNOWN * c9a0628af1011d68df4f7752520c45802990 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-6902] Containerize the Azure tests [hudi]

linliu-code commented on PR #10512: URL: https://github.com/apache/hudi/pull/10512#issuecomment-1897631868 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [HUDI-7246] Fix Data Skipping Issue: No Results When Query Conditions Involve Both Columns with and without Column Stats [hudi]

majian1998 commented on PR #10389: URL: https://github.com/apache/hudi/pull/10389#issuecomment-1897630411 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [HUDI-6902] Try container for Azure tests [hudi]

linliu-code commented on PR #10525: URL: https://github.com/apache/hudi/pull/10525#issuecomment-1897630118 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] [HUDI-7144] Build storage partition stats index and use it for data skipping [hudi]

codope commented on PR #10352: URL: https://github.com/apache/hudi/pull/10352#issuecomment-1897624163 > I made one skim of the changes. Can you reply on my previous review comments? esp on tests. @vinothchandar Thanks for the review. I have addressed all your comments. The test was p

Re: [PR] [HUDI-7144] Build storage partition stats index and use it for data skipping [hudi]

codope commented on code in PR #10352: URL: https://github.com/apache/hudi/pull/10352#discussion_r1456714914 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/PartitionStatsIndexTestBase.scala: ## @@ -0,0 +1,259 @@ +/* + * Licensed to the Apache Softw

Re: [PR] [HUDI-7144] Build storage partition stats index and use it for data skipping [hudi]

codope commented on code in PR #10352: URL: https://github.com/apache/hudi/pull/10352#discussion_r1456713310 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/PartitionStatsIndexTestBase.scala: ## @@ -0,0 +1,259 @@ +/* + * Licensed to the Apache Softw

Re: [PR] [HUDI-7144] Build storage partition stats index and use it for data skipping [hudi]

codope commented on code in PR #10352: URL: https://github.com/apache/hudi/pull/10352#discussion_r1456713128 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/PartitionStatsIndexTestBase.scala: ## @@ -0,0 +1,259 @@ +/* + * Licensed to the Apache Softw

Re: [PR] [HUDI-7144] Build storage partition stats index and use it for data skipping [hudi]

codope commented on code in PR #10352: URL: https://github.com/apache/hudi/pull/10352#discussion_r1456712975 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/PartitionStatsIndexTestBase.scala: ## @@ -0,0 +1,259 @@ +/* + * Licensed to the Apache Softw

Re: [PR] [HUDI-7144] Build storage partition stats index and use it for data skipping [hudi]

codope commented on code in PR #10352: URL: https://github.com/apache/hudi/pull/10352#discussion_r1456712604 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/PartitionStatsIndexSupport.scala: ## @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Fo

Re: [PR] [HUDI-7144] Build storage partition stats index and use it for data skipping [hudi]

codope commented on code in PR #10352: URL: https://github.com/apache/hudi/pull/10352#discussion_r1456708282 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java: ## @@ -1901,4 +1909,162 @@ private static Path filePath(String basePath, String parti

  1   2   3   >