Re: [PR] [WIP] [HUDI-6787] Implement the HoodieFileGroupReader API for Hive [hudi]

2024-05-20 Thread via GitHub
codope commented on code in PR #10422: URL: https://github.com/apache/hudi/pull/10422#discussion_r1607649124 ## hudi-common/src/main/java/org/apache/hudi/common/engine/HoodieReaderContext.java: ## @@ -123,10 +129,23 @@ public abstract ClosableIterator getFileRecordIterator(

Re: [PR] [HUDI-7776] Simplify HoodieStorage instance fetching [hudi]

2024-05-20 Thread via GitHub
codope commented on code in PR #11259: URL: https://github.com/apache/hudi/pull/11259#discussion_r1607618163 ## hudi-common/src/main/java/org/apache/hudi/storage/HoodieStorageUtils.java: ## @@ -33,6 +35,13 @@ public static HoodieStorage getStorage(String basePath, StorageConfig

[jira] [Updated] (HUDI-3204) Allow original partition column value to be retrieved when using TimestampBasedKeyGen

2024-05-20 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geser Dugarov updated HUDI-3204: Description: {color:#172b4d}Currently, b/c Spark by default omits partition values from the data fi

[jira] [Comment Edited] (HUDI-7709) Class Cast Exception while reading the data using TimestampBasedKeyGenerator

2024-05-20 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848040#comment-17848040 ] Geser Dugarov edited comment on HUDI-7709 at 5/21/24 4:23 AM: --

[jira] [Comment Edited] (HUDI-7709) Class Cast Exception while reading the data using TimestampBasedKeyGenerator

2024-05-20 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848040#comment-17848040 ] Geser Dugarov edited comment on HUDI-7709 at 5/21/24 4:22 AM: --

[jira] [Commented] (HUDI-7709) Class Cast Exception while reading the data using TimestampBasedKeyGenerator

2024-05-20 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848040#comment-17848040 ] Geser Dugarov commented on HUDI-7709: - The issue related to HUDI-3204. Spark by defaul

[jira] [Updated] (HUDI-7709) Class Cast Exception while reading the data using TimestampBasedKeyGenerator

2024-05-20 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geser Dugarov updated HUDI-7709: Status: In Progress (was: Open) > Class Cast Exception while reading the data using TimestampBasedK

[jira] [Updated] (HUDI-7782) Task not serializable due to DynamoDBBasedLockProvider and HiveMetastoreBasedLockProvider in clean action

2024-05-20 Thread hector (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hector updated HUDI-7782: - Description: Caused by: java.io.NotSerializableException: org.apache.hudi.hive.transaction.lock.HiveMetastoreBase

[jira] [Created] (HUDI-7782) Task not serializable due to DynamoDBBasedLockProvider and HiveMetastoreBasedLockProvider in clean action

2024-05-20 Thread hector (Jira)
hector created HUDI-7782: Summary: Task not serializable due to DynamoDBBasedLockProvider and HiveMetastoreBasedLockProvider in clean action Key: HUDI-7782 URL: https://issues.apache.org/jira/browse/HUDI-7782

[jira] [Assigned] (HUDI-7585) Avoid reading log files for resolving schema for _hoodie_operation field

2024-05-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-7585: --- Assignee: Jing Zhang (was: Danny Chen) > Avoid reading log files for resolving schema for _hoodie_op

[jira] [Closed] (HUDI-7570) Update RFC with details on API changes

2024-05-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7570. --- Resolution: Fixed > Update RFC with details on API changes > -- > >

Re: [I] [SUPPORT]FileID of partition path xxx=xx does not exist. [hudi]

2024-05-20 Thread via GitHub
CaesarWangX commented on issue #11202: URL: https://github.com/apache/hudi/issues/11202#issuecomment-2121555896 Hi @ad1happy2go, Is there any progress? Thank you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [MINOR] avoid listing files for empty tables [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11155: URL: https://github.com/apache/hudi/pull/11155#issuecomment-2121528308 ## CI report: * 83057bf74dc211a7322d704d8711ce5b0c60ae26 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23

Re: [PR] [HUDI-7758] Only consider files in Hudi partitions when initializing MDT [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11219: URL: https://github.com/apache/hudi/pull/11219#issuecomment-2121528499 ## CI report: * 6af15255c4d28bd3661fdb7497849e28dd2906d0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23

Re: [PR] [HUDI-7758] Only consider files in Hudi partitions when initializing MDT [hudi]

2024-05-20 Thread via GitHub
the-other-tim-brown commented on code in PR #11219: URL: https://github.com/apache/hudi/pull/11219#discussion_r1607459267 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java: ## @@ -2000,16 +2000,15 @@ public DirectoryInfo(String relativePath, Lis

Re: [PR] [HUDI-7772] HoodieTimelineArchiver##getCommitInstantsToArchive need skip limiting archiving of instants [hudi]

2024-05-20 Thread via GitHub
danny0405 commented on code in PR #11245: URL: https://github.com/apache/hudi/pull/11245#discussion_r1607433833 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/timeline/HoodieTimelineArchiver.java: ## @@ -217,6 +217,10 @@ private List getCommitInstantsToAr

Re: [PR] [HUDI-7713] Enforce ordering of fields during schema reconciliation [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11154: URL: https://github.com/apache/hudi/pull/11154#issuecomment-2121474964 ## CI report: * 12038dbde068e26f733a7b1c9cc7217019c31f25 UNKNOWN * 2c40dd9ab4d22b2377d8a8e34d221f435dcd8a12 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

(hudi) branch branch-0.x updated: [MINOR] [BRANCH-0.x] Added condition to check default value to fix extracting password from credential store (#11247)

2024-05-20 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/branch-0.x by this push: new 807baeaa7d1 [MINOR] [BRANCH-0.x] Added cond

Re: [PR] [MINOR][TESTING][DNM] 0.15.0 RC1 testing [hudi]

2024-05-20 Thread via GitHub
yihua merged PR #11244: URL: https://github.com/apache/hudi/pull/11244 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o

(hudi) branch branch-0.x updated (2815aef3101 -> 1b975828717)

2024-05-20 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git from 2815aef3101 [HUDI-6386] Branch 0.x failing tests test multi writer archival (#11239) add a04390b89e5 [HUDI-7770

(hudi) branch branch-0.x updated (e0cf1ce147a -> 2815aef3101)

2024-05-20 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git omit e0cf1ce147a [MINOR] [BRANCH-0.x] Added condition to check default value to fix extracting password from credential s

Re: [PR] [HUDI-7777][Stacked on 11259] Allow HoodieTableMetaClient to take HoodieStorage instance directly [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11266: URL: https://github.com/apache/hudi/pull/11266#issuecomment-2121316386 ## CI report: * c77cfae23cd687162e3b306e31104064191382a4 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[jira] [Updated] (HUDI-7777) Allow HoodieTableMetaClient to take HoodieStorage instance directly

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Allow HoodieTableMetaClien

[PR] [HUDI-7777] Allow HoodieTableMetaClient to take HoodieStorage instance directly [hudi]

2024-05-20 Thread via GitHub
yihua opened a new pull request, #11266: URL: https://github.com/apache/hudi/pull/11266 ### Change Logs This PR adds an API to the `HoodieTableMetaClient` builder so it can take `HoodieStorage` instance directly. ### Impact Simplifies Trino Hudi connector integration.

[jira] [Updated] (HUDI-7777) Allow HoodieTableMetaClient to take HoodieStorage instance directly

2024-05-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-: Labels: hoodie-storage (was: ) > Allow HoodieTableMetaClient to take HoodieStorage instance directly > ---

[jira] [Updated] (HUDI-7777) Add function of instantiating HoodieStorage instance to meta client

2024-05-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-: Description: We need to functionality for the meta client to  > Add function of instantiating HoodieStorage

[jira] [Assigned] (HUDI-7777) Allow HoodieTableMetaClient to take HoodieStorage instance directly

2024-05-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-: --- Assignee: Ethan Guo > Allow HoodieTableMetaClient to take HoodieStorage instance directly >

[jira] [Updated] (HUDI-7777) Allow HoodieTableMetaClient to take HoodieStorage instance directly

2024-05-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-: Fix Version/s: 0.15.0 1.0.0 > Allow HoodieTableMetaClient to take HoodieStorage instance

[jira] [Updated] (HUDI-7777) Allow HoodieTableMetaClient to take HoodieStorage instance directly

2024-05-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-: Summary: Allow HoodieTableMetaClient to take HoodieStorage instance directly (was: Add function of instant

Re: [PR] [HUDI-7776] Simplify HoodieStorage instance fetching [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11259: URL: https://github.com/apache/hudi/pull/11259#issuecomment-2121230130 ## CI report: * 24ea42132c66d0526562d86877e979e05245b082 UNKNOWN * e02d4a37c89d621d528ba5466d10364318b309de Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7776] Simplify HoodieStorage instance fetching [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11259: URL: https://github.com/apache/hudi/pull/11259#issuecomment-2121216231 ## CI report: * 24ea42132c66d0526562d86877e979e05245b082 UNKNOWN * e02d4a37c89d621d528ba5466d10364318b309de Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7776] Simplify HoodieStorage instance fetching [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11259: URL: https://github.com/apache/hudi/pull/11259#issuecomment-2121155138 ## CI report: * b889bec75b7bf744cdcca5d441f966fc6fb4e7d5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23

Re: [PR] [HUDI-7776] Simplify HoodieStorage instance fetching [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11259: URL: https://github.com/apache/hudi/pull/11259#issuecomment-2121144593 ## CI report: * b889bec75b7bf744cdcca5d441f966fc6fb4e7d5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23

Re: [I] [SUPPORT] PriorityBasedFileSystemView: Got error running preferred function. Trying secondary [hudi]

2024-05-20 Thread via GitHub
sukumaranb commented on issue #7689: URL: https://github.com/apache/hudi/issues/7689#issuecomment-2121050953 Hi - I am facing the same error in Managed Apache Flink. I noticed only few records are not getting inserted in hudi table because of this issue. Most of the records are successfully

[jira] [Assigned] (HUDI-7774) MercifulJsonConvertor should support Avro logical type

2024-05-20 Thread Davis Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davis Zhang reassigned HUDI-7774: - Assignee: Davis Zhang > MercifulJsonConvertor should support Avro logical type >

Re: [I] issue with reading the data using hudi streamer [hudi]

2024-05-20 Thread via GitHub
ad1happy2go commented on issue #11263: URL: https://github.com/apache/hudi/issues/11263#issuecomment-2120935671 @Pavan792reddy Looks to be the library version conflict between utilities jar and spark bundle. can you check hudi-utilities-slim-bundle_2.12-0.14.0.jar -- This is an automate

Re: [PR] [HUDI-7774] Extend json convertor to support Avro logical type [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11265: URL: https://github.com/apache/hudi/pull/11265#issuecomment-2120885755 ## CI report: * c284b2fce8c40e3c5b7448a6cf2f47f3b5ae50c4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

[jira] [Commented] (HUDI-7774) MercifulJsonConvertor should support Avro logical type

2024-05-20 Thread Davis Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17847935#comment-17847935 ] Davis Zhang commented on HUDI-7774: --- Pull request created https://github.com/apache/hudi

Re: [PR] [HUDI-7774] Extend json convertor to support Avro logical type [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11265: URL: https://github.com/apache/hudi/pull/11265#issuecomment-2120792311 ## CI report: * c284b2fce8c40e3c5b7448a6cf2f47f3b5ae50c4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] [HUDI-7774] Extend json convertor to support Avro logical type [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11265: URL: https://github.com/apache/hudi/pull/11265#issuecomment-2120779703 ## CI report: * c284b2fce8c40e3c5b7448a6cf2f47f3b5ae50c4 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[jira] [Updated] (HUDI-7774) MercifulJsonConvertor should support Avro logical type

2024-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7774: - Labels: pull-request-available (was: ) > MercifulJsonConvertor should support Avro logical type >

[PR] [HUDI-7774] Extend json convertor to support Avro logical type [hudi]

2024-05-20 Thread via GitHub
Davis-Zhang-Onehouse opened a new pull request, #11265: URL: https://github.com/apache/hudi/pull/11265 Extended Merciful json converter to support Time, Date, UUID, Timestamp, LocalTimestamp and Duration. For supported and unsupported converter input please refer unit tests. Test:

Re: [PR] Rebase on lastest Master branch for Logical [hudi]

2024-05-20 Thread via GitHub
Davis-Zhang-Onehouse closed pull request #11264: Rebase on lastest Master branch for Logical URL: https://github.com/apache/hudi/pull/11264 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[jira] [Updated] (HUDI-7774) MercifulJsonConvertor should support Avro logical type

2024-05-20 Thread Davis Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davis Zhang updated HUDI-7774: -- Status: In Progress (was: Open) > MercifulJsonConvertor should support Avro logical type >

[PR] Rebase on lastest Master branch for Logical [hudi]

2024-05-20 Thread via GitHub
Davis-Zhang-Onehouse opened a new pull request, #11264: URL: https://github.com/apache/hudi/pull/11264 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or a

[I] issue with reading the data using hudi streamer [hudi]

2024-05-20 Thread via GitHub
Pavan792reddy opened a new issue, #11263: URL: https://github.com/apache/hudi/issues/11263 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at dev-

(hudi) branch asf-site updated: [DOCS] Add video guides (#11261)

2024-05-20 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 117129dc94c [DOCS] Add video guides (#11261)

Re: [PR] [DOCS][MINOR] Remove events banner [hudi]

2024-05-20 Thread via GitHub
xushiyan merged PR #11262: URL: https://github.com/apache/hudi/pull/11262 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apach

(hudi) branch asf-site updated: [DOCS][MINOR] Remove events banner (#11262)

2024-05-20 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new cc5951809e8 [DOCS][MINOR] Remove events bann

Re: [PR] [DOCS] Add video guides [hudi]

2024-05-20 Thread via GitHub
xushiyan merged PR #11261: URL: https://github.com/apache/hudi/pull/11261 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apach

Re: [I] [SUPPORT] During the process of ingesting data from Kafka and persisting it into a Hudi MOR table, an Out of Memory exception was encountered [hudi]

2024-05-20 Thread via GitHub
hdygxsj closed issue #10929: [SUPPORT] During the process of ingesting data from Kafka and persisting it into a Hudi MOR table, an Out of Memory exception was encountered URL: https://github.com/apache/hudi/issues/10929 -- This is an automated message from the Apache Git Service. To respond

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2120437419 ## CI report: * 96b10a6c9a2457512cbe8bb33bb974496aa515c0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] [HUDI-7146] Implement secondary index write path [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11146: URL: https://github.com/apache/hudi/pull/11146#issuecomment-2120351007 ## CI report: * 4c02510ba3b23cb7d7feffbb2c6850c038d6103a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] [DOCS][MINOR] Remove events banner [hudi]

2024-05-20 Thread via GitHub
bhasudha commented on PR #11262: URL: https://github.com/apache/hudi/pull/11262#issuecomment-2120328074 Tested locally to verify that no event banner is displayed. https://github.com/apache/hudi/assets/2179254/6b594ee3-cd6b-44ea-88f9-914029bfcdf0";> -- This is an automated messa

[PR] [DOCS][MINOR] Remove events banner [hudi]

2024-05-20 Thread via GitHub
bhasudha opened a new pull request, #11262: URL: https://github.com/apache/hudi/pull/11262 ### Change Logs remove event banner ### Impact site changes ### Risk level (write none, low medium or high below) none ### Documentation Update _Describe

Re: [PR] [DOCS][MINOR] Remove events banner [hudi]

2024-05-20 Thread via GitHub
bhasudha commented on PR #11262: URL: https://github.com/apache/hudi/pull/11262#issuecomment-2120325630 Removing the event banner of a previous event. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] [DOCS] Add video guides [hudi]

2024-05-20 Thread via GitHub
bhasudha commented on PR #11261: URL: https://github.com/apache/hudi/pull/11261#issuecomment-2120321693 Tested locally. Images usually show up after merging the pr and not while testing. https://github.com/apache/hudi/assets/2179254/58bbcc57-26a6-452a-8d50-1fb1968f8193";> -- Th

[PR] [DOCS] Add video guides [hudi]

2024-05-20 Thread via GitHub
bhasudha opened a new pull request, #11261: URL: https://github.com/apache/hudi/pull/11261 ### Change Logs Adding video guides ### Impact site changes ### Risk level (write none, low medium or high below) none ### Documentation Update _Describe

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2120260409 ## CI report: * 1c2c253f3316324240407570d8f1e063773bddd7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] [HUDI-7146] Implement secondary index write path [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11146: URL: https://github.com/apache/hudi/pull/11146#issuecomment-2120260006 ## CI report: * 420b19219080b2935b3a37442db7ed22816466af Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2120242139 ## CI report: * 1c2c253f3316324240407570d8f1e063773bddd7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] [HUDI-7146] Implement secondary index write path [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11146: URL: https://github.com/apache/hudi/pull/11146#issuecomment-2120241948 ## CI report: * 420b19219080b2935b3a37442db7ed22816466af Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2119929616 ## CI report: * 1c2c253f3316324240407570d8f1e063773bddd7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] [HUDI-7772] HoodieTimelineArchiver##getCommitInstantsToArchive need skip limiting archiving of instants [hudi]

2024-05-20 Thread via GitHub
xuzifu666 commented on code in PR #11245: URL: https://github.com/apache/hudi/pull/11245#discussion_r1606420083 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/timeline/HoodieTimelineArchiver.java: ## @@ -217,6 +217,10 @@ private List getCommitInstantsToAr

Re: [PR] [HUDI-7781] Filter wrong partitions when using hoodie.datasource.write.partitions.to.delete [hudi]

2024-05-20 Thread via GitHub
danny0405 commented on PR #11260: URL: https://github.com/apache/hudi/pull/11260#issuecomment-2119898699 > This looks good, but for example, such as third-level partitions, dt, hh, mm, if user configures `dt=1/mm=1` do we need to help the user configure as `dt=1/hh=*/mm=1`? I'm +1 on

Re: [PR] [HUDI-7772] HoodieTimelineArchiver##getCommitInstantsToArchive need skip limiting archiving of instants [hudi]

2024-05-20 Thread via GitHub
danny0405 commented on code in PR #11245: URL: https://github.com/apache/hudi/pull/11245#discussion_r1606403731 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/timeline/HoodieTimelineArchiver.java: ## @@ -217,6 +217,10 @@ private List getCommitInstantsToAr

[jira] [Closed] (HUDI-6207) Files pruning for bucket index table pk filtering queries using Spark SQL

2024-05-20 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-6207. Resolution: Fixed Fixed via master branch: 74308cdbd24bcf6c4836249b6abdf4d75ae492b8 > Files pruning for bu

[jira] [Updated] (HUDI-6207) Files pruning for bucket index table pk filtering queries using Spark SQL

2024-05-20 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-6207: - Fix Version/s: 1.0.0 > Files pruning for bucket index table pk filtering queries using Spark SQL > --

(hudi) branch master updated: [HUDI-6207] Spark bucket index query pruning (#10191)

2024-05-20 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 74308cdbd24 [HUDI-6207] Spark bucket index quer

Re: [PR] [HUDI-6207] Spark bucket index query pruning [hudi]

2024-05-20 Thread via GitHub
danny0405 merged PR #10191: URL: https://github.com/apache/hudi/pull/10191 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apac

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2119834319 ## CI report: * afa509c76da8cd4215d962749620fb9896f564ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2119821666 ## CI report: * afa509c76da8cd4215d962749620fb9896f564ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24

Re: [PR] [HUDI-7146] Integrate secondary index on reader path [hudi]

2024-05-20 Thread via GitHub
hudi-bot commented on PR #11162: URL: https://github.com/apache/hudi/pull/11162#issuecomment-2119810460 ## CI report: * afa509c76da8cd4215d962749620fb9896f564ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24