codope commented on code in PR #10422:
URL: https://github.com/apache/hudi/pull/10422#discussion_r1607649124
##
hudi-common/src/main/java/org/apache/hudi/common/engine/HoodieReaderContext.java:
##
@@ -123,10 +129,23 @@ public abstract ClosableIterator getFileRecordIterator(
codope commented on code in PR #11259:
URL: https://github.com/apache/hudi/pull/11259#discussion_r1607618163
##
hudi-common/src/main/java/org/apache/hudi/storage/HoodieStorageUtils.java:
##
@@ -33,6 +35,13 @@ public static HoodieStorage getStorage(String basePath,
StorageConfig
[
https://issues.apache.org/jira/browse/HUDI-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Geser Dugarov updated HUDI-3204:
Description:
{color:#172b4d}Currently, b/c Spark by default omits partition values from the
data fi
[
https://issues.apache.org/jira/browse/HUDI-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848040#comment-17848040
]
Geser Dugarov edited comment on HUDI-7709 at 5/21/24 4:23 AM:
--
[
https://issues.apache.org/jira/browse/HUDI-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848040#comment-17848040
]
Geser Dugarov edited comment on HUDI-7709 at 5/21/24 4:22 AM:
--
[
https://issues.apache.org/jira/browse/HUDI-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848040#comment-17848040
]
Geser Dugarov commented on HUDI-7709:
-
The issue related to HUDI-3204. Spark by defaul
[
https://issues.apache.org/jira/browse/HUDI-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Geser Dugarov updated HUDI-7709:
Status: In Progress (was: Open)
> Class Cast Exception while reading the data using TimestampBasedK
[
https://issues.apache.org/jira/browse/HUDI-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hector updated HUDI-7782:
-
Description:
Caused by: java.io.NotSerializableException:
org.apache.hudi.hive.transaction.lock.HiveMetastoreBase
hector created HUDI-7782:
Summary: Task not serializable due to DynamoDBBasedLockProvider
and HiveMetastoreBasedLockProvider in clean action
Key: HUDI-7782
URL: https://issues.apache.org/jira/browse/HUDI-7782
[
https://issues.apache.org/jira/browse/HUDI-7585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo reassigned HUDI-7585:
---
Assignee: Jing Zhang (was: Danny Chen)
> Avoid reading log files for resolving schema for _hoodie_op
[
https://issues.apache.org/jira/browse/HUDI-7570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo closed HUDI-7570.
---
Resolution: Fixed
> Update RFC with details on API changes
> --
>
>
CaesarWangX commented on issue #11202:
URL: https://github.com/apache/hudi/issues/11202#issuecomment-2121555896
Hi @ad1happy2go, Is there any progress? Thank you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
hudi-bot commented on PR #11155:
URL: https://github.com/apache/hudi/pull/11155#issuecomment-2121528308
## CI report:
* 83057bf74dc211a7322d704d8711ce5b0c60ae26 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23
hudi-bot commented on PR #11219:
URL: https://github.com/apache/hudi/pull/11219#issuecomment-2121528499
## CI report:
* 6af15255c4d28bd3661fdb7497849e28dd2906d0 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23
the-other-tim-brown commented on code in PR #11219:
URL: https://github.com/apache/hudi/pull/11219#discussion_r1607459267
##
hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java:
##
@@ -2000,16 +2000,15 @@ public DirectoryInfo(String relativePath,
Lis
danny0405 commented on code in PR #11245:
URL: https://github.com/apache/hudi/pull/11245#discussion_r1607433833
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/timeline/HoodieTimelineArchiver.java:
##
@@ -217,6 +217,10 @@ private List getCommitInstantsToAr
hudi-bot commented on PR #11154:
URL: https://github.com/apache/hudi/pull/11154#issuecomment-2121474964
## CI report:
* 12038dbde068e26f733a7b1c9cc7217019c31f25 UNKNOWN
* 2c40dd9ab4d22b2377d8a8e34d221f435dcd8a12 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a commit to branch branch-0.x
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/branch-0.x by this push:
new 807baeaa7d1 [MINOR] [BRANCH-0.x] Added cond
yihua merged PR #11244:
URL: https://github.com/apache/hudi/pull/11244
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a change to branch branch-0.x
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 2815aef3101 [HUDI-6386] Branch 0.x failing tests test multi writer
archival (#11239)
add a04390b89e5 [HUDI-7770
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a change to branch branch-0.x
in repository https://gitbox.apache.org/repos/asf/hudi.git
omit e0cf1ce147a [MINOR] [BRANCH-0.x] Added condition to check default
value to fix extracting password from credential s
hudi-bot commented on PR #11266:
URL: https://github.com/apache/hudi/pull/11266#issuecomment-2121316386
## CI report:
* c77cfae23cd687162e3b306e31104064191382a4 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run th
[
https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-:
-
Labels: hoodie-storage pull-request-available (was: hoodie-storage)
> Allow HoodieTableMetaClien
yihua opened a new pull request, #11266:
URL: https://github.com/apache/hudi/pull/11266
### Change Logs
This PR adds an API to the `HoodieTableMetaClient` builder so it can take
`HoodieStorage` instance directly.
### Impact
Simplifies Trino Hudi connector integration.
[
https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-:
Labels: hoodie-storage (was: )
> Allow HoodieTableMetaClient to take HoodieStorage instance directly
> ---
[
https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-:
Description: We need to functionality for the meta client to
> Add function of instantiating HoodieStorage
[
https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo reassigned HUDI-:
---
Assignee: Ethan Guo
> Allow HoodieTableMetaClient to take HoodieStorage instance directly
>
[
https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-:
Fix Version/s: 0.15.0
1.0.0
> Allow HoodieTableMetaClient to take HoodieStorage instance
[
https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-:
Summary: Allow HoodieTableMetaClient to take HoodieStorage instance
directly (was: Add function of instant
hudi-bot commented on PR #11259:
URL: https://github.com/apache/hudi/pull/11259#issuecomment-2121230130
## CI report:
* 24ea42132c66d0526562d86877e979e05245b082 UNKNOWN
* e02d4a37c89d621d528ba5466d10364318b309de Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4
hudi-bot commented on PR #11259:
URL: https://github.com/apache/hudi/pull/11259#issuecomment-2121216231
## CI report:
* 24ea42132c66d0526562d86877e979e05245b082 UNKNOWN
* e02d4a37c89d621d528ba5466d10364318b309de Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4
hudi-bot commented on PR #11259:
URL: https://github.com/apache/hudi/pull/11259#issuecomment-2121155138
## CI report:
* b889bec75b7bf744cdcca5d441f966fc6fb4e7d5 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23
hudi-bot commented on PR #11259:
URL: https://github.com/apache/hudi/pull/11259#issuecomment-2121144593
## CI report:
* b889bec75b7bf744cdcca5d441f966fc6fb4e7d5 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23
sukumaranb commented on issue #7689:
URL: https://github.com/apache/hudi/issues/7689#issuecomment-2121050953
Hi - I am facing the same error in Managed Apache Flink. I noticed only few
records are not getting inserted in hudi table because of this issue. Most of
the records are successfully
[
https://issues.apache.org/jira/browse/HUDI-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Zhang reassigned HUDI-7774:
-
Assignee: Davis Zhang
> MercifulJsonConvertor should support Avro logical type
>
ad1happy2go commented on issue #11263:
URL: https://github.com/apache/hudi/issues/11263#issuecomment-2120935671
@Pavan792reddy Looks to be the library version conflict between utilities
jar and spark bundle. can you check hudi-utilities-slim-bundle_2.12-0.14.0.jar
--
This is an automate
hudi-bot commented on PR #11265:
URL: https://github.com/apache/hudi/pull/11265#issuecomment-2120885755
## CI report:
* c284b2fce8c40e3c5b7448a6cf2f47f3b5ae50c4 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24
[
https://issues.apache.org/jira/browse/HUDI-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17847935#comment-17847935
]
Davis Zhang commented on HUDI-7774:
---
Pull request created https://github.com/apache/hudi
hudi-bot commented on PR #11265:
URL: https://github.com/apache/hudi/pull/11265#issuecomment-2120792311
## CI report:
* c284b2fce8c40e3c5b7448a6cf2f47f3b5ae50c4 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24
hudi-bot commented on PR #11265:
URL: https://github.com/apache/hudi/pull/11265#issuecomment-2120779703
## CI report:
* c284b2fce8c40e3c5b7448a6cf2f47f3b5ae50c4 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run th
[
https://issues.apache.org/jira/browse/HUDI-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-7774:
-
Labels: pull-request-available (was: )
> MercifulJsonConvertor should support Avro logical type
>
Davis-Zhang-Onehouse opened a new pull request, #11265:
URL: https://github.com/apache/hudi/pull/11265
Extended Merciful json converter to support Time, Date, UUID, Timestamp,
LocalTimestamp and Duration. For supported and unsupported converter input
please refer unit tests.
Test:
Davis-Zhang-Onehouse closed pull request #11264: Rebase on lastest Master
branch for Logical
URL: https://github.com/apache/hudi/pull/11264
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specif
[
https://issues.apache.org/jira/browse/HUDI-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Zhang updated HUDI-7774:
--
Status: In Progress (was: Open)
> MercifulJsonConvertor should support Avro logical type
>
Davis-Zhang-Onehouse opened a new pull request, #11264:
URL: https://github.com/apache/hudi/pull/11264
### Change Logs
_Describe context and summary for this change. Highlight if any code was
copied._
### Impact
_Describe any public API or user-facing feature change or a
Pavan792reddy opened a new issue, #11263:
URL: https://github.com/apache/hudi/issues/11263
**_Tips before filing an issue_**
- Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?
- Join the mailing list to engage in conversations and get faster support at
dev-
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 117129dc94c [DOCS] Add video guides (#11261)
xushiyan merged PR #11262:
URL: https://github.com/apache/hudi/pull/11262
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apach
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new cc5951809e8 [DOCS][MINOR] Remove events bann
xushiyan merged PR #11261:
URL: https://github.com/apache/hudi/pull/11261
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apach
hdygxsj closed issue #10929: [SUPPORT] During the process of ingesting data
from Kafka and persisting it into a Hudi MOR table, an Out of Memory exception
was encountered
URL: https://github.com/apache/hudi/issues/10929
--
This is an automated message from the Apache Git Service.
To respond
hudi-bot commented on PR #11162:
URL: https://github.com/apache/hudi/pull/11162#issuecomment-2120437419
## CI report:
* 96b10a6c9a2457512cbe8bb33bb974496aa515c0 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24
hudi-bot commented on PR #11146:
URL: https://github.com/apache/hudi/pull/11146#issuecomment-2120351007
## CI report:
* 4c02510ba3b23cb7d7feffbb2c6850c038d6103a Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24
bhasudha commented on PR #11262:
URL: https://github.com/apache/hudi/pull/11262#issuecomment-2120328074
Tested locally to verify that no event banner is displayed.
https://github.com/apache/hudi/assets/2179254/6b594ee3-cd6b-44ea-88f9-914029bfcdf0";>
--
This is an automated messa
bhasudha opened a new pull request, #11262:
URL: https://github.com/apache/hudi/pull/11262
### Change Logs
remove event banner
### Impact
site changes
### Risk level (write none, low medium or high below)
none
### Documentation Update
_Describe
bhasudha commented on PR #11262:
URL: https://github.com/apache/hudi/pull/11262#issuecomment-2120325630
Removing the event banner of a previous event.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
bhasudha commented on PR #11261:
URL: https://github.com/apache/hudi/pull/11261#issuecomment-2120321693
Tested locally. Images usually show up after merging the pr and not while
testing.
https://github.com/apache/hudi/assets/2179254/58bbcc57-26a6-452a-8d50-1fb1968f8193";>
--
Th
bhasudha opened a new pull request, #11261:
URL: https://github.com/apache/hudi/pull/11261
### Change Logs
Adding video guides
### Impact
site changes
### Risk level (write none, low medium or high below)
none
### Documentation Update
_Describe
hudi-bot commented on PR #11162:
URL: https://github.com/apache/hudi/pull/11162#issuecomment-2120260409
## CI report:
* 1c2c253f3316324240407570d8f1e063773bddd7 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24
hudi-bot commented on PR #11146:
URL: https://github.com/apache/hudi/pull/11146#issuecomment-2120260006
## CI report:
* 420b19219080b2935b3a37442db7ed22816466af Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23
hudi-bot commented on PR #11162:
URL: https://github.com/apache/hudi/pull/11162#issuecomment-2120242139
## CI report:
* 1c2c253f3316324240407570d8f1e063773bddd7 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24
hudi-bot commented on PR #11146:
URL: https://github.com/apache/hudi/pull/11146#issuecomment-2120241948
## CI report:
* 420b19219080b2935b3a37442db7ed22816466af Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=23
hudi-bot commented on PR #11162:
URL: https://github.com/apache/hudi/pull/11162#issuecomment-2119929616
## CI report:
* 1c2c253f3316324240407570d8f1e063773bddd7 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24
xuzifu666 commented on code in PR #11245:
URL: https://github.com/apache/hudi/pull/11245#discussion_r1606420083
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/timeline/HoodieTimelineArchiver.java:
##
@@ -217,6 +217,10 @@ private List getCommitInstantsToAr
danny0405 commented on PR #11260:
URL: https://github.com/apache/hudi/pull/11260#issuecomment-2119898699
> This looks good, but for example, such as third-level partitions, dt, hh,
mm, if user configures `dt=1/mm=1` do we need to help the user configure as
`dt=1/hh=*/mm=1`?
I'm +1 on
danny0405 commented on code in PR #11245:
URL: https://github.com/apache/hudi/pull/11245#discussion_r1606403731
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/timeline/HoodieTimelineArchiver.java:
##
@@ -217,6 +217,10 @@ private List getCommitInstantsToAr
[
https://issues.apache.org/jira/browse/HUDI-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen closed HUDI-6207.
Resolution: Fixed
Fixed via master branch: 74308cdbd24bcf6c4836249b6abdf4d75ae492b8
> Files pruning for bu
[
https://issues.apache.org/jira/browse/HUDI-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen updated HUDI-6207:
-
Fix Version/s: 1.0.0
> Files pruning for bucket index table pk filtering queries using Spark SQL
> --
This is an automated email from the ASF dual-hosted git repository.
danny0405 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 74308cdbd24 [HUDI-6207] Spark bucket index quer
danny0405 merged PR #10191:
URL: https://github.com/apache/hudi/pull/10191
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apac
hudi-bot commented on PR #11162:
URL: https://github.com/apache/hudi/pull/11162#issuecomment-2119834319
## CI report:
* afa509c76da8cd4215d962749620fb9896f564ea Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24
hudi-bot commented on PR #11162:
URL: https://github.com/apache/hudi/pull/11162#issuecomment-2119821666
## CI report:
* afa509c76da8cd4215d962749620fb9896f564ea Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24
hudi-bot commented on PR #11162:
URL: https://github.com/apache/hudi/pull/11162#issuecomment-2119810460
## CI report:
* afa509c76da8cd4215d962749620fb9896f564ea Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=24
73 matches
Mail list logo