yihua commented on code in PR #11628:
URL: https://github.com/apache/hudi/pull/11628#discussion_r1693873977
##
packaging/hudi-cli-bundle/hudi-cli-with-bundle.sh:
##
@@ -38,9 +38,15 @@ HUDI_CONF_DIR="${DIR}"/conf
HUDI_AUX_LIB="${DIR}"/auxlib
if [ ! -d $HUDI_AUX_LIB ]; then
-
yihua commented on code in PR #11664:
URL: https://github.com/apache/hudi/pull/11664#discussion_r1693866004
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/config/KafkaSourceConfig.java:
##
@@ -66,14 +66,6 @@ public class KafkaSourceConfig extends HoodieConfig {
yihua commented on code in PR #11692:
URL: https://github.com/apache/hudi/pull/11692#discussion_r1693859325
##
.github/workflows/release_candidate_validation.yml:
##
@@ -46,18 +46,6 @@ jobs:
flinkProfile: 'flink1.16'
sparkProfile: 'spark3.3'
Toroidals opened a new issue, #11694:
URL: https://github.com/apache/hudi/issues/11694
**_Tips before filing an issue_**
- Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? yes
- Join the mailing list to engage in conversations and get faster support at
dev-
hudi-bot commented on PR #11693:
URL: https://github.com/apache/hudi/pull/11693#issuecomment-2253755540
## CI report:
* f7e6d57194be5337faf1524b5adb8e0773e1ff9d Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=25
hudi-bot commented on PR #11693:
URL: https://github.com/apache/hudi/pull/11693#issuecomment-2253722059
## CI report:
* 387d2559c02e163e261ae82991ce45e2b8bf2afe Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=25
KnightChess commented on issue #11583:
URL: https://github.com/apache/hudi/issues/11583#issuecomment-2253721916
@neerajpadarthi can you try version 0.13.0 or above, analyer will fetch all
partition in 0.11.0 I think. https://issues.apache.org/jira/browse/HUDI-4812
--
This is an automated
[
https://issues.apache.org/jira/browse/HUDI-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-8029:
-
Labels: pull-request-available (was: )
> Implicit partition key dynamo db lock provider should en
hudi-bot commented on PR #11693:
URL: https://github.com/apache/hudi/pull/11693#issuecomment-2253720350
## CI report:
* 387d2559c02e163e261ae82991ce45e2b8bf2afe Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=25
KnightChess commented on code in PR #11605:
URL: https://github.com/apache/hudi/pull/11605#discussion_r1693728265
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/clean/CleanPlanActionExecutor.java:
##
@@ -97,6 +99,64 @@ private boolean needsCleaning(
KnightChess commented on code in PR #11605:
URL: https://github.com/apache/hudi/pull/11605#discussion_r1693728107
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/clean/CleanPlanActionExecutor.java:
##
@@ -97,6 +99,64 @@ private boolean needsCleaning(
KnightChess commented on issue #11684:
URL: https://github.com/apache/hudi/issues/11684#issuecomment-2253707003
@Jason-liujc I think we cannot confirm at runtime that the deleted files
were necessarily deleted by the cleanup service. The reasons for deletion could
be varied, requiring more
KnightChess commented on issue #11680:
URL: https://github.com/apache/hudi/issues/11680#issuecomment-2253705017
can you check the running time for every task in these two stage between
other day batch? And is the available resources normal? I found only 25 task
running.
 were added to refs/heads/asf-site by this push:
new 08032842fbf [HUDI-6191][DOCS] Improve passi
danny0405 merged PR #11690:
URL: https://github.com/apache/hudi/pull/11690
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apac
danny0405 commented on PR #11691:
URL: https://github.com/apache/hudi/pull/11691#issuecomment-2253687593
@dongtingting Thanks for the contribution, would you mind to take care of
the test failures?
--
This is an automated message from the Apache Git Service.
To respond to the message, ple
hudi-bot commented on PR #11693:
URL: https://github.com/apache/hudi/pull/11693#issuecomment-2253684744
## CI report:
* 96ec97e422306b86b5b6557feb6385d46fd05c15 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=25
hudi-bot commented on PR #11693:
URL: https://github.com/apache/hudi/pull/11693#issuecomment-2253682116
## CI report:
* 96ec97e422306b86b5b6557feb6385d46fd05c15 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run th
Davis-Zhang-Onehouse opened a new pull request, #11693:
URL: https://github.com/apache/hudi/pull/11693
DynamoDBBasedImplicitPartitionKeyLockProvider as a lock provider derives its
partition key from hudi table name and hudi table base path. Considering the s3
uri can be of prefix s3:// or s
[
https://issues.apache.org/jira/browse/HUDI-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo closed HUDI-7837.
---
Resolution: Fixed
> Cut docs for release 0.15.0
> ---
>
> Key: HUDI-78
[
https://issues.apache.org/jira/browse/HUDI-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869053#comment-17869053
]
Ethan Guo commented on HUDI-7837:
-
https://github.com/apache/hudi/pull/11475
> Cut docs f
Davis Zhang created HUDI-8029:
-
Summary: Implicit partition key dynamo db lock provider should
enforce s3 prefix over s3 uri
Key: HUDI-8029
URL: https://issues.apache.org/jira/browse/HUDI-8029
Project: Ap
[
https://issues.apache.org/jira/browse/HUDI-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davis Zhang reassigned HUDI-8029:
-
Assignee: Davis Zhang
> Implicit partition key dynamo db lock provider should enforce s3 prefix o
Jason-liujc commented on issue #11684:
URL: https://github.com/apache/hudi/issues/11684#issuecomment-2253576047
incremental query option:
```
Map(hoodie.datasource.query.type -> incremental,
hoodie.datasource.read.begin.instanttime -> 2024072407000,
hoodie.datasource.read.end.inst
Jason-liujc commented on issue #10029:
URL: https://github.com/apache/hudi/issues/10029#issuecomment-2253533412
We ran into this issue without doing any Hudi upgrades.
Seeing similar stack trace:
```
Caused by: org.apache.hudi.exception.HoodieException:
org.apache.hudi.exceptio
hudi-bot commented on PR #11692:
URL: https://github.com/apache/hudi/pull/11692#issuecomment-2253295439
## CI report:
* b560a28cb9b547dd84d70271f035afb94daa UNKNOWN
* 5032e266a8d99020771a5def2d72e41ba240257c Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4
hudi-bot commented on PR #11692:
URL: https://github.com/apache/hudi/pull/11692#issuecomment-2253284743
## CI report:
* b560a28cb9b547dd84d70271f035afb94daa UNKNOWN
* 91af8a6b0b7ff4885c31cbd694ba293c6536408e Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4
Shiyan Xu created HUDI-8028:
---
Summary: Make hudi-common jar to support some newer spark/flink
versions
Key: HUDI-8028
URL: https://issues.apache.org/jira/browse/HUDI-8028
Project: Apache Hudi
Issu
hudi-bot commented on PR #11692:
URL: https://github.com/apache/hudi/pull/11692#issuecomment-2253226167
## CI report:
* b560a28cb9b547dd84d70271f035afb94daa UNKNOWN
* 91af8a6b0b7ff4885c31cbd694ba293c6536408e Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4
hudi-bot commented on PR #11692:
URL: https://github.com/apache/hudi/pull/11692#issuecomment-2253215916
## CI report:
* b560a28cb9b547dd84d70271f035afb94daa UNKNOWN
* 91af8a6b0b7ff4885c31cbd694ba293c6536408e UNKNOWN
Bot commands
@hudi-bot supports the followi
hudi-bot commented on PR #11692:
URL: https://github.com/apache/hudi/pull/11692#issuecomment-2253204885
## CI report:
* b560a28cb9b547dd84d70271f035afb94daa UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run th
jonvex closed pull request #11523: [HUDI-7918] Remove support of Spark 2, 3.0,
3.1, and 3.2
URL: https://github.com/apache/hudi/pull/11523
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specifi
jonvex commented on code in PR #11692:
URL: https://github.com/apache/hudi/pull/11692#discussion_r1693370415
##
hudi-spark-datasource/hudi-spark3-common/src/main/java/org/apache/hudi/spark3/internal/ReflectUtil.java:
##
@@ -29,17 +27,10 @@ public class ReflectUtil {
public st
[
https://issues.apache.org/jira/browse/HUDI-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-7918:
-
Labels: pull-request-available (was: )
> Remove support of Spark 2, 3.0, 3.1, and 3.2
> -
jonvex opened a new pull request, #11692:
URL: https://github.com/apache/hudi/pull/11692
### Change Logs
remove support for spark 3.0, 3.1, and 3.2
don't remove support for spark 2 yet
### Impact
make maintaining project easier
### Risk level (write none, low me
ad1happy2go commented on issue #11680:
URL: https://github.com/apache/hudi/issues/11680#issuecomment-2253043140
@nb Are you on Apache Hudi Slack, can we connect on this? Let me know
your username or reach me there (Aditya Goenka)
--
This is an automated message from the Apache Git Ser
ad1happy2go closed issue #11687: [SUPPORT] spark-sql write the table fail witch
was created by flink-sql with HoodieHiveCatalog and the error is:Config
conflict(key current value existing value): PreCombineKey: ts
URL: https://github.com/apache/hudi/issues/11687
--
This is an automated mes
soumilshah1995 commented on PR #11509:
URL: https://github.com/apache/hudi/pull/11509#issuecomment-2253034825
Test verified and works as expected thank you everyone
https://github.com/apache/hudi/issues/10644#event-13663036439
--
This is an automated message from the Apache Git Ser
soumilshah1995 commented on issue #10644:
URL: https://github.com/apache/hudi/issues/10644#issuecomment-2253027370
tested with Master Branch
Test passed
```
spark-submit \
--class org.apache.hudi.utilities.HoodieSnapshotExporter \
--packages org.apache.hudi:hu
soumilshah1995 closed issue #10644: [FeatureRequest] Inquiry Regarding Hudi
Exporter with SQL Transformer for Data Filtering
URL: https://github.com/apache/hudi/issues/10644
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
hudi-bot commented on PR #11691:
URL: https://github.com/apache/hudi/pull/11691#issuecomment-2252943716
## CI report:
* a57d0676562e9c4804571a4f869038d7197fe1c4 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=25
ad1happy2go commented on issue #11687:
URL: https://github.com/apache/hudi/issues/11687#issuecomment-2252843620
Thanks @wardlican . Closing this issue. Please reopen in case of any other
issues. Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message
hudi-bot commented on PR #11691:
URL: https://github.com/apache/hudi/pull/11691#issuecomment-2252825332
## CI report:
* a57d0676562e9c4804571a4f869038d7197fe1c4 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=25
soumilshah1995 commented on issue #10110:
URL: https://github.com/apache/hudi/issues/10110#issuecomment-2252804125
agar, could you guide me on which metrics I should focus on? Specifically,
should I be looking at query execution time or the total amount of data
scanned? What are the key met
hudi-bot commented on PR #11691:
URL: https://github.com/apache/hudi/pull/11691#issuecomment-2252801575
## CI report:
* a57d0676562e9c4804571a4f869038d7197fe1c4 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run th
dongtingting commented on issue #11516:
URL: https://github.com/apache/hudi/issues/11516#issuecomment-2252729302
> Based on the variable name `compactionAndClusteringPendingTimeline`, it
looks like your fix is reasonable.
I have fix it in https://github.com/apache/hudi/pull/11691 , ca
dongtingting opened a new pull request, #11691:
URL: https://github.com/apache/hudi/pull/11691
### Change Logs
Because replacecommit can be clustering, insert overwrite and delete
partition. In SimpleConcurrentFileWritesConflictResolutionStrategy funciton
getCandidateInstants, he
muyihao commented on issue #5:
URL: https://github.com/apache/hudi-rs/issues/5#issuecomment-2252562474
@xushiyan Yes, I am currently working on this issue. I will provide updates
as I make progress. Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the
xiarixiaoyao commented on code in PR #11559:
URL: https://github.com/apache/hudi/pull/11559#discussion_r1692704221
##
rfc/rfc-80/rfc-80.md:
##
@@ -0,0 +1,158 @@
+
+# RFC-80: Support column families for wide tbles
+
+## Proposers
+
+- @xiarixiaoyao
+- @wombatu-kun
+
+## Approvers
abyssnlp commented on issue #81:
URL: https://github.com/apache/hudi-rs/issues/81#issuecomment-2252227455
Sure, so at a high level:
- Spin up minio via `testcontainers` before running the integration tests
- Setup mino object storage with s3, gs and create the test hudi table
- Run m
xushiyan closed issue #84: Configure workflows to avoid running tests when
changes are not relevant
URL: https://github.com/apache/hudi-rs/issues/84
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to t
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/hudi-rs.git
The following commit(s) were added to refs/heads/main by this push:
new 3e71bb0 ci: add path ignore files for ci workflo
xushiyan merged PR #93:
URL: https://github.com/apache/hudi-rs/pull/93
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o
codecov[bot] commented on PR #93:
URL: https://github.com/apache/hudi-rs/pull/93#issuecomment-2252223145
##
[Codecov](https://app.codecov.io/gh/apache/hudi-rs/pull/93?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ap
abyssnlp commented on code in PR #93:
URL: https://github.com/apache/hudi-rs/pull/93#discussion_r1692676588
##
.github/workflows/ci.yml:
##
@@ -22,9 +22,17 @@ on:
branches:
- main
- release/**
+paths:
+ - 'python/**'
+ - '!python/Makefile'
+
dependabot[bot] opened a new pull request, #99:
URL: https://github.com/apache/hudi-rs/pull/99
Updates the requirements on
[datafusion](https://github.com/apache/datafusion) to permit the latest version.
Commits
See full diff in https://github.com/apache/datafusion/compare/39.0
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/datafusion-common-40.0.0
in repository https://gitbox.apache.org/repos/asf/hudi-rs.git
at b78a36f build(deps): update datafusion-common requirement from 39.0.0
to 40.
dependabot[bot] opened a new pull request, #97:
URL: https://github.com/apache/hudi-rs/pull/97
Updates the requirements on
[datafusion-expr](https://github.com/apache/datafusion) to permit the latest
version.
Commits
See full diff in https://github.com/apache/datafusion/compar
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/datafusion-expr-40.0.0
in repository https://gitbox.apache.org/repos/asf/hudi-rs.git
at 91c7e15 build(deps): update datafusion-expr requirement from 39.0.0
to 40.0.0
[
https://issues.apache.org/jira/browse/HUDI-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vova Kolmakov reassigned HUDI-7843:
---
Assignee: Vova Kolmakov
> Support record merge mode with partial updates
> --
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/cargo/datafusion-physical-expr-40.0.0
in repository https://gitbox.apache.org/repos/asf/hudi-rs.git
at df7bbee build(deps): update datafusion-physical-expr requirement
No
dependabot[bot] opened a new pull request, #95:
URL: https://github.com/apache/hudi-rs/pull/95
Updates the requirements on [pyo3](https://github.com/pyo3/pyo3) to permit
the latest version.
Release notes
Sourced from https://github.com/pyo3/pyo3/releases";>pyo3's
releases.
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/datafusion-40.0.0
in repository https://gitbox.apache.org/repos/asf/hudi-rs.git
at f586602 build(deps): update datafusion requirement from 39.0.0 to
40.0.0
No new re
dependabot[bot] opened a new pull request, #98:
URL: https://github.com/apache/hudi-rs/pull/98
Updates the requirements on
[datafusion-common](https://github.com/apache/datafusion) to permit the latest
version.
Commits
See full diff in https://github.com/apache/datafusion/comp
[
https://issues.apache.org/jira/browse/HUDI-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vova Kolmakov updated HUDI-7843:
Status: In Progress (was: Open)
> Support record merge mode with partial updates
>
dependabot[bot] opened a new pull request, #96:
URL: https://github.com/apache/hudi-rs/pull/96
Updates the requirements on
[datafusion-physical-expr](https://github.com/apache/datafusion) to permit the
latest version.
Commits
See full diff in https://github.com/apache/datafusi
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/pyo3-0.22.2
in repository https://gitbox.apache.org/repos/asf/hudi-rs.git
at a6a8de5 build(deps): update pyo3 requirement from 0.21.2 to 0.22.2
No new revisions were
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/hudi-rs.git
The following commit(s) were added to refs/heads/main by this push:
new 2bade8f chore: enable dependabot (#94)
2bade8f i
xushiyan closed issue #91: Setup dependabot as per ASF guide
URL: https://github.com/apache/hudi-rs/issues/91
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-
xushiyan merged PR #94:
URL: https://github.com/apache/hudi-rs/pull/94
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o
xushiyan commented on code in PR #93:
URL: https://github.com/apache/hudi-rs/pull/93#discussion_r1692651992
##
.github/workflows/ci.yml:
##
@@ -22,9 +22,17 @@ on:
branches:
- main
- release/**
+paths:
+ - 'python/**'
+ - '!python/Makefile'
+
xushiyan opened a new pull request, #94:
URL: https://github.com/apache/hudi-rs/pull/94
## Description
Enable dependabot https://docs.github.com/en/code-security/dependabot
Fixes #91
## How are the changes test-covered
- [X] N/A
- [ ] Au
abyssnlp commented on code in PR #93:
URL: https://github.com/apache/hudi-rs/pull/93#discussion_r1692641535
##
.github/workflows/ci.yml:
##
@@ -22,9 +22,17 @@ on:
branches:
- main
- release/**
+paths:
+ - 'python/**'
+ - '!python/Makefile'
+
xushiyan commented on issue #81:
URL: https://github.com/apache/hudi-rs/issues/81#issuecomment-2252137301
@abyssnlp before you start, can you please elaborate on the design?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
abyssnlp commented on code in PR #93:
URL: https://github.com/apache/hudi-rs/pull/93#discussion_r1692622588
##
.github/workflows/ci.yml:
##
@@ -22,9 +22,17 @@ on:
branches:
- main
- release/**
+paths:
+ - 'python/**'
+ - '!python/Makefile'
+
xushiyan commented on PR #92:
URL: https://github.com/apache/hudi-rs/pull/92#issuecomment-2252127160
@crrow i suspect your previous approach using binstall could work but the
github action was not whitelisted by asf so the whole workflow is not
triggered. if you can verify that binstall app
xushiyan commented on code in PR #93:
URL: https://github.com/apache/hudi-rs/pull/93#discussion_r1692614366
##
.github/workflows/ci.yml:
##
@@ -22,9 +22,17 @@ on:
branches:
- main
- release/**
+paths:
+ - 'python/**'
+ - '!python/Makefile'
+
xushiyan commented on code in PR #93:
URL: https://github.com/apache/hudi-rs/pull/93#discussion_r1692614366
##
.github/workflows/ci.yml:
##
@@ -22,9 +22,17 @@ on:
branches:
- main
- release/**
+paths:
+ - 'python/**'
+ - '!python/Makefile'
+
xushiyan commented on code in PR #93:
URL: https://github.com/apache/hudi-rs/pull/93#discussion_r1692614366
##
.github/workflows/ci.yml:
##
@@ -22,9 +22,17 @@ on:
branches:
- main
- release/**
+paths:
+ - 'python/**'
+ - '!python/Makefile'
+
xushiyan commented on issue #5:
URL: https://github.com/apache/hudi-rs/issues/5#issuecomment-2252111807
@muyihao are you planning to start on this ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
clintonbuzon-iress commented on issue #11661:
URL: https://github.com/apache/hudi/issues/11661#issuecomment-2252109359
@ad1happy2go unfortunately we don't have the timeline anymore since we
deleted the entire s3 path and recreated the table from scratch to fix the
issue. We are using COW an
84 matches
Mail list logo
