hudi-bot commented on PR #8047:
URL: https://github.com/apache/hudi/pull/8047#issuecomment-1445265556
## CI report:
* ae30cc314acd9f921799f81074bde54ff83b98e3 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1540
sandyfog commented on code in PR #7886:
URL: https://github.com/apache/hudi/pull/7886#discussion_r1118011841
##
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/util/AvroToRowDataConverters.java:
##
@@ -233,7 +234,9 @@ private static AvroToRowDataConverter
createT
hudi-bot commented on PR #8047:
URL: https://github.com/apache/hudi/pull/8047#issuecomment-1445253036
## CI report:
* 1aa19ff1be973030ba204f593c3b257e65c91997 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=154
hudi-bot commented on PR #8047:
URL: https://github.com/apache/hudi/pull/8047#issuecomment-1445252087
## CI report:
* 1aa19ff1be973030ba204f593c3b257e65c91997 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=154
hudi-bot commented on PR #8047:
URL: https://github.com/apache/hudi/pull/8047#issuecomment-1445251279
## CI report:
* 6edf74eed7ee1140bceb9a75ec89eb47eb52c978 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=154
hudi-bot commented on PR #8047:
URL: https://github.com/apache/hudi/pull/8047#issuecomment-1445243094
## CI report:
* 6edf74eed7ee1140bceb9a75ec89eb47eb52c978 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=154
hudi-bot commented on PR #8047:
URL: https://github.com/apache/hudi/pull/8047#issuecomment-1445242084
## CI report:
* b6c62c08500e543fd0018141238b2e5d0bdb3843 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1539
bvaradar commented on PR #7550:
URL: https://github.com/apache/hudi/pull/7550#issuecomment-1445239983
Closing this PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To un
bvaradar closed pull request #7550: [MINOR] Avoid running tests as part of
bundle uploads
URL: https://github.com/apache/hudi/pull/7550
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
bvaradar closed pull request #7542: [HUDI-5469] Hive doesn't respect the space
at the end of partition path, so remove it to avoid dupl…
URL: https://github.com/apache/hudi/pull/7542
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHu
bvaradar commented on PR #7542:
URL: https://github.com/apache/hudi/pull/7542#issuecomment-1445239668
Closing this PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To u
hudi-bot commented on PR #8047:
URL: https://github.com/apache/hudi/pull/8047#issuecomment-1445232647
## CI report:
* b6c62c08500e543fd0018141238b2e5d0bdb3843 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1539
hudi-bot commented on PR #8047:
URL: https://github.com/apache/hudi/pull/8047#issuecomment-1445226900
## CI report:
* b6c62c08500e543fd0018141238b2e5d0bdb3843 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1539
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 2770ff50714 [HUDI-915][HUDI-5656] Rebased `HoodieBootstrapRelation`
onto `HoodieBaseRelation` (#7804)
add b39d99c7e
yihua merged PR #8012:
URL: https://github.com/apache/hudi/pull/8012
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
hudi-bot commented on PR #8047:
URL: https://github.com/apache/hudi/pull/8047#issuecomment-1445225313
## CI report:
* b6c62c08500e543fd0018141238b2e5d0bdb3843 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1539
the-other-tim-brown commented on code in PR #8044:
URL: https://github.com/apache/hudi/pull/8044#discussion_r1117987102
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/MORRestoreTool.java:
##
@@ -0,0 +1,434 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) un
[
https://issues.apache.org/jira/browse/HUDI-5272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-5272:
-
Labels: pull-request-available (was: )
> Align with Flink to support no_precombine in spark
> ---
hudi-bot commented on PR #8047:
URL: https://github.com/apache/hudi/pull/8047#issuecomment-1445210694
## CI report:
* b6c62c08500e543fd0018141238b2e5d0bdb3843 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1539
hudi-bot commented on PR #8012:
URL: https://github.com/apache/hudi/pull/8012#issuecomment-1445210676
## CI report:
* 24b0dcbee9b74870a04fb5484a613215e888003b Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1532
[
https://issues.apache.org/jira/browse/HUDI-5272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693534#comment-17693534
]
kazdy commented on HUDI-5272:
-
Starting from 0.13 precombine field is optional in Spark.
Befor
[
https://issues.apache.org/jira/browse/HUDI-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kazdy closed HUDI-5848.
---
Resolution: Duplicate
> No PreCombineField mode - make COMBINE_BEFORE_UPSERT=false automatically
> ---
[
https://issues.apache.org/jira/browse/HUDI-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kazdy updated HUDI-5848:
Status: Open (was: In Progress)
> No PreCombineField mode - make COMBINE_BEFORE_UPSERT=false automatically
> --
hudi-bot commented on PR #8047:
URL: https://github.com/apache/hudi/pull/8047#issuecomment-1445209222
## CI report:
* b6c62c08500e543fd0018141238b2e5d0bdb3843 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #8012:
URL: https://github.com/apache/hudi/pull/8012#issuecomment-1445209208
## CI report:
* 24b0dcbee9b74870a04fb5484a613215e888003b Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1532
[
https://issues.apache.org/jira/browse/HUDI-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kazdy updated HUDI-5848:
Status: In Progress (was: Open)
> No PreCombineField mode - make COMBINE_BEFORE_UPSERT=false automatically
> --
kazdy commented on code in PR #8047:
URL: https://github.com/apache/hudi/pull/8047#discussion_r1117978967
##
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/TestHoodieSparkSqlWriter.scala:
##
@@ -454,6 +454,38 @@ class TestHoodieSparkSqlWriter {
assert(df.ex
kazdy commented on code in PR #8047:
URL: https://github.com/apache/hudi/pull/8047#discussion_r1117978967
##
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/TestHoodieSparkSqlWriter.scala:
##
@@ -454,6 +454,38 @@ class TestHoodieSparkSqlWriter {
assert(df.ex
kazdy commented on PR #8047:
URL: https://github.com/apache/hudi/pull/8047#issuecomment-1445204504
I should probably also add sql tests to cover sql update, but I'll do it
after https://github.com/apache/hudi/pull/7998 is merged and this branch is
rebased on it.
Also I've seen MERGE INTO
kazdy commented on code in PR #8047:
URL: https://github.com/apache/hudi/pull/8047#discussion_r1117977800
##
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/TestHoodieSparkSqlWriter.scala:
##
@@ -454,6 +454,38 @@ class TestHoodieSparkSqlWriter {
assert(df.ex
[
https://issues.apache.org/jira/browse/HUDI-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-5848:
-
Labels: pull-request-available (was: )
> No PreCombineField mode - make COMBINE_BEFORE_UPSERT=fal
kazdy opened a new pull request, #8047:
URL: https://github.com/apache/hudi/pull/8047
### Change Logs
Align with Flink behaviour, since precombine is now optional in Spark let
users do updates on Hudi table where precombine field is not defined.
fixes #7282
This PR can be me
[
https://issues.apache.org/jira/browse/HUDI-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kazdy updated HUDI-5848:
Summary: No PreCombineField mode - make COMBINE_BEFORE_UPSERT=false
automatically (was: If no precombine field is p
the-other-tim-brown commented on code in PR #8044:
URL: https://github.com/apache/hudi/pull/8044#discussion_r1117964460
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/MORRestoreTool.java:
##
@@ -0,0 +1,384 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) un
the-other-tim-brown commented on code in PR #8044:
URL: https://github.com/apache/hudi/pull/8044#discussion_r1117958567
##
hudi-utilities/src/test/java/org/apache/hudi/utilities/TestMorRestoreTool.java:
##
@@ -0,0 +1,204 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF
the-other-tim-brown commented on code in PR #8044:
URL: https://github.com/apache/hudi/pull/8044#discussion_r1117955249
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/MORRestoreTool.java:
##
@@ -0,0 +1,384 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) un
soumilshah1995 opened a new issue, #8046:
URL: https://github.com/apache/hudi/issues/8046
## i believe we should change it to Early
--
This is an automated message from
hudi-bot commented on PR #8045:
URL: https://github.com/apache/hudi/pull/8045#issuecomment-1445129014
## CI report:
* 294e7e2bec6a775e93bcf22a129f24ac361e65ff Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1539
hudi-bot commented on PR #8032:
URL: https://github.com/apache/hudi/pull/8032#issuecomment-1445121732
## CI report:
* c303fc268b71faf519eaabe8d686d1c167b99d17 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1537
soumilshah1995 commented on issue #8033:
URL: https://github.com/apache/hudi/issues/8033#issuecomment-1445117931
issue has been resolved
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the speci
soumilshah1995 closed issue #8033: [SUPPORT] Hudi to support
Change-Data-Capture RFC 51 |
URL: https://github.com/apache/hudi/issues/8033
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specifi
hudi-bot commented on PR #8026:
URL: https://github.com/apache/hudi/pull/8026#issuecomment-1445078746
## CI report:
* 0b0ca829bb52ee630882391a5525ac85a69ecb7c UNKNOWN
* 95dd16b15ed224b17079cfca9d485b4473347a1c Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
hudi-bot commented on PR #8045:
URL: https://github.com/apache/hudi/pull/8045#issuecomment-1445058699
## CI report:
* 294e7e2bec6a775e93bcf22a129f24ac361e65ff Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1539
hudi-bot commented on PR #8045:
URL: https://github.com/apache/hudi/pull/8045#issuecomment-1445057264
## CI report:
* 294e7e2bec6a775e93bcf22a129f24ac361e65ff UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #8032:
URL: https://github.com/apache/hudi/pull/8032#issuecomment-1445057253
## CI report:
* c303fc268b71faf519eaabe8d686d1c167b99d17 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1537
beyond1920 commented on issue #6430:
URL: https://github.com/apache/hudi/issues/6430#issuecomment-1445051714
@danny0405 Flink SQL has limited support for complex types. Nested array
type is not supported yet, for example, array.
1. the writer: There is a litter bug when create parquet wri
kazdy opened a new pull request, #8045:
URL: https://github.com/apache/hudi/pull/8045
### Change Logs
Instead of doing spark.read... two times in assert, do it only once, run
assertions on the df
### Impact
None
### Risk level (write none, low medium or high below
hudi-bot commented on PR #8026:
URL: https://github.com/apache/hudi/pull/8026#issuecomment-1445047580
## CI report:
* 0b0ca829bb52ee630882391a5525ac85a69ecb7c UNKNOWN
* edc3bd93fb3e6441e1bb3c6ec7cfad22495d13de Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
voonhous commented on code in PR #7997:
URL: https://github.com/apache/hudi/pull/7997#discussion_r1117898536
##
hudi-common/src/test/java/org/apache/hudi/common/testutils/FileCreateUtils.java:
##
@@ -101,7 +101,11 @@ public static String markerFileName(String instantTime,
Strin
[
https://issues.apache.org/jira/browse/HUDI-5839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kazdy updated HUDI-5839:
Description:
There seem to be a bug with non-strict insert mode when precombine is not
defined (but I have not chec
slfan1989 commented on PR #8032:
URL: https://github.com/apache/hudi/pull/8032#issuecomment-1445045978
@hudi-bot run
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsu
slfan1989 commented on PR #8032:
URL: https://github.com/apache/hudi/pull/8032#issuecomment-1445045944
@danny0405 Thank you very much for your help in reviewing the code!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
[
https://issues.apache.org/jira/browse/HUDI-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kazdy updated HUDI-5848:
Description:
Starting from 0.13 precombine field is optional in Spark.
Before this was only available in Flink, but
[
https://issues.apache.org/jira/browse/HUDI-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kazdy updated HUDI-5848:
Description:
Starting from 0.13 precombine field is optional in Spark.
Before this was only available in Flink, but
[
https://issues.apache.org/jira/browse/HUDI-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kazdy updated HUDI-5848:
Description:
Starting from 0.13 precombine field is optional in Spark.
Before this was only available in Flink, but
kazdy created HUDI-5848:
---
Summary: If no precombine field is provided make
COMBINE_BEFORE_UPSERT=false automatically
Key: HUDI-5848
URL: https://issues.apache.org/jira/browse/HUDI-5848
Project: Apache Hudi
hudi-bot commented on PR #8026:
URL: https://github.com/apache/hudi/pull/8026#issuecomment-1445039504
## CI report:
* 0b0ca829bb52ee630882391a5525ac85a69ecb7c UNKNOWN
* edc3bd93fb3e6441e1bb3c6ec7cfad22495d13de Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
hudi-bot commented on PR #8026:
URL: https://github.com/apache/hudi/pull/8026#issuecomment-1445038398
## CI report:
* 0b0ca829bb52ee630882391a5525ac85a69ecb7c UNKNOWN
* edc3bd93fb3e6441e1bb3c6ec7cfad22495d13de Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
hudi-bot commented on PR #8026:
URL: https://github.com/apache/hudi/pull/8026#issuecomment-1445027432
## CI report:
* 0b0ca829bb52ee630882391a5525ac85a69ecb7c UNKNOWN
* edc3bd93fb3e6441e1bb3c6ec7cfad22495d13de Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
59 matches
Mail list logo
