hudi-bot commented on PR #9883:
URL: https://github.com/apache/hudi/pull/9883#issuecomment-1774544385
## CI report:
* c140ff462f58b649d45c782ce072b683cd908c1c Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2044
hudi-bot commented on PR #9761:
URL: https://github.com/apache/hudi/pull/9761#issuecomment-1774534084
## CI report:
* d680ff4d9daad14fea165c1520ef906606e991a5 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2042
hudi-bot commented on PR #9883:
URL: https://github.com/apache/hudi/pull/9883#issuecomment-1774534304
## CI report:
* 8104637c318a0a12b646c7819a3ba6270d90 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2043
zyclove opened a new issue, #9902:
URL: https://github.com/apache/hudi/issues/9902
**Describe the problem you faced**
hudi schema error.
**To Reproduce**
Steps to reproduce the behavior:
1. spark-sql hudi task appears suddenly during operation
**Expe
hudi-bot commented on PR #9761:
URL: https://github.com/apache/hudi/pull/9761#issuecomment-1774524188
## CI report:
* d680ff4d9daad14fea165c1520ef906606e991a5 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2042
li-ang-666 closed issue #9900: [SUPPORT] I want delivery one Article for
apache-hudi-WeChat-official-account
URL: https://github.com/apache/hudi/issues/9900
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
ad1happy2go commented on issue #9885:
URL: https://github.com/apache/hudi/issues/9885#issuecomment-1774454476
Can you try setting spark.sql.storeAssignmentPolicy=legacy
Referring this issue - https://github.com/apache/hudi/issues/6209
--
This is an automated message from the Apache
codope commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368138053
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java:
##
@@ -866,11 +866,11 @@ public void validateInsertSchema() throws
HoodieInsertExce
codope commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368140158
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieMultiFileFormatRelation.scala:
##
@@ -0,0 +1,232 @@
+/*
+ * Licensed to the Apache Software
codope commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368138053
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java:
##
@@ -866,11 +866,11 @@ public void validateInsertSchema() throws
HoodieInsertExce
ad1happy2go commented on issue #9890:
URL: https://github.com/apache/hudi/issues/9890#issuecomment-177529
@bradleybonitatibus I am not very sure about Redshift, But whenever we will
try to read hudi table we should get in '/mm/dd' format only. If somebody
try to directly read the pa
codope commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368134682
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala:
##
@@ -516,6 +515,99 @@ abstract class HoodieBaseRelation(val sqlContext
codope commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368134047
##
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##
@@ -244,6 +244,12 @@ public class HoodieTableConfig extends HoodieConfig {
.mark
codope commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368133407
##
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##
@@ -284,6 +290,13 @@ public class HoodieTableConfig extends HoodieConfig {
.sinc
hudi-bot commented on PR #9883:
URL: https://github.com/apache/hudi/pull/9883#issuecomment-1774432431
## CI report:
* 8104637c318a0a12b646c7819a3ba6270d90 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2043
hudi-bot commented on PR #9883:
URL: https://github.com/apache/hudi/pull/9883#issuecomment-1774426918
## CI report:
* 8cec737f1e3a05a91c475d395cb08e74dd668c73 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2043
hudi-bot commented on PR #9896:
URL: https://github.com/apache/hudi/pull/9896#issuecomment-1774426980
## CI report:
* 6476982b71f8924be4fce2c68e67f754456b1d5d Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2042
danny0405 commented on code in PR #9896:
URL: https://github.com/apache/hudi/pull/9896#discussion_r1368125789
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##
@@ -2616,6 +2617,19 @@ public Integer getWritesFileIdEncoding() {
nfarah86 opened a new pull request, #9901:
URL: https://github.com/apache/hudi/pull/9901
Updated release notes to specify that hudi_table_change table function can
only be done though spark SQL/ Also updated and rounded out the title and text.
https://github.com/apache/hudi/assets/53
hudi-bot commented on PR #9896:
URL: https://github.com/apache/hudi/pull/9896#issuecomment-1774419635
## CI report:
* 6476982b71f8924be4fce2c68e67f754456b1d5d Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2042
danny0405 commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368122420
##
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##
@@ -284,6 +290,13 @@ public class HoodieTableConfig extends HoodieConfig {
.s
danny0405 commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368120859
##
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##
@@ -244,6 +244,12 @@ public class HoodieTableConfig extends HoodieConfig {
.m
danny0405 commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368118968
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java:
##
@@ -866,11 +866,11 @@ public void validateInsertSchema() throws
HoodieInsertE
danny0405 commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368117619
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieMultiFileFormatRelation.scala:
##
@@ -0,0 +1,232 @@
+/*
+ * Licensed to the Apache Softwa
danny0405 commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368110965
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala:
##
@@ -516,6 +515,99 @@ abstract class HoodieBaseRelation(val sqlCont
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Attachment: (was: screenshot-1.png)
> remove block logical in BulkInsertWriteFunction#open
> -
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Attachment: (was: image-2023-10-23-11-16-01-233.png)
> remove block logical in BulkInsertWriteFunction
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Issue Type: Improvement (was: New Feature)
> remove block logical in BulkInsertWriteFunction#open
> -
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Description: See more discussion in
[PR9896|https://github.com/apache/hudi/pull/9896]. (was: See more dis
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Priority: Trivial (was: Major)
> remove block logical in BulkInsertWriteFunction#open
> -
beyond1920 commented on code in PR #9896:
URL: https://github.com/apache/hudi/pull/9896#discussion_r1368084833
##
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/utils/BulkInsertFunctionWrapper.java:
##
@@ -0,0 +1,232 @@
+/*
+ * Licensed to the Apache Softwar
boneanxs commented on PR #9887:
URL: https://github.com/apache/hudi/pull/9887#issuecomment-1774383153
> So if we roll back the current instant immediately, new files may still be
written after rollback scheduled, which will cause dirty data.
Hey @stream2000 can share more info how you
This is an automated email from the ASF dual-hosted git repository.
codope pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new bb8fc3e9f63 [HUDI-6929] Lazy loading dynamically f
codope merged PR #9898:
URL: https://github.com/apache/hudi/pull/9898
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.or
li-ang-666 commented on issue #9900:
URL: https://github.com/apache/hudi/issues/9900#issuecomment-1774379881
@danny0405 I only found the account id `leesf`, Did he change his account?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
beyond1920 commented on code in PR #9896:
URL: https://github.com/apache/hudi/pull/9896#discussion_r1368086374
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##
@@ -2616,6 +2617,19 @@ public Integer getWritesFileIdEncoding() {
liiang-huang commented on issue #6767:
URL: https://github.com/apache/hudi/issues/6767#issuecomment-1774371473
facing the same issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific c
beyond1920 commented on code in PR #9896:
URL: https://github.com/apache/hudi/pull/9896#discussion_r1368084833
##
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/utils/BulkInsertFunctionWrapper.java:
##
@@ -0,0 +1,232 @@
+/*
+ * Licensed to the Apache Softwar
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Description:
See more discussion in [PR9896|https://github.com/apache/hudi/pull/9896].
!screenshot-1.png!
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Attachment: screenshot-1.png
> remove block logical in BulkInsertWriteFunction#open
>
Jing Zhang created HUDI-6968:
Summary: remove block logical in BulkInsertWriteFunction#open
Key: HUDI-6968
URL: https://issues.apache.org/jira/browse/HUDI-6968
Project: Apache Hudi
Issue Type: Ne
beyond1920 commented on code in PR #9896:
URL: https://github.com/apache/hudi/pull/9896#discussion_r1368081879
##
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/utils/TestData.java:
##
@@ -553,7 +554,12 @@ public static void writeDataAsBatch(
* Initializes a
danny0405 commented on PR #9887:
URL: https://github.com/apache/hudi/pull/9887#issuecomment-1774357741
> could we merge this first and tract the file-slicing issue in other prs
Do we have conclusion that the data source V2 `drop` has no guarantee for
recycling existing stray tasks?
danny0405 commented on issue #9900:
URL: https://github.com/apache/hudi/issues/9900#issuecomment-1774355665
That's great, you can contact this account id of wechat: xleesf
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and us
danny0405 commented on code in PR #9876:
URL: https://github.com/apache/hudi/pull/9876#discussion_r1368076982
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/payload/ExpressionPayload.scala:
##
@@ -411,10 +414,14 @@ object ExpressionPayload {
danny0405 commented on code in PR #9876:
URL: https://github.com/apache/hudi/pull/9876#discussion_r1368076982
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/payload/ExpressionPayload.scala:
##
@@ -411,10 +414,14 @@ object ExpressionPayload {
danny0405 commented on code in PR #9876:
URL: https://github.com/apache/hudi/pull/9876#discussion_r1368075473
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieAppendHandle.java:
##
@@ -652,6 +660,16 @@ private static Map
getUpdatedHeader(Map
hudi-bot commented on PR #9883:
URL: https://github.com/apache/hudi/pull/9883#issuecomment-1774343094
## CI report:
* 8cec737f1e3a05a91c475d395cb08e74dd668c73 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2043
li-ang-666 opened a new issue, #9900:
URL: https://github.com/apache/hudi/issues/9900
who could I contact?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e
danny0405 commented on code in PR #9889:
URL: https://github.com/apache/hudi/pull/9889#discussion_r1368068891
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala:
##
@@ -149,27 +152,10 @@ case class BaseFileOnlyRelation(override v
stream2000 commented on PR #9887:
URL: https://github.com/apache/hudi/pull/9887#issuecomment-1774333640
@danny0405 As we discussed offline, the reason for the test failures after
#9776 is that after we changed the file-slicing algorithm, the existing bug
made the test fail. This pr only so
zyclove commented on issue #9865:
URL: https://github.com/apache/hudi/issues/9865#issuecomment-1774305775
I also encountered this problem, how can I solve it ?
```
Caused by: org.apache.hudi.exception.HoodieException:
org.apache.hudi.exception.HoodieException:
org.apache.hudi.exce
hudi-bot commented on PR #9883:
URL: https://github.com/apache/hudi/pull/9883#issuecomment-1774261385
## CI report:
* d1a976ddc81d1aa79df06fcbf72acd59c2c2b518 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2043
hudi-bot commented on PR #9892:
URL: https://github.com/apache/hudi/pull/9892#issuecomment-1774261415
## CI report:
* 355a341791a82a572e0595b44ed51372a7ee2c6e Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2043
hudi-bot commented on PR #9883:
URL: https://github.com/apache/hudi/pull/9883#issuecomment-1774256792
## CI report:
* d1a976ddc81d1aa79df06fcbf72acd59c2c2b518 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2043
hudi-bot commented on PR #9892:
URL: https://github.com/apache/hudi/pull/9892#issuecomment-1774234779
## CI report:
* 355a341791a82a572e0595b44ed51372a7ee2c6e Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2043
hudi-bot commented on PR #9892:
URL: https://github.com/apache/hudi/pull/9892#issuecomment-1774232729
## CI report:
* 355a341791a82a572e0595b44ed51372a7ee2c6e UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #9899:
URL: https://github.com/apache/hudi/pull/9899#issuecomment-1774167489
## CI report:
* 6827d7a14bdec8ff6a903e4303030d94b52467a1 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2043
hudi-bot commented on PR #9899:
URL: https://github.com/apache/hudi/pull/9899#issuecomment-1774138467
## CI report:
* 6827d7a14bdec8ff6a903e4303030d94b52467a1 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2043
hudi-bot commented on PR #9899:
URL: https://github.com/apache/hudi/pull/9899#issuecomment-1774127969
## CI report:
* 6827d7a14bdec8ff6a903e4303030d94b52467a1 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
[
https://issues.apache.org/jira/browse/HUDI-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-6967:
-
Labels: pull-request-available (was: )
> Add clearJobStatus api in HoodieEngineContext
>
wecharyu opened a new pull request, #9899:
URL: https://github.com/apache/hudi/pull/9899
### Change Logs
1. Add clearJobStatus api in HoodieEngineContext
2. Add call of clearJobStatus after setJobStatus.
### Impact
Fix the incorrect job group and descriptions.
### Risk
[
https://issues.apache.org/jira/browse/HUDI-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wechar updated HUDI-6967:
-
Description:
Currently HudiEngineContext only has setJobStatus api, the configured job group
and description will
[
https://issues.apache.org/jira/browse/HUDI-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wechar updated HUDI-6967:
-
Attachment: Job_description_not_correct.png
> Add clearJobStatus api in HoodieEngineContext
>
Wechar created HUDI-6967:
Summary: Add clearJobStatus api in HoodieEngineContext
Key: HUDI-6967
URL: https://issues.apache.org/jira/browse/HUDI-6967
Project: Apache Hudi
Issue Type: Improvement
bvaradar merged PR #9749:
URL: https://github.com/apache/hudi/pull/9749
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.
This is an automated email from the ASF dual-hosted git repository.
vbalaji pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 2b245aa7098 Fix race condition in HoodieSparkSqlW
blackcheckren commented on issue #9748:
URL: https://github.com/apache/hudi/issues/9748#issuecomment-1774052369
![d29f8bf682be3042130b06390613b9b](https://github.com/apache/hudi/assets/88579280/b318c56e-9e55-4fba-8a17-2b911b36f7f2)
![fbc7345f6e288f4439554fc9a4db36d](https://github.com/ap
blackcheckren commented on issue #9748:
URL: https://github.com/apache/hudi/issues/9748#issuecomment-1774052145
@ad1happy2go Sorry for the late reply. I read the tables in Maxcompute into
the memory, sort them by primary key, and write them into the Hudi table. Then
I read the table from th
[
https://issues.apache.org/jira/browse/HUDI-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778306#comment-17778306
]
Wechar commented on HUDI-6950:
--
[~xuzifu] Can you also provide the stages after the revert? I
70 matches
Mail list logo