ad1happy2go commented on issue #9885:
URL: https://github.com/apache/hudi/issues/9885#issuecomment-1774454476
Can you try setting spark.sql.storeAssignmentPolicy=legacy
Referring this issue - https://github.com/apache/hudi/issues/6209
--
This is an automated message from the
codope commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368138053
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java:
##
@@ -866,11 +866,11 @@ public void validateInsertSchema() throws
codope commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368140158
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieMultiFileFormatRelation.scala:
##
@@ -0,0 +1,232 @@
+/*
+ * Licensed to the Apache Software
codope commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368138053
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java:
##
@@ -866,11 +866,11 @@ public void validateInsertSchema() throws
ad1happy2go commented on issue #9890:
URL: https://github.com/apache/hudi/issues/9890#issuecomment-177529
@bradleybonitatibus I am not very sure about Redshift, But whenever we will
try to read hudi table we should get in '/mm/dd' format only. If somebody
try to directly read the
codope commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368134682
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala:
##
@@ -516,6 +515,99 @@ abstract class HoodieBaseRelation(val
codope commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368134047
##
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##
@@ -244,6 +244,12 @@ public class HoodieTableConfig extends HoodieConfig {
codope commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368133407
##
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##
@@ -284,6 +290,13 @@ public class HoodieTableConfig extends HoodieConfig {
hudi-bot commented on PR #9883:
URL: https://github.com/apache/hudi/pull/9883#issuecomment-1774432431
## CI report:
* 8104637c318a0a12b646c7819a3ba6270d90 Azure:
hudi-bot commented on PR #9883:
URL: https://github.com/apache/hudi/pull/9883#issuecomment-1774426918
## CI report:
* 8cec737f1e3a05a91c475d395cb08e74dd668c73 Azure:
hudi-bot commented on PR #9896:
URL: https://github.com/apache/hudi/pull/9896#issuecomment-1774426980
## CI report:
* 6476982b71f8924be4fce2c68e67f754456b1d5d Azure:
danny0405 commented on code in PR #9896:
URL: https://github.com/apache/hudi/pull/9896#discussion_r1368125789
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##
@@ -2616,6 +2617,19 @@ public Integer getWritesFileIdEncoding() {
nfarah86 opened a new pull request, #9901:
URL: https://github.com/apache/hudi/pull/9901
Updated release notes to specify that hudi_table_change table function can
only be done though spark SQL/ Also updated and rounded out the title and text.
hudi-bot commented on PR #9896:
URL: https://github.com/apache/hudi/pull/9896#issuecomment-1774419635
## CI report:
* 6476982b71f8924be4fce2c68e67f754456b1d5d Azure:
danny0405 commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368122420
##
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##
@@ -284,6 +290,13 @@ public class HoodieTableConfig extends HoodieConfig {
danny0405 commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368120859
##
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java:
##
@@ -244,6 +244,12 @@ public class HoodieTableConfig extends HoodieConfig {
danny0405 commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368118968
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java:
##
@@ -866,11 +866,11 @@ public void validateInsertSchema() throws
danny0405 commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368117619
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieMultiFileFormatRelation.scala:
##
@@ -0,0 +1,232 @@
+/*
+ * Licensed to the Apache
danny0405 commented on code in PR #9761:
URL: https://github.com/apache/hudi/pull/9761#discussion_r1368110965
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala:
##
@@ -516,6 +515,99 @@ abstract class HoodieBaseRelation(val
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Attachment: (was: screenshot-1.png)
> remove block logical in BulkInsertWriteFunction#open
>
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Attachment: (was: image-2023-10-23-11-16-01-233.png)
> remove block logical in
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Issue Type: Improvement (was: New Feature)
> remove block logical in BulkInsertWriteFunction#open
>
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Description: See more discussion in
[PR9896|https://github.com/apache/hudi/pull/9896]. (was: See more
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Priority: Trivial (was: Major)
> remove block logical in BulkInsertWriteFunction#open
>
beyond1920 commented on code in PR #9896:
URL: https://github.com/apache/hudi/pull/9896#discussion_r1368084833
##
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/utils/BulkInsertFunctionWrapper.java:
##
@@ -0,0 +1,232 @@
+/*
+ * Licensed to the Apache
boneanxs commented on PR #9887:
URL: https://github.com/apache/hudi/pull/9887#issuecomment-1774383153
> So if we roll back the current instant immediately, new files may still be
written after rollback scheduled, which will cause dirty data.
Hey @stream2000 can share more info how
This is an automated email from the ASF dual-hosted git repository.
codope pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new bb8fc3e9f63 [HUDI-6929] Lazy loading dynamically
codope merged PR #9898:
URL: https://github.com/apache/hudi/pull/9898
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
li-ang-666 commented on issue #9900:
URL: https://github.com/apache/hudi/issues/9900#issuecomment-1774379881
@danny0405 I only found the account id `leesf`, Did he change his account?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
beyond1920 commented on code in PR #9896:
URL: https://github.com/apache/hudi/pull/9896#discussion_r1368086374
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##
@@ -2616,6 +2617,19 @@ public Integer getWritesFileIdEncoding() {
liiang-huang commented on issue #6767:
URL: https://github.com/apache/hudi/issues/6767#issuecomment-1774371473
facing the same issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific
beyond1920 commented on code in PR #9896:
URL: https://github.com/apache/hudi/pull/9896#discussion_r1368084833
##
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/utils/BulkInsertFunctionWrapper.java:
##
@@ -0,0 +1,232 @@
+/*
+ * Licensed to the Apache
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Description:
See more discussion in [PR9896|https://github.com/apache/hudi/pull/9896].
[
https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jing Zhang updated HUDI-6968:
-
Attachment: screenshot-1.png
> remove block logical in BulkInsertWriteFunction#open
>
Jing Zhang created HUDI-6968:
Summary: remove block logical in BulkInsertWriteFunction#open
Key: HUDI-6968
URL: https://issues.apache.org/jira/browse/HUDI-6968
Project: Apache Hudi
Issue Type:
beyond1920 commented on code in PR #9896:
URL: https://github.com/apache/hudi/pull/9896#discussion_r1368081879
##
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/utils/TestData.java:
##
@@ -553,7 +554,12 @@ public static void writeDataAsBatch(
* Initializes a
danny0405 commented on PR #9887:
URL: https://github.com/apache/hudi/pull/9887#issuecomment-1774357741
> could we merge this first and tract the file-slicing issue in other prs
Do we have conclusion that the data source V2 `drop` has no guarantee for
recycling existing stray tasks?
danny0405 commented on issue #9900:
URL: https://github.com/apache/hudi/issues/9900#issuecomment-1774355665
That's great, you can contact this account id of wechat: xleesf
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
danny0405 commented on code in PR #9876:
URL: https://github.com/apache/hudi/pull/9876#discussion_r1368076982
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/payload/ExpressionPayload.scala:
##
@@ -411,10 +414,14 @@ object ExpressionPayload
danny0405 commented on code in PR #9876:
URL: https://github.com/apache/hudi/pull/9876#discussion_r1368076982
##
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/payload/ExpressionPayload.scala:
##
@@ -411,10 +414,14 @@ object ExpressionPayload
danny0405 commented on code in PR #9876:
URL: https://github.com/apache/hudi/pull/9876#discussion_r1368075473
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieAppendHandle.java:
##
@@ -652,6 +660,16 @@ private static Map
getUpdatedHeader(Map
hudi-bot commented on PR #9883:
URL: https://github.com/apache/hudi/pull/9883#issuecomment-1774343094
## CI report:
* 8cec737f1e3a05a91c475d395cb08e74dd668c73 Azure:
li-ang-666 opened a new issue, #9900:
URL: https://github.com/apache/hudi/issues/9900
who could I contact?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe,
danny0405 commented on code in PR #9889:
URL: https://github.com/apache/hudi/pull/9889#discussion_r1368068891
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala:
##
@@ -149,27 +152,10 @@ case class BaseFileOnlyRelation(override
stream2000 commented on PR #9887:
URL: https://github.com/apache/hudi/pull/9887#issuecomment-1774333640
@danny0405 As we discussed offline, the reason for the test failures after
#9776 is that after we changed the file-slicing algorithm, the existing bug
made the test fail. This pr only
zyclove commented on issue #9865:
URL: https://github.com/apache/hudi/issues/9865#issuecomment-1774305775
I also encountered this problem, how can I solve it ?
```
Caused by: org.apache.hudi.exception.HoodieException:
org.apache.hudi.exception.HoodieException:
hudi-bot commented on PR #9883:
URL: https://github.com/apache/hudi/pull/9883#issuecomment-1774261385
## CI report:
* d1a976ddc81d1aa79df06fcbf72acd59c2c2b518 Azure:
hudi-bot commented on PR #9892:
URL: https://github.com/apache/hudi/pull/9892#issuecomment-1774261415
## CI report:
* 355a341791a82a572e0595b44ed51372a7ee2c6e Azure:
hudi-bot commented on PR #9883:
URL: https://github.com/apache/hudi/pull/9883#issuecomment-1774256792
## CI report:
* d1a976ddc81d1aa79df06fcbf72acd59c2c2b518 Azure:
hudi-bot commented on PR #9892:
URL: https://github.com/apache/hudi/pull/9892#issuecomment-1774234779
## CI report:
* 355a341791a82a572e0595b44ed51372a7ee2c6e Azure:
hudi-bot commented on PR #9892:
URL: https://github.com/apache/hudi/pull/9892#issuecomment-1774232729
## CI report:
* 355a341791a82a572e0595b44ed51372a7ee2c6e UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #9899:
URL: https://github.com/apache/hudi/pull/9899#issuecomment-1774167489
## CI report:
* 6827d7a14bdec8ff6a903e4303030d94b52467a1 Azure:
hudi-bot commented on PR #9899:
URL: https://github.com/apache/hudi/pull/9899#issuecomment-1774138467
## CI report:
* 6827d7a14bdec8ff6a903e4303030d94b52467a1 Azure:
hudi-bot commented on PR #9899:
URL: https://github.com/apache/hudi/pull/9899#issuecomment-1774127969
## CI report:
* 6827d7a14bdec8ff6a903e4303030d94b52467a1 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
[
https://issues.apache.org/jira/browse/HUDI-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-6967:
-
Labels: pull-request-available (was: )
> Add clearJobStatus api in HoodieEngineContext
>
wecharyu opened a new pull request, #9899:
URL: https://github.com/apache/hudi/pull/9899
### Change Logs
1. Add clearJobStatus api in HoodieEngineContext
2. Add call of clearJobStatus after setJobStatus.
### Impact
Fix the incorrect job group and descriptions.
### Risk
[
https://issues.apache.org/jira/browse/HUDI-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wechar updated HUDI-6967:
-
Description:
Currently HudiEngineContext only has setJobStatus api, the configured job group
and description
[
https://issues.apache.org/jira/browse/HUDI-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wechar updated HUDI-6967:
-
Attachment: Job_description_not_correct.png
> Add clearJobStatus api in HoodieEngineContext
>
Wechar created HUDI-6967:
Summary: Add clearJobStatus api in HoodieEngineContext
Key: HUDI-6967
URL: https://issues.apache.org/jira/browse/HUDI-6967
Project: Apache Hudi
Issue Type: Improvement
bvaradar merged PR #9749:
URL: https://github.com/apache/hudi/pull/9749
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail:
This is an automated email from the ASF dual-hosted git repository.
vbalaji pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 2b245aa7098 Fix race condition in
blackcheckren commented on issue #9748:
URL: https://github.com/apache/hudi/issues/9748#issuecomment-1774052369
blackcheckren commented on issue #9748:
URL: https://github.com/apache/hudi/issues/9748#issuecomment-1774052145
@ad1happy2go Sorry for the late reply. I read the tables in Maxcompute into
the memory, sort them by primary key, and write them into the Hudi table. Then
I read the table from
[
https://issues.apache.org/jira/browse/HUDI-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778306#comment-17778306
]
Wechar commented on HUDI-6950:
--
[~xuzifu] Can you also provide the stages after the revert? In the
64 matches
Mail list logo
