hudi-bot commented on PR #8514:
URL: https://github.com/apache/hudi/pull/8514#issuecomment-1525630032
## CI report:
* 524a060f0e5fcf31d43cc538dbc80004d64c9b52 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1668
hudi-bot commented on PR #8478:
URL: https://github.com/apache/hudi/pull/8478#issuecomment-1525629794
## CI report:
* 6605f4759c25ff79eb43928cdbc97b086a905534 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1669
hudi-bot commented on PR #8514:
URL: https://github.com/apache/hudi/pull/8514#issuecomment-1525619167
## CI report:
* 524a060f0e5fcf31d43cc538dbc80004d64c9b52 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1668
hudi-bot commented on PR #8478:
URL: https://github.com/apache/hudi/pull/8478#issuecomment-1525618855
## CI report:
* 6605f4759c25ff79eb43928cdbc97b086a905534 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1669
hudi-bot commented on PR #8585:
URL: https://github.com/apache/hudi/pull/8585#issuecomment-1525604467
## CI report:
* ef0b65c6471448ba86899c587618e60a6377d3c8 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1670
hudi-bot commented on PR #8574:
URL: https://github.com/apache/hudi/pull/8574#issuecomment-1525545607
## CI report:
* cf4e7358763e10aab951d16d7270f7592f7c62b0 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1664
hudi-bot commented on PR #8574:
URL: https://github.com/apache/hudi/pull/8574#issuecomment-1525535120
## CI report:
* cf4e7358763e10aab951d16d7270f7592f7c62b0 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1664
hudi-bot commented on PR #8493:
URL: https://github.com/apache/hudi/pull/8493#issuecomment-1525524709
## CI report:
* 6d9d24f2e0ab70b97fb912505f2d0da60dfea86f Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1650
lokeshj1703 commented on PR #8574:
URL: https://github.com/apache/hudi/pull/8574#issuecomment-1525524372
I have added some changes in the UT. It is in progress.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL a
lokeshj1703 commented on code in PR #8574:
URL: https://github.com/apache/hudi/pull/8574#discussion_r1179003066
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/transform/ChainedTransformer.java:
##
@@ -46,9 +110,40 @@ public List getTransformersNames() {
@Override
lokeshj1703 commented on code in PR #8574:
URL: https://github.com/apache/hudi/pull/8574#discussion_r1179003066
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/transform/ChainedTransformer.java:
##
@@ -46,9 +110,40 @@ public List getTransformersNames() {
@Override
lokeshj1703 commented on code in PR #8574:
URL: https://github.com/apache/hudi/pull/8574#discussion_r1178997841
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/transform/ChainedTransformer.java:
##
@@ -46,9 +110,40 @@ public List getTransformersNames() {
@Override
lokeshj1703 commented on code in PR #8574:
URL: https://github.com/apache/hudi/pull/8574#discussion_r1178997565
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/transform/Transformer.java:
##
@@ -45,4 +46,8 @@ public interface Transformer {
*/
@PublicAPIMethod(ma
lokeshj1703 commented on code in PR #8574:
URL: https://github.com/apache/hudi/pull/8574#discussion_r1178997392
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/transform/Transformer.java:
##
@@ -45,4 +46,8 @@ public interface Transformer {
*/
@PublicAPIMethod(ma
hudi-bot commented on PR #8478:
URL: https://github.com/apache/hudi/pull/8478#issuecomment-1525407039
## CI report:
* 6605f4759c25ff79eb43928cdbc97b086a905534 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1669
[
https://issues.apache.org/jira/browse/HUDI-93?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit updated HUDI-93:
Fix Version/s: 1.0.0
> Enforce semantics on HoodieRecordPayload to allow for a consistent
> instantiation of
[
https://issues.apache.org/jira/browse/HUDI-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit updated HUDI-309:
-
Fix Version/s: 1.0.0
> General Redesign of Archived Timeline for efficient scan and management
> --
danny0405 commented on PR #7173:
URL: https://github.com/apache/hudi/pull/7173#issuecomment-1525375730
@xicm Thanks for the contribution, can we squash the commits into one, it is
hard for code reviewing because of the merge cmd, let's use the `git rebase `
instead of `git merge`, the `git
[
https://issues.apache.org/jira/browse/HUDI-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit updated HUDI-5996:
--
Status: In Progress (was: Open)
> We should verify the consistency of bucket num at job startup.
>
[
https://issues.apache.org/jira/browse/HUDI-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit updated HUDI-5996:
--
Fix Version/s: 0.14.0
> We should verify the consistency of bucket num at job startup.
> ---
[
https://issues.apache.org/jira/browse/HUDI-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit updated HUDI-5996:
--
Status: Patch Available (was: In Progress)
> We should verify the consistency of bucket num at job star
[
https://issues.apache.org/jira/browse/HUDI-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit updated HUDI-6047:
--
Status: Patch Available (was: In Progress)
> Clustering operation on consistent hashing resulting in du
[
https://issues.apache.org/jira/browse/HUDI-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sagar Sumit updated HUDI-6047:
--
Status: In Progress (was: Open)
> Clustering operation on consistent hashing resulting in duplicate dat
danny0405 commented on issue #7602:
URL: https://github.com/apache/hudi/issues/7602#issuecomment-1525312103
Yeah, do you have the intreast for the contribution, I can help with the
code reivew.
--
This is an automated message from the Apache Git Service.
To respond to the message, please
hudi-bot commented on PR #7355:
URL: https://github.com/apache/hudi/pull/7355#issuecomment-1525289166
## CI report:
* 744a515f20bf5611d649a2a502662799929779a3 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1667
hudi-bot commented on PR #8587:
URL: https://github.com/apache/hudi/pull/8587#issuecomment-1525275586
## CI report:
* 8db0bfcd2ce5aee94771f35ceb8c0eeb905d2003 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1670
hudi-bot commented on PR #7355:
URL: https://github.com/apache/hudi/pull/7355#issuecomment-1525270232
## CI report:
* 744a515f20bf5611d649a2a502662799929779a3 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1667
ad1happy2go commented on issue #6591:
URL: https://github.com/apache/hudi/issues/6591#issuecomment-1525265398
JIRA created to fix the issue -
https://issues.apache.org/jira/browse/HUDI-6146
--
This is an automated message from the Apache Git Service.
To respond to the message, please log
Aditya Goenka created HUDI-6146:
---
Summary: Data Duplication in MOR tables when upsetting the same
keys twice.
Key: HUDI-6146
URL: https://issues.apache.org/jira/browse/HUDI-6146
Project: Apache Hudi
hudi-bot commented on PR #8587:
URL: https://github.com/apache/hudi/pull/8587#issuecomment-1525256821
## CI report:
* 8db0bfcd2ce5aee94771f35ceb8c0eeb905d2003 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
ad1happy2go commented on issue #6591:
URL: https://github.com/apache/hudi/issues/6591#issuecomment-1525255395
Issue still exists in master.
Reproducible script -
```
//action1: spark-dataframe write
import org.apache.spark.sql.SaveMode._
import org.apache.hudi.DataSourceR
[
https://issues.apache.org/jira/browse/HUDI-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen closed HUDI-5517.
Fix Version/s: 0.13.1
0.14.0
Resolution: Fixed
Fixed via master branch: 77039ae734
This is an automated email from the ASF dual-hosted git repository.
danny0405 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 77039ae734a [HUDI-5517] HoodieTimeline support
danny0405 merged PR #7627:
URL: https://github.com/apache/hudi/pull/7627
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache
danny0405 commented on PR #7627:
URL: https://github.com/apache/hudi/pull/7627#issuecomment-1525213139
The test has passed:
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=16697&view=results
--
This is an automated message from the Apache Git Service.
To res
danny0405 commented on issue #8500:
URL: https://github.com/apache/hudi/issues/8500#issuecomment-1525210337
Recently we plan to introduce completion time on the timeline:
https://github.com/apache/hudi/pull/7627, after that, we can use this
completion time to filter the timeline to resolve
danny0405 commented on PR #8432:
URL: https://github.com/apache/hudi/pull/8432#issuecomment-1525159081
> @danny0405 integrated your patch. Now I need to:
>
> * confirm the test breaks without the change
> * assert not throw npe
Yeah, that makes sense, I run the 2 tests locall
[
https://issues.apache.org/jira/browse/HUDI-6145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-6145:
-
Labels: pull-request-available (was: )
> Fix the flink table create schema to be compatible with
danny0405 opened a new pull request, #8587:
URL: https://github.com/apache/hudi/pull/8587
…park
### Change Logs
Fix the table create schema namespace and record name.
### Impact
none
### Risk level (write none, low medium or high below)
none
##
Danny Chen created HUDI-6145:
Summary: Fix the flink table create schema to be compatible with
Spark
Key: HUDI-6145
URL: https://issues.apache.org/jira/browse/HUDI-6145
Project: Apache Hudi
Issu
parisni commented on PR #8432:
URL: https://github.com/apache/hudi/pull/8432#issuecomment-1525111734
@danny0405 integrated your patch. Now I need to:
- confirm the test breaks without the change
- assert not throw npe
--
This is an automated message from the Apache Git Service.
To re
newsbreak-tonglin opened a new issue, #8586:
URL: https://github.com/apache/hudi/issues/8586
use Flink Mongo CDC fetch data from mongo to Hudi MOR table, sync ro table
success, but sync rt table failed
with error message:
2023-04-27 07:46:27,967 INFO
org.apache.hadoop.hive.me
vinothchandar commented on code in PR #6661:
URL: https://github.com/apache/hudi/pull/6661#discussion_r1178763050
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/S3EventsHoodieIncrSource.java:
##
@@ -213,15 +216,27 @@ public Pair>, String>
fetchNextBatch(Optio
codope commented on issue #4863:
URL: https://github.com/apache/hudi/issues/4863#issuecomment-1525027596
Reopening to validate against master. Please close if fixed. cc @danny0405
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitH
ghost opened a new issue, #4863:
URL: https://github.com/apache/hudi/issues/4863
**Describe the problem you faced**
* At instant time `20220221085407453`, Flink sent a compaction request to
merge the delta log files into the base parquet files.
```
2022-02-21 08:58:50,410 INFO
stream2000 commented on issue #8500:
URL: https://github.com/apache/hudi/issues/8500#issuecomment-1525023072
> since we have a tracking ticket, can we go ahead and close the github
issue.
Hi, I don't really understand how can I go ahead with this issue. Do you
mean that I should crea
Aload opened a new issue, #6102:
URL: https://github.com/apache/hudi/issues/6102
**_Tips before filing an issue_**
- Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?
- Join the mailing list to engage in conversations and get faster support at
dev-subscr...@
codope commented on issue #6102:
URL: https://github.com/apache/hudi/issues/6102#issuecomment-1525011926
Reopening to validate against master. cc @danny0405
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL abov
hudi-bot commented on PR #8582:
URL: https://github.com/apache/hudi/pull/8582#issuecomment-1525007205
## CI report:
* f77423caf9e0bc624ffbf3b5848b143acb6b3357 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1669
codope commented on issue #7352:
URL: https://github.com/apache/hudi/issues/7352#issuecomment-1525004837
Reopening to validate against master. cc @danny0405
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL abov
lklhdu opened a new issue, #7352:
URL: https://github.com/apache/hudi/issues/7352
**Describe the problem you faced**
Now I'm writing a hive sync hudi through Flink, when the sync is done, I
find that there is a very big difference between the quantity obtained from the
query and the
ad1happy2go commented on issue #6869:
URL: https://github.com/apache/hudi/issues/6869#issuecomment-1524975366
Not able to reproduce the issue. Code is working as expected.
```import org.apache.hudi.QuickstartUtils._
import scala.collection.JavaConversions._
import org.apache.spar
codope commented on issue #7191:
URL: https://github.com/apache/hudi/issues/7191#issuecomment-1524969555
> a. Few records from a table are unpartitioned and are stored in S3 with
partition name "default". i.e. year/month/day --> default/default/default
b. These records are not reflected i
alexone95 closed issue #8436: [SUPPORT] run hoodie cleaner process as a spark
submit request on EMR 6.9
URL: https://github.com/apache/hudi/issues/8436
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go t
alexone95 commented on issue #8436:
URL: https://github.com/apache/hudi/issues/8436#issuecomment-1524958582
hi, i solved by working on a labda to delete file in archive rather than the
.commit file thanks to the hoodie.keep.min.commits and hoodie.keep.max.commits
thank
--
This is an auto
ChestnutQiang commented on issue #7602:
URL: https://github.com/apache/hudi/issues/7602#issuecomment-1524936763
@danny0405 I proposed a jira on this issue and gave me a little idea
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to Git
[
https://issues.apache.org/jira/browse/HUDI-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lizhiqiang updated HUDI-6144:
-
Affects Version/s: 0.14.0
> [Spark][Flink]bucket index and then insert data in bulk, the correct file
> c
[
https://issues.apache.org/jira/browse/HUDI-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lizhiqiang updated HUDI-6144:
-
Component/s: flink-sql
spark-sql
> [Spark][Flink]bucket index and then insert data in bul
rohan-uptycs commented on code in PR #8503:
URL: https://github.com/apache/hudi/pull/8503#discussion_r1178710798
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/HoodieTimelineArchiver.java:
##
@@ -509,7 +509,15 @@ private Stream getCommitInstantsToArchive(
[
https://issues.apache.org/jira/browse/HUDI-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lizhiqiang updated HUDI-6144:
-
Description:
When I use bucket index and then insert data in bulk, the correct file cannot
be created, an
[
https://issues.apache.org/jira/browse/HUDI-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717016#comment-17717016
]
lizhiqiang commented on HUDI-6144:
--
[~danny0405]
> [Spark][Flink]bucket index and then
101 - 161 of 161 matches
Mail list logo