pftn commented on issue #8892:
URL: https://github.com/apache/hudi/issues/8892#issuecomment-1584058475
> @pftn can you please help to verify if the data in these 2 parquets are
the same?
>
> 1.
20220604/0007-3477-401f-982e-e5ae38ca0e23_3-20-6_20230510170043301.parquet
> 2.
20
danny0405 commented on code in PR #8900:
URL: https://github.com/apache/hudi/pull/8900#discussion_r1223901787
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/plan/generators/BaseHoodieCompactionPlanGenerator.java:
##
@@ -158,7 +165,8 @@ prote
hudi-bot commented on PR #8900:
URL: https://github.com/apache/hudi/pull/8900#issuecomment-1584047968
## CI report:
* 85e65864e9376baf4d84149310810983751b87eb Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=176
danny0405 commented on code in PR #8900:
URL: https://github.com/apache/hudi/pull/8900#discussion_r1223899704
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/plan/generators/BaseHoodieCompactionPlanGenerator.java:
##
@@ -158,7 +165,8 @@ prote
danny0405 commented on code in PR #8900:
URL: https://github.com/apache/hudi/pull/8900#discussion_r1223899704
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/plan/generators/BaseHoodieCompactionPlanGenerator.java:
##
@@ -158,7 +165,8 @@ prote
danny0405 commented on code in PR #8900:
URL: https://github.com/apache/hudi/pull/8900#discussion_r1223894630
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##
@@ -1021,17 +1023,46 @@ private void
runPendingTableSe
hudi-bot commented on PR #8900:
URL: https://github.com/apache/hudi/pull/8900#issuecomment-1584040360
## CI report:
* 85e65864e9376baf4d84149310810983751b87eb Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=176
hudi-bot commented on PR #8900:
URL: https://github.com/apache/hudi/pull/8900#issuecomment-1584033578
## CI report:
* f9e3b8dd406a43d5808ee93105efb9154b05a6cb Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=176
danny0405 commented on code in PR #8900:
URL: https://github.com/apache/hudi/pull/8900#discussion_r1223872493
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##
@@ -985,9 +985,10 @@ public void performTableServices(O
nsivabalan commented on code in PR #8900:
URL: https://github.com/apache/hudi/pull/8900#discussion_r1223876484
##
hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java:
##
@@ -1325,6 +1332,39 @@ public static Set
getInflightAndCompletedMetadataPartitio
zyclove commented on PR #6358:
URL: https://github.com/apache/hudi/pull/6358#issuecomment-1584019050
@aditiwari01 @ad1happy2go @alexeykudinkin alexeykudinkin
Execuse me.
This error https://github.com/apache/hudi/issues/8904
I use hudi 0.13.1 and set hoodie.datasource.write.
codope commented on code in PR #8900:
URL: https://github.com/apache/hudi/pull/8900#discussion_r1223850963
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java:
##
@@ -61,6 +61,12 @@ public class HoodieCompactionConfig extends Hoodie
danny0405 commented on code in PR #8900:
URL: https://github.com/apache/hudi/pull/8900#discussion_r1223869176
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieMergeHandleFactory.java:
##
@@ -47,6 +50,7 @@ public static HoodieMergeHandle
create(
S
suryaprasanna commented on code in PR #8900:
URL: https://github.com/apache/hudi/pull/8900#discussion_r1223865818
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataWriteUtils.java:
##
@@ -111,6 +112,10 @@ public static HoodieWriteConfig creat
nsivabalan commented on code in PR #8900:
URL: https://github.com/apache/hudi/pull/8900#discussion_r1223854254
##
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/TestHoodieClientOnMergeOnReadStorage.java:
##
@@ -314,7 +314,7 @@ public void
testSche
hudi-bot commented on PR #8900:
URL: https://github.com/apache/hudi/pull/8900#issuecomment-1583999590
## CI report:
* f9e3b8dd406a43d5808ee93105efb9154b05a6cb Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=176
hudi-bot commented on PR #8913:
URL: https://github.com/apache/hudi/pull/8913#issuecomment-1583999661
## CI report:
* 3580939238ab2c8a458df5d4a14b0a6f07ccebed Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=176
hudi-bot commented on PR #8885:
URL: https://github.com/apache/hudi/pull/8885#issuecomment-1583999528
## CI report:
* 6bcf646df9a0223b8787e7bae2255c628aea54b4 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=176
danny0405 commented on code in PR #8837:
URL: https://github.com/apache/hudi/pull/8837#discussion_r1223859381
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##
@@ -851,26 +919,49 @@ public void update(HoodieRestoreM
danny0405 commented on code in PR #8837:
URL: https://github.com/apache/hudi/pull/8837#discussion_r1223857627
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##
@@ -851,26 +919,49 @@ public void update(HoodieRestoreM
voonhous commented on issue #8892:
URL: https://github.com/apache/hudi/issues/8892#issuecomment-1583996315
@pftn can you please help to verify if the data in these 2 parquets are the
same?
1.
20220604/0007-3477-401f-982e-e5ae38ca0e23_3-20-6_20230510170043301.parquet
2.
202206
hudi-bot commented on PR #8913:
URL: https://github.com/apache/hudi/pull/8913#issuecomment-1583993645
## CI report:
* 3580939238ab2c8a458df5d4a14b0a6f07ccebed Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1769
hudi-bot commented on PR #8911:
URL: https://github.com/apache/hudi/pull/8911#issuecomment-1583993589
## CI report:
* 1ddc84cab970a6a43ea77a729213dc8c5200d845 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1769
hudi-bot commented on PR #8900:
URL: https://github.com/apache/hudi/pull/8900#issuecomment-1583993513
## CI report:
* fe74a9a7d32286ae29ded9370f6d53ccb14c8809 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1767
hudi-bot commented on PR #8885:
URL: https://github.com/apache/hudi/pull/8885#issuecomment-1583993438
## CI report:
* e2f44f2a1f574eed79090b337d7bd56e08058b51 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1768
yihua commented on PR #8885:
URL: https://github.com/apache/hudi/pull/8885#issuecomment-1583990851
@CTTY Thanks for the review. I addressed all your comments. @rahil-c
@mansipp let me know if you have more comments.
--
This is an automated message from the Apache Git Service.
To respond
yihua commented on code in PR #8885:
URL: https://github.com/apache/hudi/pull/8885#discussion_r1223853653
##
hudi-spark-datasource/hudi-spark3.4.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark34HoodieParquetFileFormat.scala:
##
@@ -0,0 +1,532 @@
+/*
+ *
hudi-bot commented on PR #8905:
URL: https://github.com/apache/hudi/pull/8905#issuecomment-1583987938
## CI report:
* f8f14263190df7b66143e192188e68463e0c1efd UNKNOWN
* f9adcecf4e54774510569f14af4c81a1f4951a28 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-
danny0405 commented on code in PR #8837:
URL: https://github.com/apache/hudi/pull/8837#discussion_r1223851326
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##
@@ -837,10 +840,75 @@ public void update(HoodieCleanMet
ad1happy2go commented on issue #8904:
URL: https://github.com/apache/hudi/issues/8904#issuecomment-1583978910
@zyclove This is known issue with hudi 0.11.1.
This was fixed with this commit - https://github.com/apache/hudi/pull/6358
Can you try out this and let us know.
--
Th
[
https://issues.apache.org/jira/browse/HUDI-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu updated HUDI-3891:
-
Epic Link: HUDI-1297
> Investigate Hudi vs Raw Parquet table discrepancy
> ---
hudi-bot commented on PR #8914:
URL: https://github.com/apache/hudi/pull/8914#issuecomment-1583960558
## CI report:
* c72b73a619fbc720e343b1fc5a0e3e9506857d1b Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1769
hudi-bot commented on PR #8913:
URL: https://github.com/apache/hudi/pull/8913#issuecomment-1583960533
## CI report:
* 3580939238ab2c8a458df5d4a14b0a6f07ccebed Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1769
[
https://issues.apache.org/jira/browse/HUDI-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen closed HUDI-6342.
Fix Version/s: 0.14.0
Resolution: Fixed
Fixed via master branch: f1c8049f81af94dc4b01b25eb80218a9d97f
This is an automated email from the ASF dual-hosted git repository.
danny0405 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 593181397e2 [HUDI-5352] Fix `LocalDate` serialization in colstats
(#8840)
add f1c8049f81a [HUDI-6342] Fixing fl
danny0405 merged PR #8910:
URL: https://github.com/apache/hudi/pull/8910
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache
codope commented on code in PR #8913:
URL: https://github.com/apache/hudi/pull/8913#discussion_r1223830445
##
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestMetadataTableWithSparkDataSource.scala:
##
@@ -84,23 +84,21 @@ class TestMetadataTableWith
danny0405 commented on issue #8126:
URL: https://github.com/apache/hudi/issues/8126#issuecomment-1583957629
Yeah, it is introduced by https://github.com/apache/hudi/pull/6657, @codope
, do you have any thoughts here?
--
This is an automated message from the Apache Git Service.
To respond
hudi-bot commented on PR #8913:
URL: https://github.com/apache/hudi/pull/8913#issuecomment-1583956648
## CI report:
* 3580939238ab2c8a458df5d4a14b0a6f07ccebed UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #8914:
URL: https://github.com/apache/hudi/pull/8914#issuecomment-1583956673
## CI report:
* c72b73a619fbc720e343b1fc5a0e3e9506857d1b UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
codope commented on code in PR #8910:
URL: https://github.com/apache/hudi/pull/8910#discussion_r1223827683
##
hudi-utilities/src/test/java/org/apache/hudi/utilities/deltastreamer/TestHoodieDeltaStreamerWithMultiWriter.java:
##
@@ -404,12 +405,24 @@ private void runJobsInParallel
danny0405 commented on code in PR #8913:
URL: https://github.com/apache/hudi/pull/8913#discussion_r1223826247
##
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestMetadataTableWithSparkDataSource.scala:
##
@@ -84,23 +84,21 @@ class TestMetadataTableW
danny0405 commented on code in PR #8913:
URL: https://github.com/apache/hudi/pull/8913#discussion_r1223825494
##
hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java:
##
@@ -1453,11 +1453,7 @@ public static String
deleteMetadataTablePartition(HoodieTa
[
https://issues.apache.org/jira/browse/HUDI-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-6344:
-
Labels: pull-request-available (was: )
> Support Flink MDT bulk_insert
>
danny0405 opened a new pull request, #8914:
URL: https://github.com/apache/hudi/pull/8914
### Change Logs
Fix the bulk_insert for Flink MDT initialization after #8684 .
### Impact
none
### Risk level (write none, low medium or high below)
none
### Doc
hudi-bot commented on PR #8910:
URL: https://github.com/apache/hudi/pull/8910#issuecomment-1583949317
## CI report:
* fc4825fd3b646e3b69322b386fa4b2fd4f19ba67 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1768
Danny Chen created HUDI-6344:
Summary: Support Flink MDT bulk_insert
Key: HUDI-6344
URL: https://issues.apache.org/jira/browse/HUDI-6344
Project: Apache Hudi
Issue Type: Improvement
Com
[
https://issues.apache.org/jira/browse/HUDI-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen updated HUDI-6344:
-
Fix Version/s: 0.14.0
> Support Flink MDT bulk_insert
> -
>
>
nsivabalan commented on PR #8910:
URL: https://github.com/apache/hudi/pull/8910#issuecomment-1583934703
we have an unrelated test failure
```
Test Call run_clustering Procedure Order Strategy *** FAILED ***
```
since this patch is also fixing a flaky test, prefer to go ahead w/ l
[
https://issues.apache.org/jira/browse/HUDI-6343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-6343:
-
Labels: pull-request-available (was: )
> File id format differs from FILES partition and others w
nsivabalan opened a new pull request, #8913:
URL: https://github.com/apache/hudi/pull/8913
### Change Logs
Fixing fileId format for all mdt partitions. When bulk_insert gets
triggered, the fileId will get suffixed with "-0" in the end. And so, we might
need to ensure the initial inst
sivabalan narayanan created HUDI-6343:
-
Summary: File id format differs from FILES partition and others
when its initialized for first time
Key: HUDI-6343
URL: https://issues.apache.org/jira/browse/HUDI-6343
hudi-bot commented on PR #8885:
URL: https://github.com/apache/hudi/pull/8885#issuecomment-1583913902
## CI report:
* e2f44f2a1f574eed79090b337d7bd56e08058b51 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1768
hudi-bot commented on PR #8885:
URL: https://github.com/apache/hudi/pull/8885#issuecomment-1583907653
## CI report:
* e2f44f2a1f574eed79090b337d7bd56e08058b51 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1768
yihua commented on code in PR #8885:
URL: https://github.com/apache/hudi/pull/8885#discussion_r1223791778
##
hudi-common/src/main/java/org/apache/hudi/common/util/JsonUtils.java:
##
@@ -35,6 +36,8 @@ public class JsonUtils {
private static final ObjectMapper MAPPER = new Obje
zyclove opened a new issue, #8912:
URL: https://github.com/apache/hudi/issues/8912
**Describe the problem you faced**
hudi timing spark-sql scheduling tasks sometimes appear
org.apache.hudi.exception.HoodieIOException: IOException when reading log file.
**To Reproduce**
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 80e0b557ffe [HUDI-6310]
CreateHoodieTableCommand::createHiveDataSourceTable arguments refactor (#8874)
add 59318139
yihua merged PR #8840:
URL: https://github.com/apache/hudi/pull/8840
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
hudi-bot commented on PR #8900:
URL: https://github.com/apache/hudi/pull/8900#issuecomment-1583854119
## CI report:
* fe74a9a7d32286ae29ded9370f6d53ccb14c8809 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1767
zyclove commented on issue #8903:
URL: https://github.com/apache/hudi/issues/8903#issuecomment-1583849913
@umehrot2
hi，Hudi Experts, can anyone help me? The prod env problem is more urgent,
looking forward to an early reply.
--
This is an automated message from the Apache Git
zyclove commented on issue #8904:
URL: https://github.com/apache/hudi/issues/8904#issuecomment-1583848717
hi，Hudi Experts, can anyone help me? The prod env problem is more urgent,
looking forward to an early reply.
--
This is an automated message from the Apache Git Service.
To respond to
hudi-bot commented on PR #8911:
URL: https://github.com/apache/hudi/pull/8911#issuecomment-1583844595
## CI report:
* 1ddc84cab970a6a43ea77a729213dc8c5200d845 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1769
hudi-bot commented on PR #8900:
URL: https://github.com/apache/hudi/pull/8900#issuecomment-1583844504
## CI report:
* fe74a9a7d32286ae29ded9370f6d53ccb14c8809 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1767
hudi-bot commented on PR #8840:
URL: https://github.com/apache/hudi/pull/8840#issuecomment-1583844187
## CI report:
* 80b25e613cbcdf8f3e1efe39436cad173163d9d9 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1768
boneanxs commented on code in PR #8452:
URL: https://github.com/apache/hudi/pull/8452#discussion_r1223761168
##
hudi-common/src/main/java/org/apache/hudi/metadata/FileSystemBackedTableMetadata.java:
##
@@ -50,20 +56,25 @@
/**
* Implementation of {@link HoodieTableMetadata} ba
hudi-bot commented on PR #8911:
URL: https://github.com/apache/hudi/pull/8911#issuecomment-1583838150
## CI report:
* 1ddc84cab970a6a43ea77a729213dc8c5200d845 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #8905:
URL: https://github.com/apache/hudi/pull/8905#issuecomment-1583838091
## CI report:
* f8f14263190df7b66143e192188e68463e0c1efd UNKNOWN
* f9adcecf4e54774510569f14af4c81a1f4951a28 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-
thomasg19930417 commented on issue #8882:
URL: https://github.com/apache/hudi/issues/8882#issuecomment-1583807262
I probably looked at the hive branch 2.0 2.1 code and it should be the same
as 2.2
--
This is an automated message from the Apache Git Service.
To respond to the message, plea
stream2000 commented on PR #8905:
URL: https://github.com/apache/hudi/pull/8905#issuecomment-1583798165
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
thomasg19930417 commented on PR #8911:
URL: https://github.com/apache/hudi/pull/8911#issuecomment-1583794413
@danny0405 Please help to review the code
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
hudi-bot commented on PR #8910:
URL: https://github.com/apache/hudi/pull/8910#issuecomment-1583793617
## CI report:
* fc4825fd3b646e3b69322b386fa4b2fd4f19ba67 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1768
thomasg19930417 commented on issue #8882:
URL: https://github.com/apache/hudi/issues/8882#issuecomment-1583792529
@danny0405 I submitted a pr to be compatible with hive2.2, copied part of
the code of hive2.3 to hudi, and converted the data structure of hive2.2 to the
form in 2.3 for process
danny0405 merged PR #8874:
URL: https://github.com/apache/hudi/pull/8874
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache
This is an automated email from the ASF dual-hosted git repository.
danny0405 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 7ae8da02d12 [HUDI-6200] Enhancements to the MDT for improving
performance of larger indexes. (#8684)
add 80e0b5
danny0405 commented on issue #8906:
URL: https://github.com/apache/hudi/issues/8906#issuecomment-1583786336
you are right, bucket index for bulk_insert in supported only in latest
master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on
thomasg19930417 opened a new pull request, #8911:
URL: https://github.com/apache/hudi/pull/8911
### Change Logs
_Describe context and summary for this change. Highlight if any code was
copied._
### Impact
_Describe any public API or user-facing feature change or any perf
hudi-bot commented on PR #8910:
URL: https://github.com/apache/hudi/pull/8910#issuecomment-1583784756
## CI report:
* fc4825fd3b646e3b69322b386fa4b2fd4f19ba67 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
danny0405 commented on code in PR #8684:
URL: https://github.com/apache/hudi/pull/8684#discussion_r1223719557
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##
@@ -1052,51 +1091,81 @@ protected HoodieData
prepRecor
nsivabalan commented on code in PR #8910:
URL: https://github.com/apache/hudi/pull/8910#discussion_r1223690819
##
hudi-utilities/src/test/java/org/apache/hudi/utilities/deltastreamer/TestHoodieDeltaStreamerWithMultiWriter.java:
##
@@ -404,12 +405,24 @@ private void runJobsInPara
[
https://issues.apache.org/jira/browse/HUDI-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-6342:
-
Labels: pull-request-available (was: )
> Fix flaky MultiTableDeltaStreamer test
> ---
nsivabalan opened a new pull request, #8910:
URL: https://github.com/apache/hudi/pull/8910
### Change Logs
Fixing flaky Continuous mode multi writer tests. Exception thrown when
continuous mode job fails is different than exception thrown while backfill job
fails. So, had to fix the
[
https://issues.apache.org/jira/browse/HUDI-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-6342:
--
Epic Link: HUDI-4302
> Fix flaky MultiTableDeltaStreamer test
>
sivabalan narayanan created HUDI-6342:
-
Summary: Fix flaky MultiTableDeltaStreamer test
Key: HUDI-6342
URL: https://issues.apache.org/jira/browse/HUDI-6342
Project: Apache Hudi
Issue Type
[
https://issues.apache.org/jira/browse/HUDI-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-6315:
-
Labels: pull-request-available (was: )
> Optimize UPSERT codepath to use meta fields instead of k
nsivabalan commented on code in PR #8879:
URL: https://github.com/apache/hudi/pull/8879#discussion_r175056
##
hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/DataSourceUtils.java:
##
@@ -233,15 +238,25 @@ public static HoodieWriteResult
doDeletePartiti
yihua commented on PR #8885:
URL: https://github.com/apache/hudi/pull/8885#issuecomment-1583654629
Hi @zhangyue19921010 @xiarixiaoyao @nsivabalan @xushiyan @danny0405, could
you also review this PR?
--
This is an automated message from the Apache Git Service.
To respond to the message, pl
yihua commented on code in PR #8885:
URL: https://github.com/apache/hudi/pull/8885#discussion_r1223651454
##
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/command/index/TestIndexSyntax.scala:
##
@@ -56,30 +58,37 @@ class TestIndexSyntax extends Hoodie
hudi-bot commented on PR #8885:
URL: https://github.com/apache/hudi/pull/8885#issuecomment-1583605229
## CI report:
* e2f44f2a1f574eed79090b337d7bd56e08058b51 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1768
hudi-bot commented on PR #8840:
URL: https://github.com/apache/hudi/pull/8840#issuecomment-1583605102
## CI report:
* 29e4627d6ec492fb19b64777fbc4ae8e2091d6e0 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=176
mpouttu commented on issue #498:
URL: https://github.com/apache/hudi/issues/498#issuecomment-1583601589
_hoodie_is_deleted allows us to delete records and replace them with new
records in the same transaction which is essential for some of our use cases.
EmptyHoodieRecordPayload forces us t
hudi-bot commented on PR #8840:
URL: https://github.com/apache/hudi/pull/8840#issuecomment-1583596337
## CI report:
* 3461a1e2fbcc7b51e06f4bf803b6753466396c95 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1747
hudi-bot commented on PR #8840:
URL: https://github.com/apache/hudi/pull/8840#issuecomment-1583582258
## CI report:
* 3461a1e2fbcc7b51e06f4bf803b6753466396c95 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1747
hudi-bot commented on PR #8840:
URL: https://github.com/apache/hudi/pull/8840#issuecomment-1583486543
## CI report:
* 3461a1e2fbcc7b51e06f4bf803b6753466396c95 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1747
hudi-bot commented on PR #8885:
URL: https://github.com/apache/hudi/pull/8885#issuecomment-1583469483
## CI report:
* e2f44f2a1f574eed79090b337d7bd56e08058b51 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1768
hudi-bot commented on PR #8885:
URL: https://github.com/apache/hudi/pull/8885#issuecomment-1583463698
## CI report:
* e2f44f2a1f574eed79090b337d7bd56e08058b51 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
yihua commented on code in PR #8840:
URL: https://github.com/apache/hudi/pull/8840#discussion_r1223597615
##
hudi-common/src/main/java/org/apache/hudi/common/util/JsonUtils.java:
##
@@ -20,41 +20,74 @@
package org.apache.hudi.common.util;
import org.apache.hudi.exception.Hoo
jonvex opened a new pull request, #8909:
URL: https://github.com/apache/hudi/pull/8909
### Change Logs
Insert into updated for new behavior
Insert overwrite updated for current behavior
https://issues.apache.org/jira/browse/HUDI-6021
Create table updated for pkless
### Impact
yihua commented on code in PR #8885:
URL: https://github.com/apache/hudi/pull/8885#discussion_r1223580325
##
hudi-spark-datasource/hudi-spark3.2.x/src/main/scala/org/apache/spark/sql/HoodieSpark32CatalystPlanUtils.scala:
##
@@ -38,6 +36,14 @@ object HoodieSpark32CatalystPlanUtil
yihua commented on code in PR #8885:
URL: https://github.com/apache/hudi/pull/8885#discussion_r1223579632
##
hudi-common/src/main/java/org/apache/hudi/common/util/JsonUtils.java:
##
@@ -35,6 +36,8 @@ public class JsonUtils {
private static final ObjectMapper MAPPER = new Obje
pthalasta commented on issue #8901:
URL: https://github.com/apache/hudi/issues/8901#issuecomment-1583381245
I was able to add some env variable as mentioned in the warning message,
however, the job never terminates and these are the last few lines of the logs
that i see
```
23/06/
1 - 100 of 193 matches
Mail list logo
