[jira] [Closed] (HUDI-5749) 0.13.0 release note part 7

2023-02-10 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-5749. Resolution: Fixed > 0.13.0 release note part 7 > -- > > Key:

[GitHub] [hudi] hudi-bot commented on pull request #7598: [HUDI-5495] add some property to table config

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7598: URL: https://github.com/apache/hudi/pull/7598#issuecomment-1426645541 ## CI report: * 0bd3bcfaaebcb26b541acdc61cfe3bf1ba1df985 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7921: [HUDI-5764][DO NOT MERGE] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7921: URL: https://github.com/apache/hudi/pull/7921#issuecomment-1426644633 ## CI report: * 456c8e42f01fb54da865815781b927cb3d1c0936 Azure:

[GitHub] [hudi] danny0405 commented on a diff in pull request #6121: [HUDI-4406] Support Flink compaction/clustering write error resolvement to avoid data loss

2023-02-10 Thread via GitHub
danny0405 commented on code in PR #6121: URL: https://github.com/apache/hudi/pull/6121#discussion_r1103540589 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/ClusteringCommitSink.java: ## @@ -119,7 +119,16 @@ private void

[GitHub] [hudi] hudi-bot commented on pull request #7914: [HUDI-5080] Unpersist only relevant RDDs instead of all

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7914: URL: https://github.com/apache/hudi/pull/7914#issuecomment-1426632450 ## CI report: * 319132092c5c1521ff11a2100bd325e5a280459f UNKNOWN * b4471586094e6549c793b38276bab2b4907f2ab1 Azure:

[GitHub] [hudi] danny0405 commented on pull request #7633: [HUDI-5737] Fix Deletes issued without any prior commits

2023-02-10 Thread via GitHub
danny0405 commented on PR #7633: URL: https://github.com/apache/hudi/pull/7633#issuecomment-1426631895 The cmd to rebase the code: ```shell -- fetch upstream branch 'master', assume you already set up the upstream as the hudi git repository git fetch upstream master; --

[GitHub] [hudi] danny0405 commented on issue #7892: [hudi-flink] flink sql query same table (join or union), it occurs source uid collision

2023-02-10 Thread via GitHub
danny0405 commented on issue #7892: URL: https://github.com/apache/hudi/issues/7892#issuecomment-1426631376 We need specific uid for the operator for savepoint revover, if you do not need the savepoint, you can change the code to remove the explicit operator UID. -- This is an

[GitHub] [hudi] danny0405 commented on a diff in pull request #7894: [HUDI-5729]Fix RowDataKeyGen method getRecordKey

2023-02-10 Thread via GitHub
danny0405 commented on code in PR #7894: URL: https://github.com/apache/hudi/pull/7894#discussion_r1103538356 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/bulk/RowDataKeyGen.java: ## @@ -173,12 +179,14 @@ public String getPartitionPath(RowData rowData)

[GitHub] [hudi] danny0405 commented on a diff in pull request #7894: [HUDI-5729]Fix RowDataKeyGen method getRecordKey

2023-02-10 Thread via GitHub
danny0405 commented on code in PR #7894: URL: https://github.com/apache/hudi/pull/7894#discussion_r1103538269 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/bulk/RowDataKeyGen.java: ## @@ -153,10 +159,10 @@ public String getRecordKey(RowData rowData) {

[GitHub] [hudi] danny0405 commented on a diff in pull request #7894: [HUDI-5729]Fix RowDataKeyGen method getRecordKey

2023-02-10 Thread via GitHub
danny0405 commented on code in PR #7894: URL: https://github.com/apache/hudi/pull/7894#discussion_r1103538332 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/bulk/RowDataKeyGen.java: ## @@ -153,10 +159,10 @@ public String getRecordKey(RowData rowData) {

[GitHub] [hudi] danny0405 commented on issue #7910: [SUPPORT]

2023-02-10 Thread via GitHub
danny0405 commented on issue #7910: URL: https://github.com/apache/hudi/issues/7910#issuecomment-1426630077 One reason I can think of is for MOR table, when there are pending compaction on the FileSlice, the FileSlice is then ignored for being the target small files, that is somehow where

[GitHub] [hudi] danny0405 commented on issue #7897: [SUPPORT]the compaction of the MOR hudi table keeps the old values

2023-02-10 Thread via GitHub
danny0405 commented on issue #7897: URL: https://github.com/apache/hudi/issues/7897#issuecomment-1426629317 > I noticed that for each new record I append I had parquet file,so, first parquet has the first record, then when i insert new row a second parquet file created with both records,

[GitHub] [hudi] danny0405 merged pull request #7911: [MINOR] remove unnecessary TestCallExpressions which are adapters for CallExpression

2023-02-10 Thread via GitHub
danny0405 merged PR #7911: URL: https://github.com/apache/hudi/pull/7911 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated (67f4c78c5a0 -> 3e31ca73828)

2023-02-10 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 67f4c78c5a0 [HUDI-5758] Restoring state of `HoodieKey` to make sure it's binary compatible w/ its state in 0.12

[GitHub] [hudi] danny0405 commented on issue #7252: [SUPPORT] Error to write hudi table into minio s3 bucket

2023-02-10 Thread via GitHub
danny0405 commented on issue #7252: URL: https://github.com/apache/hudi/issues/7252#issuecomment-1426626322 Does the directory exist on the storage already? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] danny0405 commented on pull request #7490: [HUDI-5407][HUDI-5408] Fixing rollback in MDT to be eager

2023-02-10 Thread via GitHub
danny0405 commented on PR #7490: URL: https://github.com/apache/hudi/pull/7490#issuecomment-1426623404 > @danny0405 : we have scanV2 which already fixes this. Migrating to scanV2 is the plan in next release. Please make sure all the engines have the fix, scanV2 sounds like a Spark

[GitHub] [hudi] hudi-bot commented on pull request #7914: [HUDI-5080] Unpersist only relevant RDDs instead of all

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7914: URL: https://github.com/apache/hudi/pull/7914#issuecomment-1426620442 ## CI report: * 319132092c5c1521ff11a2100bd325e5a280459f UNKNOWN * b4471586094e6549c793b38276bab2b4907f2ab1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7680: [HUDI-5548] spark sql show | update hudi's table properties

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7680: URL: https://github.com/apache/hudi/pull/7680#issuecomment-1426620358 ## CI report: * f34c9eaa7c0d5741490c4ff4180a945df34d8c93 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7598: [HUDI-5495] add some property to table config

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7598: URL: https://github.com/apache/hudi/pull/7598#issuecomment-1426620324 ## CI report: * b544e5f01b03220a23f4a4930fa0550e1f7fc588 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7680: [HUDI-5548] spark sql show | update hudi's table properties

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7680: URL: https://github.com/apache/hudi/pull/7680#issuecomment-1426619329 ## CI report: * f34c9eaa7c0d5741490c4ff4180a945df34d8c93 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7598: [HUDI-5495] add some property to table config

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7598: URL: https://github.com/apache/hudi/pull/7598#issuecomment-1426619295 ## CI report: * b544e5f01b03220a23f4a4930fa0550e1f7fc588 Azure:

[GitHub] [hudi] XuQianJin-Stars commented on pull request #7918: [MINOR] Fix spark sql run clean do not exit

2023-02-10 Thread via GitHub
XuQianJin-Stars commented on PR #7918: URL: https://github.com/apache/hudi/pull/7918#issuecomment-1426618238 > see the CI's error > > ``` > [ERROR] Failures: > [ERROR] TestHoodieTableFactory.testTableTypeCheck:192 Expected org.apache.hudi.exception.HoodieValidationException

[GitHub] [hudi] hudi-bot commented on pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7921: URL: https://github.com/apache/hudi/pull/7921#issuecomment-1426611226 ## CI report: * f8e4cf8e34fe2941419568caded8cef9e01c1366 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7921: URL: https://github.com/apache/hudi/pull/7921#issuecomment-1426609736 ## CI report: * 690b16071b95fba806d28ae29bb3bfb8eebf27c5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7672: [HUDI-5557]Avoid converting columns that are not indexed in CSI

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7672: URL: https://github.com/apache/hudi/pull/7672#issuecomment-1426608460 ## CI report: * 34b46d43bb9e5f23cc8a2f03a95bf09195329dfd Azure:

[GitHub] [hudi] codope commented on a diff in pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
codope commented on code in PR #7921: URL: https://github.com/apache/hudi/pull/7921#discussion_r1103490799 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieTableServiceClient.java: ## @@ -811,6 +860,11 @@ private Option

[GitHub] [hudi] yihua commented on a diff in pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
yihua commented on code in PR #7921: URL: https://github.com/apache/hudi/pull/7921#discussion_r1103502951 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java: ## @@ -875,7 +879,11 @@ public void

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
nsivabalan commented on code in PR #7921: URL: https://github.com/apache/hudi/pull/7921#discussion_r1103501668 ## hudi-utilities/src/test/java/org/apache/hudi/utilities/TestHoodieIndexer.java: ## @@ -147,6 +148,26 @@ public void testIndexerWithFilesPartition() {

[GitHub] [hudi] yihua commented on a diff in pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
yihua commented on code in PR #7921: URL: https://github.com/apache/hudi/pull/7921#discussion_r1103501262 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java: ## @@ -1125,7 +1130,10 @@ private void initialCommit(String

[GitHub] [hudi] yihua commented on a diff in pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
yihua commented on code in PR #7921: URL: https://github.com/apache/hudi/pull/7921#discussion_r1103501151 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java: ## @@ -875,7 +879,11 @@ public void

[GitHub] [hudi] hudi-bot commented on pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7921: URL: https://github.com/apache/hudi/pull/7921#issuecomment-1426592042 ## CI report: * 690b16071b95fba806d28ae29bb3bfb8eebf27c5 Azure:

[GitHub] [hudi] hbgstc123 commented on a diff in pull request #7886: [HUDI-5726]Fix timestamp field is 8 hours longer than the time

2023-02-10 Thread via GitHub
hbgstc123 commented on code in PR #7886: URL: https://github.com/apache/hudi/pull/7886#discussion_r1103497428 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java: ## @@ -275,7 +275,7 @@ private FlinkOptions() { public static

[GitHub] [hudi] hbgstc123 commented on a diff in pull request #7886: [HUDI-5726]Fix timestamp field is 8 hours longer than the time

2023-02-10 Thread via GitHub
hbgstc123 commented on code in PR #7886: URL: https://github.com/apache/hudi/pull/7886#discussion_r1103497428 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java: ## @@ -275,7 +275,7 @@ private FlinkOptions() { public static

[GitHub] [hudi] hudi-bot commented on pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7921: URL: https://github.com/apache/hudi/pull/7921#issuecomment-1426589662 ## CI report: * 690b16071b95fba806d28ae29bb3bfb8eebf27c5 Azure:

[hudi] 11/20: [HUDI-5515] Fix concurrency conflict in ClusteringOperator with latency marker (#7625)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 09df730555737dd6ce91151467d28d3f1c73d112 Author: Thinker313 <47049042+thinker...@users.noreply.github.com>

[hudi] branch release-0.12.1 updated (2a3b0b5af8a -> 45bef56db55)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a change to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git from 2a3b0b5af8a add DeleteFsFileProcedure new d8043d48ea0 fix metatable hbase-site new ebf99a7e84f

[hudi] 08/20: fix Zhiyan metrics reporter

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 5e2db20bb20537754408bbf690caf25bbf587cd9 Author: XuQianJin-Stars AuthorDate: Mon Feb 6 17:15:58 2023 +0800

[hudi] 03/20: improve BackupInvalidParquetProcedure

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 9a9fd985f2f7d251af848b7034c5b4b1bc0ac8c9 Author: XuQianJin-Stars AuthorDate: Sat Feb 4 15:03:35 2023 +0800

[hudi] 10/20: [HUDI-5343] HoodieFlinkStreamer supports async clustering for append mode (#7403)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 59094436c9d6fae5b729a38e1d192993446ed504 Author: Nicholas Jiang AuthorDate: Wed Dec 28 20:14:51 2022 +0800

[hudi] 09/20: [MINOR] improve RunClusteringProcedure with partition selected

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit cca17a599d6c571297c91c5a8d9a9c790d0ce258 Author: XuQianJin-Stars AuthorDate: Tue Feb 7 14:01:21 2023 +0800

[hudi] 12/20: [HUDI-5543] Description of clustering.plan.partition.filter.mode supports DAY_ROLLING strategy (#7656)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 94ee9a133adf72c5c79b89ea2c9ce601d6b7f494 Author: Nicholas Jiang AuthorDate: Fri Jan 13 10:59:26 2023 +0800

[hudi] 18/20: [HUDI-5286] UnsupportedOperationException throws when enabling filesystem retry (#7313)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 0f056e52e583828a7fbbb21454e60d1a9b74d48d Author: Danny Chan AuthorDate: Tue Nov 29 10:20:41 2022 +0800

[hudi] 07/20: fix enable metrics on

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 2c8586f5a3b4f1a88340676f1e207bc85c5a740c Author: XuQianJin-Stars AuthorDate: Sun Feb 5 10:38:35 2023 +0800

[hudi] 20/20: [HUDI-5495] add some property to table config

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 45bef56db5509cacac927c28eb8d86b6b6bf652d Author: XuQianJin-Stars AuthorDate: Sat Feb 11 10:21:13 2023 +0800

[hudi] 17/20: [HUDI-4968] Update misleading read.streaming.skip_compaction/skip_clustering config (#6856)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 108c6afd308421f79ead6fc2524704db6b33161e Author: voonhous AuthorDate: Wed Feb 8 14:40:55 2023 +0800

[hudi] 16/20: [HUDI-5506] StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event (#7611)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit c265ddcc4b5bb307de319cb303ac249c85f787c2 Author: Nicholas Jiang AuthorDate: Fri Jan 6 20:32:42 2023 +0800

[hudi] 14/20: [HUDI-5341] CleanPlanner retains earliest commits must not be later than earliest pending commit (#7568)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit ee779fe86fef3ecf2144e72a7e90c75d15ad1ded Author: Nicholas Jiang AuthorDate: Fri Jan 6 20:29:29 2023 +0800

[hudi] 15/20: improve getCommitInstantsToArchive data duplication

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit e44285447a1a7eb6f3b3d49e00d653cb910b19d0 Author: XuQianJin-Stars AuthorDate: Tue Feb 7 22:16:09 2023 +0800

[hudi] 02/20: [HUDI-5278] Support more conf to cluster procedure (#7304)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit ebf99a7e84f2c937a968a5a51f48945919c07015 Author: KnightChess <981159...@qq.com> AuthorDate: Wed Nov 30 09:02:07

[hudi] 13/20: [HUDI-5235] Clustering target size should larger than small file limit (#7232)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 700717c7344128f60a42795006b12daa063fc6d1 Author: zhuanshenbsj1

[hudi] 01/20: fix metatable hbase-site

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit d8043d48ea0d5914b032779f23ee06fd6b23f2cc Author: XuQianJin-Stars AuthorDate: Wed Feb 1 16:21:53 2023 +0800

[hudi] 19/20: add DropPartitionsProcedure

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 7588b918de23f12e098fdde6acac97dfd5c559c2 Author: XuQianJin-Stars AuthorDate: Fri Feb 10 15:22:23 2023 +0800

[hudi] 04/20: [HUDI-5671] BucketIndexPartitioner partition algorithm skew (#7815)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 0344765bdf3a65a4fe2ce37a2d5ec3f5b3561429 Author: luokey <854194...@qq.com> AuthorDate: Fri Feb 3 00:56:07 2023

[hudi] 05/20: [HUDI-5318] Fix partition pruning for clustering scheduling (#7366)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 3c4a403a0a3fdb51027c0f2f76106322132513ff Author: StreamingFlames <18889897...@163.com> AuthorDate: Wed Dec 14

[hudi] 06/20: [HUDI-5326] Fix clustering group building in SparkSizeBasedClusteringPlanStrategy (#7372)

2023-02-10 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit b0a0912cfaf869234453e89d0d0ccf60c8dde98b Author: Zouxxyy AuthorDate: Wed Jan 11 09:52:42 2023 +0800

[GitHub] [hudi] hudi-bot commented on pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7921: URL: https://github.com/apache/hudi/pull/7921#issuecomment-1426579648 ## CI report: * 690b16071b95fba806d28ae29bb3bfb8eebf27c5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7680: [HUDI-5548] spark sql show | update hudi's table properties

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7680: URL: https://github.com/apache/hudi/pull/7680#issuecomment-1426579516 ## CI report: * b87dbc4ca43aa4e2565f11d87d74cd018b95b6cf Azure:

[GitHub] [hudi] yihua commented on a diff in pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
yihua commented on code in PR #7921: URL: https://github.com/apache/hudi/pull/7921#discussion_r1103486098 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java: ## @@ -1125,7 +1130,10 @@ private void initialCommit(String

[GitHub] [hudi] hudi-bot commented on pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7921: URL: https://github.com/apache/hudi/pull/7921#issuecomment-1426576345 ## CI report: * 690b16071b95fba806d28ae29bb3bfb8eebf27c5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7680: [HUDI-5548] spark sql show | update hudi's table properties

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7680: URL: https://github.com/apache/hudi/pull/7680#issuecomment-1426576215 ## CI report: * b87dbc4ca43aa4e2565f11d87d74cd018b95b6cf Azure:

[GitHub] [hudi] yihua commented on a diff in pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
yihua commented on code in PR #7921: URL: https://github.com/apache/hudi/pull/7921#discussion_r1103483491 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieTableServiceClient.java: ## @@ -659,8 +662,46 @@ protected Map> getPendingRollbackInfos

[GitHub] [hudi] hudi-bot commented on pull request #7920: support absolute path names for hierarchical configs

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7920: URL: https://github.com/apache/hudi/pull/7920#issuecomment-1426574917 ## CI report: * 7e1eaeb60befcac05ceb7d1bf4b84164b914a4d2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7914: [HUDI-5080] Unpersist only relevant RDDs instead of all

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7914: URL: https://github.com/apache/hudi/pull/7914#issuecomment-1426574904 ## CI report: * 319132092c5c1521ff11a2100bd325e5a280459f UNKNOWN * b4471586094e6549c793b38276bab2b4907f2ab1 Azure:

[GitHub] [hudi] yihua commented on a diff in pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
yihua commented on code in PR #7921: URL: https://github.com/apache/hudi/pull/7921#discussion_r1103483348 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieTableServiceClient.java: ## @@ -659,8 +662,46 @@ protected Map> getPendingRollbackInfos

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
nsivabalan commented on code in PR #7921: URL: https://github.com/apache/hudi/pull/7921#discussion_r1103473377 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieTableServiceClient.java: ## @@ -659,8 +662,46 @@ protected Map>

[GitHub] [hudi] XuQianJin-Stars commented on pull request #7918: [MINOR] Fix spark sql run clean do not exit

2023-02-10 Thread via GitHub
XuQianJin-Stars commented on PR #7918: URL: https://github.com/apache/hudi/pull/7918#issuecomment-1426562740 see the CI's error ``` [ERROR] Failures: [ERROR] TestHoodieTableFactory.testTableTypeCheck:192 Expected org.apache.hudi.exception.HoodieValidationException to be thrown,

[GitHub] [hudi] yihua commented on a diff in pull request #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
yihua commented on code in PR #7921: URL: https://github.com/apache/hudi/pull/7921#discussion_r1103472610 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java: ## @@ -1279,8 +1279,21 @@ protected void tryUpgrade(HoodieTableMetaClient

[jira] [Updated] (HUDI-5764) Allow lazy rollback for async indexer commit

2023-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5764: - Labels: pull-request-available (was: ) > Allow lazy rollback for async indexer commit >

[GitHub] [hudi] yihua opened a new pull request, #7921: [HUDI-5764] Roll back delta commits from `HoodieIndexer` lazily in metadata table

2023-02-10 Thread via GitHub
yihua opened a new pull request, #7921: URL: https://github.com/apache/hudi/pull/7921 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance

[GitHub] [hudi] hudi-bot commented on pull request #7672: [HUDI-5557]Avoid converting columns that are not indexed in CSI

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7672: URL: https://github.com/apache/hudi/pull/7672#issuecomment-1426557417 ## CI report: * Unknown: [CANCELED](TBD) * 34b46d43bb9e5f23cc8a2f03a95bf09195329dfd Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7672: [HUDI-5557]Avoid converting columns that are not indexed in CSI

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7672: URL: https://github.com/apache/hudi/pull/7672#issuecomment-1426555335 ## CI report: * 34b46d43bb9e5f23cc8a2f03a95bf09195329dfd UNKNOWN * Unknown: [CANCELED](TBD) Bot commands @hudi-bot supports the following commands: -

[GitHub] [hudi] hudi-bot commented on pull request #7672: [HUDI-5557]Avoid converting columns that are not indexed in CSI

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7672: URL: https://github.com/apache/hudi/pull/7672#issuecomment-1426553090 ## CI report: * 024847dc7e59c207309ce20432fe57e51956fb16 Azure:

[GitHub] [hudi] rfyu commented on pull request #7672: [HUDI-5557]Avoid converting columns that are not indexed in CSI

2023-02-10 Thread via GitHub
rfyu commented on PR #7672: URL: https://github.com/apache/hudi/pull/7672#issuecomment-1426535500 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot commented on pull request #7672: [HUDI-5557]Avoid converting columns that are not indexed in CSI

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7672: URL: https://github.com/apache/hudi/pull/7672#issuecomment-1426528782 ## CI report: * 46e27a0438ecf51a0faee5dbee9d710b44cf0572 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7672: [HUDI-5557]Avoid converting columns that are not indexed in CSI

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7672: URL: https://github.com/apache/hudi/pull/7672#issuecomment-1426522207 ## CI report: * 46e27a0438ecf51a0faee5dbee9d710b44cf0572 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7920: support absolute path names for hierarchical configs

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7920: URL: https://github.com/apache/hudi/pull/7920#issuecomment-1426489661 ## CI report: * 7e1eaeb60befcac05ceb7d1bf4b84164b914a4d2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7920: support absolute path names for hierarchical configs

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7920: URL: https://github.com/apache/hudi/pull/7920#issuecomment-1426484702 ## CI report: * 7e1eaeb60befcac05ceb7d1bf4b84164b914a4d2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] jonvex opened a new pull request, #7920: support absolute path names for hierarchical configs

2023-02-10 Thread via GitHub
jonvex opened a new pull request, #7920: URL: https://github.com/apache/hudi/pull/7920 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance

[hudi] branch master updated (653aa86145f -> 67f4c78c5a0)

2023-02-10 Thread akudinkin
This is an automated email from the ASF dual-hosted git repository. akudinkin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 653aa86145f [MINOR] Fix wrong assertion in TestHoodieTableFactory.java (#7916) add 67f4c78c5a0 [HUDI-5758]

[GitHub] [hudi] alexeykudinkin merged pull request #7917: [HUDI-5758] Restoring state of `HoodieKey` to make sure it's binary compatible w/ its state in 0.12

2023-02-10 Thread via GitHub
alexeykudinkin merged PR #7917: URL: https://github.com/apache/hudi/pull/7917 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] alexeykudinkin commented on pull request #7917: [HUDI-5758] Restoring state of `HoodieKey` to make sure it's binary compatible w/ its state in 0.12

2023-02-10 Thread via GitHub
alexeykudinkin commented on PR #7917: URL: https://github.com/apache/hudi/pull/7917#issuecomment-1426457488 CI is green: https://user-images.githubusercontent.com/428277/218218673-51fed9fb-54a7-404c-8857-3b9553d6e8a9.png;>

[jira] [Updated] (HUDI-5767) Add known regression of Hive Sync performance to release notes

2023-02-10 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5767: Description: This PR fixes the Hive Sync performance: https://github.com/apache/hudi/pull/7561 We should

[jira] [Updated] (HUDI-5767) Add known regression of Hive Sync performance to release notes

2023-02-10 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5767: Priority: Critical (was: Major) > Add known regression of Hive Sync performance to release notes >

[jira] [Assigned] (HUDI-5767) Add known regression of Hive Sync performance to release notes

2023-02-10 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-5767: --- Assignee: Ethan Guo > Add known regression of Hive Sync performance to release notes >

[jira] [Updated] (HUDI-5767) Add known regression of Hive Sync performance to release notes

2023-02-10 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5767: Epic Link: HUDI-4978 Story Points: 0.5 > Add known regression of Hive Sync performance to release

[jira] [Created] (HUDI-5767) Add known regression of Hive Sync performance to release notes

2023-02-10 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-5767: --- Summary: Add known regression of Hive Sync performance to release notes Key: HUDI-5767 URL: https://issues.apache.org/jira/browse/HUDI-5767 Project: Apache Hudi

[GitHub] [hudi] hudi-bot commented on pull request #7914: [HUDI-5080] Unpersist only relevant RDDs instead of all

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7914: URL: https://github.com/apache/hudi/pull/7914#issuecomment-1426411914 ## CI report: * 319132092c5c1521ff11a2100bd325e5a280459f UNKNOWN * 66780f5afc8835e99c9f0e81b5b9650003888447 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7914: [HUDI-5080] Unpersist only relevant RDDs instead of all

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7914: URL: https://github.com/apache/hudi/pull/7914#issuecomment-1426362231 ## CI report: * 319132092c5c1521ff11a2100bd325e5a280459f UNKNOWN * 66780f5afc8835e99c9f0e81b5b9650003888447 Azure:

[hudi] branch master updated: [MINOR] Fix wrong assertion in TestHoodieTableFactory.java (#7916)

2023-02-10 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 653aa86145f [MINOR] Fix wrong assertion in

[GitHub] [hudi] xushiyan merged pull request #7916: [MINOR] Fix wrong assertion in TestHoodieTableFactory.java

2023-02-10 Thread via GitHub
xushiyan merged PR #7916: URL: https://github.com/apache/hudi/pull/7916 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #7918: [MINOR] Fix spark sql run clean do not exit

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7918: URL: https://github.com/apache/hudi/pull/7918#issuecomment-1426318857 ## CI report: * 0c1826cdbd838767a041d310704ff4f62ad94e6d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7678: [HUDI-5562] Add maven wrapper

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7678: URL: https://github.com/apache/hudi/pull/7678#issuecomment-1426287042 ## CI report: * 94511a8bb16f136f2a8648b0dfa4bb0643f23450 Azure:

[jira] [Closed] (HUDI-5766) Flaky TestHoodieDeltaStreamer.testHoodieIndexer

2023-02-10 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5766. --- Resolution: Duplicate > Flaky TestHoodieDeltaStreamer.testHoodieIndexer >

[jira] [Assigned] (HUDI-5766) Flaky TestHoodieDeltaStreamer.testHoodieIndexer

2023-02-10 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin reassigned HUDI-5766: - Assignee: Sagar Sumit > Flaky TestHoodieDeltaStreamer.testHoodieIndexer >

[jira] [Created] (HUDI-5766) Flaky TestHoodieDeltaStreamer.testHoodieIndexer

2023-02-10 Thread Alexey Kudinkin (Jira)
Alexey Kudinkin created HUDI-5766: - Summary: Flaky TestHoodieDeltaStreamer.testHoodieIndexer Key: HUDI-5766 URL: https://issues.apache.org/jira/browse/HUDI-5766 Project: Apache Hudi Issue

[jira] [Assigned] (HUDI-5765) Flaky TestHoodieCompactor.testSpillingWhenCompaction

2023-02-10 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin reassigned HUDI-5765: - Assignee: Danny Chen > Flaky TestHoodieCompactor.testSpillingWhenCompaction >

[jira] [Created] (HUDI-5765) Flaky TestHoodieCompactor.testSpillingWhenCompaction

2023-02-10 Thread Alexey Kudinkin (Jira)
Alexey Kudinkin created HUDI-5765: - Summary: Flaky TestHoodieCompactor.testSpillingWhenCompaction Key: HUDI-5765 URL: https://issues.apache.org/jira/browse/HUDI-5765 Project: Apache Hudi

[GitHub] [hudi] hudi-bot commented on pull request #7809: [HUDI-5664] Improve SqlQueryPreCommitValidator#queries Parallelism.

2023-02-10 Thread via GitHub
hudi-bot commented on PR #7809: URL: https://github.com/apache/hudi/pull/7809#issuecomment-1426181901 ## CI report: * 0c116f6338642ac384fa77a3b04dc1c9fb819e37 Azure:

[jira] [Updated] (HUDI-5764) Allow lazy rollback for async indexer commit

2023-02-10 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5764: Fix Version/s: 0.13.0 > Allow lazy rollback for async indexer commit >

[jira] [Updated] (HUDI-5764) Allow lazy rollback for async indexer commit

2023-02-10 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5764: Epic Link: HUDI-2488 > Allow lazy rollback for async indexer commit >

  1   2   >