[hudi] 08/10: [HUDI-5356] Call close on SparkRDDWriteClient several places (#7418)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit 8d83a8757118337f3341812ebc906a79859e3479 Author: cxzl25 AuthorDate: Sat Dec 10 11:31:38 2022 +0800

[hudi] 04/10: [HUDI-5350] Fix oom cause compaction event lost problem (#7408)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit b930002b785248123f4cf9a9083be3815eba532d Author: Bingeng Huang <304979...@qq.com> AuthorDate: Fri Dec 9 1

[hudi] 03/10: [HUDI-5346][HUDI-5320] Fixing Create Table as Select (CTAS) performance gaps (#7370)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit bae596359e8daacd331f436b6ffca73503265de0 Author: Alexey Kudinkin AuthorDate: Thu Dec 8 18:52:47 2022 -08

[hudi] 09/10: [HUDI-5338] Adjust coalesce behavior within NONE sort mode for bulk insert (#7396)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit ca3dbbcfa57e0b6836e9545d98c95b81397120d8 Author: Y Ethan Guo AuthorDate: Fri Dec 9 21:41:48 2022 -0800

[hudi] 10/10: [HUDI-5336] Fixing parsing of log files while building file groups (#7393)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit d39bae6c59af9046d6e7893de872efea0ac0a2cd Author: Sivabalan Narayanan AuthorDate: Sun Dec 11 18:44:22 202

[hudi] 02/10: [HUDI-5291] Fixing NPE in MOR column stats accounting (#7349)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit 7abc074dac125a0a79e17f6898ab8c058b63ed34 Author: Alexey Kudinkin AuthorDate: Thu Dec 8 14:08:18 2022 -08

[hudi] 05/10: [HUDI-4881] Push down filters if possible when syncing partitions to Hive (#6725)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit ae21564b053c62e07966cec6ead55ebea5d57af1 Author: RexAn AuthorDate: Sat Dec 10 03:07:46 2022 +0800 [

[hudi] branch release-0.12.2-shadow updated: [HUDI-5347] Cleaned up transient state from `ExpressionPayload` making it non-serializable (#7424)

This is an automated email from the ASF dual-hosted git repository. akudinkin pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/release-0.12.2-shadow by this push: new 4d0a27a90eb [HUD

[GitHub] [hudi] hudi-bot commented on pull request #7345: [HUDI-3378] RFC46 rebase

hudi-bot commented on PR #7345: URL: https://github.com/apache/hudi/pull/7345#issuecomment-1349878390 ## CI report: * e5f1dba84479f08417f25f53a79f6dae4425ba23 UNKNOWN * 2cfcca5c4f1a3a17b68d50f605f736c3a03c2e3f UNKNOWN * 1930cfe77fc3ddbd75564a75558b1211f823be89 Azure: [FAILUR

[GitHub] [hudi] hudi-bot commented on pull request #7423: [HUDI-5384] Adding optimization rule to appropriately push down filters into the `HoodieFileIndex`

hudi-bot commented on PR #7423: URL: https://github.com/apache/hudi/pull/7423#issuecomment-1349879012 ## CI report: * 5292742cf3e8af3c618bb5da7092d46d46e8e461 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1369

[GitHub] [hudi] hudi-bot commented on pull request #7449: [HUDI-5261] Use Proper Parallelism for Engine Context APIs

hudi-bot commented on PR #7449: URL: https://github.com/apache/hudi/pull/7449#issuecomment-1349879413 ## CI report: * 46cb8c24bff18e89b912f53b759387d91d420019 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-5384) Make sure predicates are appropriately pushed down to HoodieFileIndex when lazy listing

[ https://issues.apache.org/jira/browse/HUDI-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5384: - Labels: pull-request-available (was: ) > Make sure predicates are appropriately pushed down to Ho

[GitHub] [hudi] hudi-bot commented on pull request #7423: [HUDI-5384] Adding optimization rule to appropriately push down filters into the `HoodieFileIndex`

hudi-bot commented on PR #7423: URL: https://github.com/apache/hudi/pull/7423#issuecomment-1349893224 ## CI report: * 5292742cf3e8af3c618bb5da7092d46d46e8e461 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1369

[GitHub] [hudi] hudi-bot commented on pull request #7447: [HUDI-5383] Testing 0.12.2 release branch for CI run

hudi-bot commented on PR #7447: URL: https://github.com/apache/hudi/pull/7447#issuecomment-1349893528 ## CI report: * 1fb8f4cad1ace6ea0f7b002ad1bad6f21d2cfde9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1369

[GitHub] [hudi] hudi-bot commented on pull request #7449: [HUDI-5261] Use Proper Parallelism for Engine Context APIs

hudi-bot commented on PR #7449: URL: https://github.com/apache/hudi/pull/7449#issuecomment-1349893640 ## CI report: * 46cb8c24bff18e89b912f53b759387d91d420019 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1369

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7413: [HUDI-5321] correctly implement arePartitionRecordsSorted for bulk insert ColumnSortPartitioners

alexeykudinkin commented on code in PR #7413: URL: https://github.com/apache/hudi/pull/7413#discussion_r1047805019 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/util/PartitionerUtils.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] [hudi] hudi-bot commented on pull request #7413: [HUDI-5321] correctly implement arePartitionRecordsSorted for bulk insert ColumnSortPartitioners

hudi-bot commented on PR #7413: URL: https://github.com/apache/hudi/pull/7413#issuecomment-1349910137 ## CI report: * 101759e2156d55c90bf79d37899ca3b2bd8ea3d4 UNKNOWN * 46de6422c1c0d78c6d4c17ed24ae82b730e552f5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[jira] [Updated] (HUDI-5385) Make behavior of keeping File Writers open configurable

[ https://issues.apache.org/jira/browse/HUDI-5385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-5385: -- Affects Version/s: 0.12.1 (was: 0.121) > Make behavior of keeping Fil

[jira] [Created] (HUDI-5385) Make behavior of keeping File Writers open configurable

Alexey Kudinkin created HUDI-5385: - Summary: Make behavior of keeping File Writers open configurable Key: HUDI-5385 URL: https://issues.apache.org/jira/browse/HUDI-5385 Project: Apache Hudi I

[hudi] 02/03: [MINOR] Fix Out of Bounds Exception for DayBasedCompactionStrategy (#7360)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit 2e358b386d2f8e69b9584ba36c2b4067951d10cc Author: vamshigv <107005799+vamsh...@users.noreply.github.com> A

[hudi] branch release-0.12.2-shadow updated (4d0a27a90eb -> b23ff1e0a19)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git from 4d0a27a90eb [HUDI-5347] Cleaned up transient state from `ExpressionPayload` making it non-serializabl

[hudi] 01/03: [HUDI-5372] Fix NPE caused by alter table add column. (#7236)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit e63a2bc189dfddd80157519a75b61d3d0519b9c2 Author: 苏承祥 AuthorDate: Mon Dec 12 16:50:02 2022 +0800 [HU

[hudi] 03/03: [HUDI-5353] Close file readers (#7412)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit b23ff1e0a199ad3f331abb29ad70bd0c0161859d Author: Sagar Sumit AuthorDate: Mon Dec 12 16:20:45 2022 +0530

[GitHub] [hudi] yihua commented on a diff in pull request #7224: [HUDI-5182] Create Hudi CLI Bundle

yihua commented on code in PR #7224: URL: https://github.com/apache/hudi/pull/7224#discussion_r1047839552 ## packaging/hudi-cli-bundle/pom.xml: ## @@ -0,0 +1,265 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocati

[hudi] branch release-0.12.2-shadow updated (b23ff1e0a19 -> 0afeb0ecc25)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git discard b23ff1e0a19 [HUDI-5353] Close file readers (#7412) new 0afeb0ecc25 [HUDI-5353] Close file readers

[hudi] 01/01: [HUDI-5353] Close file readers (#7412)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit 0afeb0ecc2512b2e529482592ec9bee5af229d1d Author: Sagar Sumit AuthorDate: Mon Dec 12 16:20:45 2022 +0530

[jira] [Updated] (HUDI-5169) Re-attempt failed rollback (regular commits, clustering) and get it to completion

[ https://issues.apache.org/jira/browse/HUDI-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-5169: -- Priority: Blocker (was: Critical) > Re-attempt failed rollback (regular commits, clustering) an

[jira] [Assigned] (HUDI-5169) Re-attempt failed rollback (regular commits, clustering) and get it to completion

[ https://issues.apache.org/jira/browse/HUDI-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-5169: --- Assignee: Ethan Guo (was: sivabalan narayanan) > Re-attempt failed rollback (regular commits, cluste

[jira] [Commented] (HUDI-5169) Re-attempt failed rollback (regular commits, clustering) and get it to completion

[ https://issues.apache.org/jira/browse/HUDI-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646865#comment-17646865 ] Ethan Guo commented on HUDI-5169: - Let's say RB2 is intended to roll back C1.  The rollbac

[jira] [Commented] (HUDI-5169) Re-attempt failed rollback (regular commits, clustering) and get it to completion

[ https://issues.apache.org/jira/browse/HUDI-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646866#comment-17646866 ] Ethan Guo commented on HUDI-5169: - The logic is here in BaseHoodieWriteClient {code:java}

[GitHub] [hudi] hudi-bot commented on pull request #7224: [HUDI-5182] Create Hudi CLI Bundle

hudi-bot commented on PR #7224: URL: https://github.com/apache/hudi/pull/7224#issuecomment-1350055059 ## CI report: * 6d054e07ece4016f560d6ed57bc3d638d0046b4d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1369

[GitHub] [hudi] hudi-bot commented on pull request #7423: [HUDI-5384] Adding optimization rule to appropriately push down filters into the `HoodieFileIndex`

hudi-bot commented on PR #7423: URL: https://github.com/apache/hudi/pull/7423#issuecomment-1350068824 ## CI report: * 5292742cf3e8af3c618bb5da7092d46d46e8e461 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1369

[GitHub] [hudi] hudi-bot commented on pull request #7423: [HUDI-5384] Adding optimization rule to appropriately push down filters into the `HoodieFileIndex`

hudi-bot commented on PR #7423: URL: https://github.com/apache/hudi/pull/7423#issuecomment-1350080961 ## CI report: * 5237ca6f5fac98a6115471b1fc2b65d77ad150cb Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=136

[GitHub] [hudi] nsivabalan opened a new pull request, #7450: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

nsivabalan opened a new pull request, #7450: URL: https://github.com/apache/hudi/pull/7450 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performan

[GitHub] [hudi] nsivabalan commented on pull request #7438: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

nsivabalan commented on PR #7438: URL: https://github.com/apache/hudi/pull/7438#issuecomment-1350104675 closing in favor of https://github.com/apache/hudi/pull/7450 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [hudi] nsivabalan closed pull request #7438: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

nsivabalan closed pull request #7438: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex URL: https://github.com/apache/hudi/pull/7438 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [hudi] rahil-c commented on a diff in pull request #7224: [HUDI-5182] Create Hudi CLI Bundle

rahil-c commented on code in PR #7224: URL: https://github.com/apache/hudi/pull/7224#discussion_r1047870384 ## packaging/hudi-cli-bundle/pom.xml: ## @@ -0,0 +1,258 @@ + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLoca

[hudi] 04/08: [HUDI-5373] Different fileids are assigned to the same bucket (#7433)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit d30b7d3857ce130f5ba4b8215c671f91298d77d0 Author: luokey <854194...@qq.com> AuthorDate: Mon Dec 12 21:40:3

[hudi] 01/08: [HUDI-5078] Fixing isTableService for replace commits (#7037)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit 38e5a35e76e9def6acfa1db5fa2858ecedccc867 Author: Sivabalan Narayanan AuthorDate: Mon Dec 12 07:28:22 202

[hudi] 05/08: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRangesFromFiles of Bloom Index (#6793)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit 20956a21ac57366acdc75c81b0381a0e4ab10848 Author: LiChuang <64473732+codecooke...@users.noreply.github.com

[hudi] 06/08: [HUDI-5351] Handle populateMetaFields when repartitioning in sort partitioner (#7411)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit e346f18162426646e12d40958051af49f081a30b Author: Sagar Sumit AuthorDate: Tue Dec 13 10:22:10 2022 +0530

[hudi] branch release-0.12.2-shadow updated (0afeb0ecc25 -> 07be18cf1ad)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git from 0afeb0ecc25 [HUDI-5353] Close file readers (#7412) new 38e5a35e76e [HUDI-5078] Fixing isTableServ

[hudi] 02/08: [HUDI-5296] Allow disable schema on read after enabling (#7421)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit 8a4c86b958254b8b06e5cd3269ef00f27908fb7b Author: Sivabalan Narayanan AuthorDate: Mon Dec 12 11:39:18 202

[hudi] 07/08: [HUDI-4113] Fix cannot parse schema when use spark delete sql (#5610)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit a56c00e767f5bd64beb533263ac4b9dee3c305c1 Author: KnightChess <981159...@qq.com> AuthorDate: Tue Dec 13 23

[hudi] 08/08: [HUDI-5366] Closing metadata writer from within writeClient (#7437)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit 07be18cf1add17bf90010104a019a80f9530ccc2 Author: Sivabalan Narayanan AuthorDate: Tue Dec 13 08:12:47 202

[hudi] 03/08: [HUDI-5348] Cache file slices in HoodieBackedTableMetadata (#7436)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit 16a89240b2562e15ce70febee0229425824753cd Author: Y Ethan Guo AuthorDate: Mon Dec 12 17:00:10 2022 -0800

[hudi] 01/02: Revert "resolving conflicts for HUDI-5306"

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit 2e6297cfd30060a8deccf038a70d98fcad88ceea Author: sivabalan AuthorDate: Tue Dec 13 16:45:25 2022 -0800

[hudi] 02/02: Revert "[HUDI-5306] Unify RecordIterator and HoodieParquetReader with ClosableIterator (#7340)"

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git commit f9f9541e2e405bae9db2743c13f6a1b1f187c066 Author: sivabalan AuthorDate: Tue Dec 13 16:45:56 2022 -0800

[hudi] branch release-0.12.2-shadow updated (07be18cf1ad -> f9f9541e2e4)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git from 07be18cf1ad [HUDI-5366] Closing metadata writer from within writeClient (#7437) new 2e6297cfd30

[hudi] branch release-0.12.2-shadow updated: reverting complicated patch 7340 and fixed some build failures

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.12.2-shadow in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/release-0.12.2-shadow by this push: new d3d427e179b reve

[GitHub] [hudi] hudi-bot commented on pull request #7448: [HUDI-5160] Fix data source write save as table

hudi-bot commented on PR #7448: URL: https://github.com/apache/hudi/pull/7448#issuecomment-1350192526 ## CI report: * eaed1745913960ef5e40a323eedaeaf96438c5fb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1369

[GitHub] [hudi] JoshuaZhuCN commented on issue #7322: [SUPPORT][HELP] SparkSQL can not read the latest change data without execute "refresh table xxx"

JoshuaZhuCN commented on issue #7322: URL: https://github.com/apache/hudi/issues/7322#issuecomment-1350194639 > @JoshuaZhuCN the reason why it's not refreshing is b/c you're writing into a table by path and not by table identifier (ie `db.table`) -- therefore it bypasses the Catalog and goe

[GitHub] [hudi] hudi-bot commented on pull request #7224: [HUDI-5182] Create Hudi CLI Bundle

hudi-bot commented on PR #7224: URL: https://github.com/apache/hudi/pull/7224#issuecomment-1350196407 ## CI report: * 6d054e07ece4016f560d6ed57bc3d638d0046b4d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1369

[GitHub] [hudi] hudi-bot commented on pull request #7450: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

hudi-bot commented on PR #7450: URL: https://github.com/apache/hudi/pull/7450#issuecomment-1350196987 ## CI report: * 80a0afc67d1e03473cdf9057375519158fee92d5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7224: [HUDI-5182] Create Hudi CLI Bundle

hudi-bot commented on PR #7224: URL: https://github.com/apache/hudi/pull/7224#issuecomment-1350201798 ## CI report: * 6d054e07ece4016f560d6ed57bc3d638d0046b4d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1369

[GitHub] [hudi] hudi-bot commented on pull request #7450: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

hudi-bot commented on PR #7450: URL: https://github.com/apache/hudi/pull/7450#issuecomment-1350202268 ## CI report: * 80a0afc67d1e03473cdf9057375519158fee92d5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1370

[GitHub] [hudi] leesf merged pull request #7366: [HUDI-5318] Fix partition pruning for clustering scheduling

leesf merged PR #7366: URL: https://github.com/apache/hudi/pull/7366 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

[hudi] branch master updated: [HUDI-5318] Fix partition pruning for clustering scheduling (#7366)

This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 6de923cfdfd [HUDI-5318] Fix partition pruning for c

[GitHub] [hudi] JoshuaZhuCN commented on issue #7322: [SUPPORT][HELP] SparkSQL can not read the latest change data without execute "refresh table xxx"

JoshuaZhuCN commented on issue #7322: URL: https://github.com/apache/hudi/issues/7322#issuecomment-1350206823 @alexeykudinkin At present, the problem I encounter is not only that the Spark datasource cannot be read after it is written, but also that the Spark sql cannot be read after it is

[GitHub] [hudi] rahil-c commented on a diff in pull request #7397: [HUDI-5205] Upgrade Flink to 1.16.0

rahil-c commented on code in PR #7397: URL: https://github.com/apache/hudi/pull/7397#discussion_r1047911803 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java: ## @@ -291,19 +291,19 @@ public void handleEventFromOperator(in

[GitHub] [hudi] Zouxxyy commented on a diff in pull request #7175: [HUDI-5191] Fix compatibility with avro 1.10

Zouxxyy commented on code in PR #7175: URL: https://github.com/apache/hudi/pull/7175#discussion_r1047921632 ## .github/workflows/bot.yml: ## @@ -73,6 +73,14 @@ jobs: run: | HUDI_VERSION=$(mvn help:evaluate -Dexpression=project.version -q -DforceStdout)

[GitHub] [hudi] alexeykudinkin commented on issue #7322: [SUPPORT][HELP] SparkSQL can not read the latest change data without execute "refresh table xxx"

alexeykudinkin commented on issue #7322: URL: https://github.com/apache/hudi/issues/7322#issuecomment-1350235937 > @alexeykudinkin i don't understand what "write into the table by its id" means, just using sql like insert into/update/delete from db.table to write data? Correct. You c

[GitHub] [hudi] YannByron commented on pull request #7410: [HUDI-3478] imporve cdc-related codes

YannByron commented on PR #7410: URL: https://github.com/apache/hudi/pull/7410#issuecomment-1350256706 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] china-shang commented on issue #7133: lazyReading affect

china-shang commented on issue #7133: URL: https://github.com/apache/hudi/issues/7133#issuecomment-1350258584 ok Sagar Sumit ***@***.***> 于2022年12月13日周二 22:50写道： > @china-shang please close the issue if > your query is answered. > > —

[GitHub] [hudi] china-shang closed issue #7133: lazyReading affect

china-shang closed issue #7133: lazyReading affect URL: https://github.com/apache/hudi/issues/7133 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commi

[GitHub] [hudi] nsivabalan commented on pull request #7450: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

nsivabalan commented on PR #7450: URL: https://github.com/apache/hudi/pull/7450#issuecomment-1350264478 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (HUDI-5377) Write call stack information to lock file

[ https://issues.apache.org/jira/browse/HUDI-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HunterXHunter updated HUDI-5377: Summary: Write call stack information to lock file (was: Add call stack information to lock file)

[GitHub] [hudi] hudi-bot commented on pull request #7345: [HUDI-3378] RFC46 rebase

hudi-bot commented on PR #7345: URL: https://github.com/apache/hudi/pull/7345#issuecomment-1350266283 ## CI report: * e5f1dba84479f08417f25f53a79f6dae4425ba23 UNKNOWN * 2cfcca5c4f1a3a17b68d50f605f736c3a03c2e3f UNKNOWN * 24c41da0d3a33d1f851e463715d4494cbd873a86 Azure: [CANCEL

[GitHub] [hudi] hudi-bot commented on pull request #7449: [HUDI-5261] Use Proper Parallelism for Engine Context APIs

hudi-bot commented on PR #7449: URL: https://github.com/apache/hudi/pull/7449#issuecomment-1350266678 ## CI report: * 46cb8c24bff18e89b912f53b759387d91d420019 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1369

[GitHub] [hudi] hudi-bot commented on pull request #7450: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

hudi-bot commented on PR #7450: URL: https://github.com/apache/hudi/pull/7450#issuecomment-1350266753 ## CI report: * 80a0afc67d1e03473cdf9057375519158fee92d5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1370

[GitHub] [hudi] hudi-bot commented on pull request #7345: [HUDI-3378] RFC46 rebase

hudi-bot commented on PR #7345: URL: https://github.com/apache/hudi/pull/7345#issuecomment-1350272921 ## CI report: * e5f1dba84479f08417f25f53a79f6dae4425ba23 UNKNOWN * 2cfcca5c4f1a3a17b68d50f605f736c3a03c2e3f UNKNOWN * 24c41da0d3a33d1f851e463715d4494cbd873a86 Azure: [CANCEL

[GitHub] [hudi] hudi-bot commented on pull request #7440: [HUDI-5377] Write call stack information to lock file

hudi-bot commented on PR #7440: URL: https://github.com/apache/hudi/pull/7440#issuecomment-1350273184 ## CI report: * 67e64ca0d35342d303f5c0027db72ec4c14f1890 UNKNOWN * 3a660182f2351faa568087baa1de216d4151702a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #7450: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

hudi-bot commented on PR #7450: URL: https://github.com/apache/hudi/pull/7450#issuecomment-1350273315 ## CI report: * 80a0afc67d1e03473cdf9057375519158fee92d5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1370

[GitHub] [hudi] hudi-bot commented on pull request #7345: [HUDI-3378] RFC46 rebase

hudi-bot commented on PR #7345: URL: https://github.com/apache/hudi/pull/7345#issuecomment-1350279052 ## CI report: * e5f1dba84479f08417f25f53a79f6dae4425ba23 UNKNOWN * 2cfcca5c4f1a3a17b68d50f605f736c3a03c2e3f UNKNOWN * 24c41da0d3a33d1f851e463715d4494cbd873a86 Azure: [CANCEL

[GitHub] [hudi] hudi-bot commented on pull request #7440: [HUDI-5377] Write call stack information to lock file

hudi-bot commented on PR #7440: URL: https://github.com/apache/hudi/pull/7440#issuecomment-1350279402 ## CI report: * 67e64ca0d35342d303f5c0027db72ec4c14f1890 UNKNOWN * 3a660182f2351faa568087baa1de216d4151702a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #7450: [HUDI-5375] Fixing reusing file readers with Metadata reader within FileIndex

hudi-bot commented on PR #7450: URL: https://github.com/apache/hudi/pull/7450#issuecomment-1350279525 ## CI report: * 80a0afc67d1e03473cdf9057375519158fee92d5 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=137

[GitHub] [hudi] hudi-bot commented on pull request #7423: [HUDI-5384] Adding optimization rule to appropriately push down filters into the `HoodieFileIndex`

hudi-bot commented on PR #7423: URL: https://github.com/apache/hudi/pull/7423#issuecomment-1350279292 ## CI report: * 2905580eede076436b472c22da2f2d6af27d1e1e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1369

[GitHub] [hudi] XuQianJin-Stars merged pull request #7398: [HUDI-4961] Support optional table synchronization to hive.

XuQianJin-Stars merged PR #7398: URL: https://github.com/apache/hudi/pull/7398 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.

[hudi] branch master updated (6de923cfdfd -> f56531f5489)

This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 6de923cfdfd [HUDI-5318] Fix partition pruning for clustering scheduling (#7366) add f56531f5489 [HUDI-4961] Sup

[GitHub] [hudi] hudi-bot commented on pull request #7440: [HUDI-5377] Write call stack information to lock file

hudi-bot commented on PR #7440: URL: https://github.com/apache/hudi/pull/7440#issuecomment-1350285610 ## CI report: * 67e64ca0d35342d303f5c0027db72ec4c14f1890 UNKNOWN * 3a660182f2351faa568087baa1de216d4151702a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] soumilshah1995 opened a new issue, #7451: [SUPPORT] Failed to upsert for commit time 20221214022409792

soumilshah1995 opened a new issue, #7451: URL: https://github.com/apache/hudi/issues/7451 Hello i am using glue 4.0 and i am trying to make a tutorial for community. the title is move data from dynamodb into Apache Hudi. # Table ![image](https://user-images.githubusercontent

[GitHub] [hudi] danny0405 commented on issue #7322: [SUPPORT][HELP] SparkSQL can not read the latest change data without execute "refresh table xxx"

danny0405 commented on issue #7322: URL: https://github.com/apache/hudi/issues/7322#issuecomment-1350309180 @alexeykudinkin Let's resolve the related issues all in this one. Re-open it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] JoshuaZhuCN commented on issue #7322: [SUPPORT][HELP] SparkSQL can not read the latest change data without execute "refresh table xxx"

JoshuaZhuCN commented on issue #7322: URL: https://github.com/apache/hudi/issues/7322#issuecomment-1350311469 > > @alexeykudinkin i don't understand what "write into the table by its id" means, just using sql like insert into/update/delete from db.table to write data? > > Correct. Yo

[GitHub] [hudi] alexeykudinkin commented on issue #7322: [SUPPORT][HELP] SparkSQL can not read the latest change data without execute "refresh table xxx"

alexeykudinkin commented on issue #7322: URL: https://github.com/apache/hudi/issues/7322#issuecomment-1350331029 > @alexeykudinkin Let's resolve the related issues all in this one. Re-open it. Can you elaborate why you think these issues are related? -- This is an automated message

[jira] [Updated] (HUDI-5203) Debezium payload does not handle null-field cases

[ https://issues.apache.org/jira/browse/HUDI-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5203: Priority: Critical (was: Major) > Debezium payload does not handle null-field cases > -

[jira] [Closed] (HUDI-5203) Debezium payload does not handle null-field cases

[ https://issues.apache.org/jira/browse/HUDI-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5203. --- Resolution: Fixed > Debezium payload does not handle null-field cases > --

[GitHub] [hudi] alexeykudinkin commented on issue #7322: [SUPPORT][HELP] SparkSQL can not read the latest change data without execute "refresh table xxx"

alexeykudinkin commented on issue #7322: URL: https://github.com/apache/hudi/issues/7322#issuecomment-1350336358 > @alexeykudinkin I think the query engine should not limit the writing way for querying data. Even for the tables created by Spakrsql, the query engine should be able to query n

[GitHub] [hudi] xushiyan commented on pull request #7139: [HUDI-5160] Spark df saveAsTable failed with CTAS

xushiyan commented on PR #7139: URL: https://github.com/apache/hudi/pull/7139#issuecomment-1350337021 @dongkelun thanks for making the patch. the root cause here is we did not support converting data source write config into table config while using saveAsTable(), where table was not create

[jira] [Created] (HUDI-5386) Rollback conflict in occ mode

HunterXHunter created HUDI-5386: --- Summary: Rollback conflict in occ mode Key: HUDI-5386 URL: https://issues.apache.org/jira/browse/HUDI-5386 Project: Apache Hudi Issue Type: Bug Rep

[jira] [Updated] (HUDI-5386) Rollback conflict in occ mode

[ https://issues.apache.org/jira/browse/HUDI-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HunterXHunter updated HUDI-5386: Attachment: (was: WechatIMG70.jpeg) > Rollback conflict in occ mode > --

[jira] [Updated] (HUDI-5386) Rollback conflict in occ mode

[ https://issues.apache.org/jira/browse/HUDI-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HunterXHunter updated HUDI-5386: Description: {code:java} configuration parameter: 'hoodie.cleaner.policy.failed.writes' = 'LAZY' 'h

[jira] [Updated] (HUDI-5386) Rollback conflict in occ mode

[ https://issues.apache.org/jira/browse/HUDI-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HunterXHunter updated HUDI-5386: Attachment: (was: 1670986960525.jpg) > Rollback conflict in occ mode > -

[jira] [Updated] (HUDI-5386) Rollback conflict in occ mode

[ https://issues.apache.org/jira/browse/HUDI-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HunterXHunter updated HUDI-5386: Attachment: image-2022-12-14-11-26-21-995.png > Rollback conflict in occ mode >

[jira] [Updated] (HUDI-5386) Rollback conflict in occ mode

[ https://issues.apache.org/jira/browse/HUDI-5386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HunterXHunter updated HUDI-5386: Attachment: image-2022-12-14-11-26-37-252.png > Rollback conflict in occ mode >

[jira] [Updated] (HUDI-5025) Rollback failed with log file not found when rollOver in rollback process

[ https://issues.apache.org/jira/browse/HUDI-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5025: Priority: Blocker (was: Major) > Rollback failed with log file not found when rollOver in rollback process

[jira] [Updated] (HUDI-5088) Failed to synchronize the hive metadata of the Flink table

[ https://issues.apache.org/jira/browse/HUDI-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5088: Priority: Blocker (was: Major) > Failed to synchronize the hive metadata of the Flink table > -

[jira] [Updated] (HUDI-5067) Merge the columns stats of multiple log blocks from the same log file

[ https://issues.apache.org/jira/browse/HUDI-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5067: Priority: Critical (was: Major) > Merge the columns stats of multiple log blocks from the same log file > -

[jira] [Closed] (HUDI-5185) Compaction run fails with --hoodieConfigs

[ https://issues.apache.org/jira/browse/HUDI-5185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5185. --- Resolution: Fixed > Compaction run fails with --hoodieConfigs > - > >

[jira] [Updated] (HUDI-5185) Compaction run fails with --hoodieConfigs

[ https://issues.apache.org/jira/browse/HUDI-5185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5185: Priority: Blocker (was: Major) > Compaction run fails with --hoodieConfigs > --

[jira] [Updated] (HUDI-5185) Compaction run fails with --hoodieConfigs

[ https://issues.apache.org/jira/browse/HUDI-5185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5185: Fix Version/s: 0.12.2 > Compaction run fails with --hoodieConfigs >

<    1   2   3   4   5   >