[GitHub] [hudi] hudi-bot commented on pull request #7959: Fix test failure in TestHoodieMergeOnReadTable

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7959: URL: https://github.com/apache/hudi/pull/7959#issuecomment-1430893257 ## CI report: * 480d3a4b17476126e248eddea06713024fae0f2b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7957: [HUDI-5798] fix spark sql query error on mor table after flink cdc delete records

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7957: URL: https://github.com/apache/hudi/pull/7957#issuecomment-1430893161 ## CI report: * cc474acacf7a7d1dd0eaf25fd6dc086dcec0f9b2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7941: [HUDI-5786] Add a new config to specific spark write rdd storage level

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7941: URL: https://github.com/apache/hudi/pull/7941#issuecomment-1430893023 ## CI report: * 21d0208f08bcf33ff9c37871c73f395d9571170e Azure:

[jira] [Updated] (HUDI-5799) Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows

2023-02-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5799: - Labels: pull-request-available (was: ) > Fix Spark partition validation in

[jira] [Created] (HUDI-5800) Fix test failure in TestHoodieMergeOnReadTable

2023-02-14 Thread Lokesh Jain (Jira)
Lokesh Jain created HUDI-5800: - Summary: Fix test failure in TestHoodieMergeOnReadTable Key: HUDI-5800 URL: https://issues.apache.org/jira/browse/HUDI-5800 Project: Apache Hudi Issue Type: Bug

[GitHub] [hudi] hudi-bot commented on pull request #7958: [HUDI-5799] Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7958: URL: https://github.com/apache/hudi/pull/7958#issuecomment-1430893211 ## CI report: * 36c706d1bb1a8f793ce874c9316aaf829aecd594 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7933: [HUDI-5774] Fix prometheus configs for metadata table and support metric labels

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7933: URL: https://github.com/apache/hudi/pull/7933#issuecomment-1430892893 ## CI report: * a02b393674ed4ae07d1eed67560f126ac06e178c Azure:

[jira] [Created] (HUDI-5799) Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows

2023-02-14 Thread Lokesh Jain (Jira)
Lokesh Jain created HUDI-5799: - Summary: Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows Key: HUDI-5799 URL: https://issues.apache.org/jira/browse/HUDI-5799 Project: Apache

[GitHub] [hudi] lokeshj1703 opened a new pull request, #7959: Fix test failure in TestHoodieMergeOnReadTable

2023-02-14 Thread via GitHub
lokeshj1703 opened a new pull request, #7959: URL: https://github.com/apache/hudi/pull/7959 ### Change Logs The PR fixes test failure in `TestHoodieMergeOnReadTable.testReleaseResource` ``` TestHoodieMergeOnReadTable.testReleaseResource:710 expected: <14> but was: <3> ```

[GitHub] [hudi] hudi-bot commented on pull request #7957: [HUDI-5798] fix spark sql query error on mor table after flink cdc delete records

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7957: URL: https://github.com/apache/hudi/pull/7957#issuecomment-1430886719 ## CI report: * cc474acacf7a7d1dd0eaf25fd6dc086dcec0f9b2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7941: [HUDI-5786] Add a new config to specific spark write rdd storage level

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7941: URL: https://github.com/apache/hudi/pull/7941#issuecomment-1430886544 ## CI report: * 42e12ad1b6bebdcc3dc9d985e5be661b198f3f5c Azure:

[GitHub] [hudi] codope commented on a diff in pull request #7942: [HUDI-5753] Add docs for record payload

2023-02-14 Thread via GitHub
codope commented on code in PR #7942: URL: https://github.com/apache/hudi/pull/7942#discussion_r1106755374 ## website/docs/record_payload.md: ## @@ -0,0 +1,97 @@ +--- +title: Record Payload +keywords: [hudi, merge, upsert, precombine] +--- + +## Record Payload + +One of the

[GitHub] [hudi] hudi-bot commented on pull request #7933: [HUDI-5774] Fix prometheus configs for metadata table and support metric labels

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7933: URL: https://github.com/apache/hudi/pull/7933#issuecomment-1430886430 ## CI report: * a02b393674ed4ae07d1eed67560f126ac06e178c Azure:

[GitHub] [hudi] lokeshj1703 opened a new pull request, #7958: Fix Spark partition validation in TestBulkInsertInternalPartitionerForRows

2023-02-14 Thread via GitHub
lokeshj1703 opened a new pull request, #7958: URL: https://github.com/apache/hudi/pull/7958 ### Change Logs This PR fixes the test failure in `TestBulkInsertInternalPartitionerForRows#testBulkInsertInternalPartitioner` with `GLOBAL_SORT`. The behavior of

[GitHub] [hudi] hudi-bot commented on pull request #7672: [HUDI-5557]Avoid converting columns that are not indexed in CSI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7672: URL: https://github.com/apache/hudi/pull/7672#issuecomment-1430879805 ## CI report: * 7653988b9cc0f31c2581ef8594347d2634ae6ebb Azure:

[jira] [Updated] (HUDI-5798) spark-sql query fail on mor table after flink cdc application delete records

2023-02-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5798: - Labels: pull-request-available (was: ) > spark-sql query fail on mor table after flink cdc

[GitHub] [hudi] li36909 opened a new pull request, #7957: [HUDI-5798] fix spark sql query error on mor table after flink cdc de…

2023-02-14 Thread via GitHub
li36909 opened a new pull request, #7957: URL: https://github.com/apache/hudi/pull/7957 Change Logs shade avro-1.10.0 at hudi-spark${sparkbundle.version}-bundle_${scala.binary.version} to avoid deserialize error for delete record which writted by flink cdc application. Impact

[jira] [Created] (HUDI-5798) spark-sql query fail on mor table after flink cdc application delete records

2023-02-14 Thread lrz (Jira)
lrz created HUDI-5798: - Summary: spark-sql query fail on mor table after flink cdc application delete records Key: HUDI-5798 URL: https://issues.apache.org/jira/browse/HUDI-5798 Project: Apache Hudi

[GitHub] [hudi] hudi-bot commented on pull request #7894: [HUDI-5729] Fix RowDataKeyGen method getRecordKey

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7894: URL: https://github.com/apache/hudi/pull/7894#issuecomment-1430844941 ## CI report: * 6d1ea73414d1ff772c402746dcb554257492ad97 Azure:

[GitHub] [hudi] pramodbiligiri commented on pull request #7868: [HUDI-1593] Add support for "show restores" and "show restore" commands in hudi-cli

2023-02-14 Thread via GitHub
pramodbiligiri commented on PR #7868: URL: https://github.com/apache/hudi/pull/7868#issuecomment-1430840601 @nsivabalan One unrelated test in spark3.3 mode is failing, as shown below. Is that something that can be ignored and this PR can be merged? ``` TestCreateTable: - Test

[GitHub] [hudi] hudi-bot commented on pull request #7894: [HUDI-5729] Fix RowDataKeyGen method getRecordKey

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7894: URL: https://github.com/apache/hudi/pull/7894#issuecomment-1430840211 ## CI report: * 7576ed9c5b6208a497a55cfbf4c7ba463a34cc4a Azure:

[GitHub] [hudi] sandyfog commented on a diff in pull request #7894: [HUDI-5729] Fix RowDataKeyGen method getRecordKey

2023-02-14 Thread via GitHub
sandyfog commented on code in PR #7894: URL: https://github.com/apache/hudi/pull/7894#discussion_r1106708076 ## hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/bulk/TestRowDataKeyGen.java: ## @@ -191,6 +192,8 @@ void testPrimaryKeylessWrite() { @Test

[GitHub] [hudi] hudi-bot commented on pull request #7956: [HUDI-5797] fix use bulk insert error as row

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7956: URL: https://github.com/apache/hudi/pull/7956#issuecomment-1430789695 ## CI report: * 5bd4d5c4de8fc54bf93fb7fd252b6e61fda85373 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7955: [HUDI-5649] Unify all the loggers to slf4j

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7955: URL: https://github.com/apache/hudi/pull/7955#issuecomment-1430789668 ## CI report: * 8c05730d6eddec29b98d421b2edc95ae616dc29d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7950: [MINOR] Revisited `HoodieDeltaWriteStat` to avoid using `Option` as it's going to be improperly serialized to JSON

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7950: URL: https://github.com/apache/hudi/pull/7950#issuecomment-1430789613 ## CI report: * f71048d68c99e122e9d8e65d7429c32bdb00d64e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7941: [HUDI-5786] Add a new config to specific spark write rdd storage level

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7941: URL: https://github.com/apache/hudi/pull/7941#issuecomment-1430789562 ## CI report: * 42e12ad1b6bebdcc3dc9d985e5be661b198f3f5c Azure:

[jira] [Updated] (HUDI-5797) bulk insert as row will throw error without mdt init

2023-02-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5797: - Labels: pull-request-available (was: ) > bulk insert as row will throw error without mdt init >

[GitHub] [hudi] hudi-bot commented on pull request #7956: [HUDI-5797] fix use bulk insert error as row

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7956: URL: https://github.com/apache/hudi/pull/7956#issuecomment-1430785574 ## CI report: * 5bd4d5c4de8fc54bf93fb7fd252b6e61fda85373 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7955: [HUDI-5649] Unify all the loggers to slf4j

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7955: URL: https://github.com/apache/hudi/pull/7955#issuecomment-1430785542 ## CI report: * 8c05730d6eddec29b98d421b2edc95ae616dc29d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7941: [HUDI-5786] Add a new config to specific spark write rdd storage level

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7941: URL: https://github.com/apache/hudi/pull/7941#issuecomment-1430785448 ## CI report: * 42e12ad1b6bebdcc3dc9d985e5be661b198f3f5c Azure:

[GitHub] [hudi] KnightChess opened a new pull request, #7956: [DHUDI-5797] fix use bulk insert error as row

2023-02-14 Thread via GitHub
KnightChess opened a new pull request, #7956: URL: https://github.com/apache/hudi/pull/7956 ### Change Logs `bulkinsert as row` not initTable first, it will trigger mdt init when commit result after write in the same job, and this will use fileSystem to init, which will contain

[jira] [Created] (HUDI-5797) bulk insert as row will throw error without mdt init

2023-02-14 Thread KnightChess (Jira)
KnightChess created HUDI-5797: - Summary: bulk insert as row will throw error without mdt init Key: HUDI-5797 URL: https://issues.apache.org/jira/browse/HUDI-5797 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-5649) Unify all the loggers to slf4j

2023-02-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5649: - Labels: pull-request-available (was: ) > Unify all the loggers to slf4j >

[GitHub] [hudi] danny0405 opened a new pull request, #7955: [HUDI-5649] Unify all the loggers to slf4j

2023-02-14 Thread via GitHub
danny0405 opened a new pull request, #7955: URL: https://github.com/apache/hudi/pull/7955 ### Change Logs * replace all the apache logging loggers * replace all the log4j loggers, keep several loggers that needs to set up explicit log level with codes ### Impact

[GitHub] [hudi] lokeshj1703 opened a new pull request, #7789: [DNM][WIP] Bundle validation 0.13.0-rc2

2023-02-14 Thread via GitHub
lokeshj1703 opened a new pull request, #7789: URL: https://github.com/apache/hudi/pull/7789 ### Change Logs Bundle validation for 0.13.0-rc1 ### Impact NA ### Risk level (write none, low medium or high below) Low ### Documentation Update

[GitHub] [hudi] SteNicholas commented on pull request #7940: [HUDI-5787] HMSDDLExecutor should set table type to EXTERNAL_TABLE when hoodie.datasource.hive_sync.create_managed_table of sync config is

2023-02-14 Thread via GitHub
SteNicholas commented on PR #7940: URL: https://github.com/apache/hudi/pull/7940#issuecomment-1430755145 @danny0405, I have addressed above minor comments. PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] hudi-bot commented on pull request #7949: [HUDI-5795] Ensure we only have a single push gw client and hence a single connection pool

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7949: URL: https://github.com/apache/hudi/pull/7949#issuecomment-1430753772 ## CI report: * d84a59f5668f181672f3324d032ce56043acbbde Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7940: [HUDI-5787] HMSDDLExecutor should set table type to EXTERNAL_TABLE when hoodie.datasource.hive_sync.create_managed_table of sync config is fal

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7940: URL: https://github.com/apache/hudi/pull/7940#issuecomment-1430745841 ## CI report: * 7d067c88e32e27a325d62471017946482632cd60 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7940: [HUDI-5787] HMSDDLExecutor should set table type to EXTERNAL_TABLE when hoodie.datasource.hive_sync.create_managed_table of sync config is fal

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7940: URL: https://github.com/apache/hudi/pull/7940#issuecomment-1430742300 ## CI report: * 7d067c88e32e27a325d62471017946482632cd60 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7952: [MINOR] Fix format name and remove redundant line in examples

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7952: URL: https://github.com/apache/hudi/pull/7952#issuecomment-1430742384 ## CI report: * 7b1012695ef498cd5ffadd4e87c58709e782a479 UNKNOWN * 8e06386f41311e3780846c5dcb4593e0ed863d3e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7947: [MINOR] DO NOT MERGE try reporting action

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7947: URL: https://github.com/apache/hudi/pull/7947#issuecomment-1430742341 ## CI report: * d3bca1cd0f23d598d84a84fadd5e5fba093491d3 UNKNOWN * 308cbfefb269d24e5866228701ea3077594a907b Azure:

[GitHub] [hudi] zhangyue19921010 opened a new pull request, #7954: [WIP][HUDI-5729] Fix Test in TestDisruptorExecutionInSpark

2023-02-14 Thread via GitHub
zhangyue19921010 opened a new pull request, #7954: URL: https://github.com/apache/hudi/pull/7954 ### Change Logs Fix Test in TestDisruptorExecutionInSpark ### Impact no ### Risk level (write none, low medium or high below) low ### Documentation

[GitHub] [hudi] hudi-bot commented on pull request #7952: [MINOR] Fix format name and remove redundant line in examples

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7952: URL: https://github.com/apache/hudi/pull/7952#issuecomment-1430709762 ## CI report: * 7b1012695ef498cd5ffadd4e87c58709e782a479 UNKNOWN * 8e06386f41311e3780846c5dcb4593e0ed863d3e UNKNOWN Bot commands @hudi-bot supports the

[GitHub] [hudi] longjuncai1994 opened a new issue, #7953: [SUPPORT]Code pending on writing data to S3 using Flink datastream API,and the target path is empty.

2023-02-14 Thread via GitHub
longjuncai1994 opened a new issue, #7953: URL: https://github.com/apache/hudi/issues/7953 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? yes **Describe the problem you faced** I want to write data to S3 on my

[GitHub] [hudi] danny0405 commented on a diff in pull request #7940: [HUDI-5787] HMSDDLExecutor should set table type to EXTERNAL_TABLE when hoodie.datasource.hive_sync.create_managed_table of sync co

2023-02-14 Thread via GitHub
danny0405 commented on code in PR #7940: URL: https://github.com/apache/hudi/pull/7940#discussion_r1106613956 ## hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/table/catalog/TestHoodieHiveCatalog.java: ## @@ -207,6 +208,23 @@ public void

[GitHub] [hudi] hudi-bot commented on pull request #7952: [MINOR] Fix format name and remove redundant line in examples

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7952: URL: https://github.com/apache/hudi/pull/7952#issuecomment-1430705742 ## CI report: * 7b1012695ef498cd5ffadd4e87c58709e782a479 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] yihua opened a new pull request, #7952: [MINOR] Fix format name and remove redundant line in examples

2023-02-14 Thread via GitHub
yihua opened a new pull request, #7952: URL: https://github.com/apache/hudi/pull/7952 ### Change Logs Two minor changes in Hudi examples: - Replace `"org.apache.hudi"` with `"hudi"` as the format in `df.write.format("hudi")` - Remove redundant line in Python example ###

[GitHub] [hudi] danny0405 commented on a diff in pull request #7752: [MINOR] De-duplicating Iterator implementations

2023-02-14 Thread via GitHub
danny0405 commented on code in PR #7752: URL: https://github.com/apache/hudi/pull/7752#discussion_r1106608367 ## hudi-common/src/main/java/org/apache/hudi/common/util/collection/CloseableMappingIterator.java: ## @@ -22,8 +22,8 @@ import java.util.function.Function; -//

[GitHub] [hudi] danny0405 commented on a diff in pull request #7894: [HUDI-5729] Fix RowDataKeyGen method getRecordKey

2023-02-14 Thread via GitHub
danny0405 commented on code in PR #7894: URL: https://github.com/apache/hudi/pull/7894#discussion_r1106606144 ## hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/bulk/TestRowDataKeyGen.java: ## @@ -191,6 +192,8 @@ void testPrimaryKeylessWrite() { @Test

[GitHub] [hudi] hudi-bot commented on pull request #7792: [MINOR] Improving logging and tracking of failures for metadata validator

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7792: URL: https://github.com/apache/hudi/pull/7792#issuecomment-1430677371 ## CI report: * 6795e0cbe9f6ebc75f54d2a7e6a6594f8ed3622a UNKNOWN * 6e11e221c599fb73a8139876d6f8dc50760b988d Azure:

[GitHub] [hudi] danny0405 commented on a diff in pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-14 Thread via GitHub
danny0405 commented on code in PR #7885: URL: https://github.com/apache/hudi/pull/7885#discussion_r1106591250 ## hudi-common/src/main/java/org/apache/hudi/common/util/JsonUtils.java: ## @@ -19,22 +19,39 @@ package org.apache.hudi.common.util; +import

[GitHub] [hudi] hudi-bot commented on pull request #7918: [MINOR] Fix spark sql run clean do not exit

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7918: URL: https://github.com/apache/hudi/pull/7918#issuecomment-1430665092 ## CI report: * f694a549ea265813f05767d69269fda2bb1ef279 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7948: [HUDI-5794] Failing new commits on any pending restore commits

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7948: URL: https://github.com/apache/hudi/pull/7948#issuecomment-1430665212 ## CI report: * 44ccfacd787a566ff73343955389b080576ab225 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7894: [HUDI-5729] Fix RowDataKeyGen method getRecordKey

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7894: URL: https://github.com/apache/hudi/pull/7894#issuecomment-1430664990 ## CI report: * 7576ed9c5b6208a497a55cfbf4c7ba463a34cc4a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1430664938 ## CI report: * 38b3bf82a57801e27cf28532590327b785754fc5 UNKNOWN * 02e61304e85a8eb02e30c12e33b044529caac064 Azure:

[GitHub] [hudi] stream2000 commented on pull request #7918: [MINOR] Fix spark sql run clean do not exit

2023-02-14 Thread via GitHub
stream2000 commented on PR #7918: URL: https://github.com/apache/hudi/pull/7918#issuecomment-1430656832 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[hudi] branch master updated (b59fa1bd7fd -> af61dea6f98)

2023-02-14 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from b59fa1bd7fd [HUDI-5792] Disabling flaky tests: TestDisruptorExecutionInSpark (#7946) add af61dea6f98 [MINOR]

[GitHub] [hudi] xushiyan merged pull request #7943: [MINOR] enable publish test results

2023-02-14 Thread via GitHub
xushiyan merged PR #7943: URL: https://github.com/apache/hudi/pull/7943 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #7894: [HUDI-5729] Fix RowDataKeyGen method getRecordKey

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7894: URL: https://github.com/apache/hudi/pull/7894#issuecomment-1430635877 ## CI report: * 7576ed9c5b6208a497a55cfbf4c7ba463a34cc4a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1430635809 ## CI report: * 0ba77cfa61aba32f120f9d46b589baf8bff9c9bd Azure:

[GitHub] [hudi] sandyfog commented on pull request #7894: [HUDI-5729] Fix RowDataKeyGen method getRecordKey

2023-02-14 Thread via GitHub
sandyfog commented on PR #7894: URL: https://github.com/apache/hudi/pull/7894#issuecomment-1430633349 > > There is a test failure: `TestRowDataKeyGen.testRecoredKeyContainsTimestamp:201` May be the default timezone is different. -- This is an automated message

[GitHub] [hudi] vinothchandar commented on pull request #7935: [DRAFT] Add maven-build-cache-extension

2023-02-14 Thread via GitHub
vinothchandar commented on PR #7935: URL: https://github.com/apache/hudi/pull/7935#issuecomment-1430616319 @kazdy Good points. @xushiyan how do we control the maven version on Azure CI? Does it take a docker image we maintain? -- This is an automated message from the Apache Git

[GitHub] [hudi] xushiyan commented on a diff in pull request #7948: [HUDI-5794] Failing new commits on any pending restore commits

2023-02-14 Thread via GitHub
xushiyan commented on code in PR #7948: URL: https://github.com/apache/hudi/pull/7948#discussion_r1106547724 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java: ## @@ -839,6 +842,12 @@ private void startCommitWithTime(String

[jira] [Updated] (HUDI-5352) Jackson fails to serialize LocalDate when updating Delta Commit metadata

2023-02-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-5352: - Fix Version/s: 0.13.1 (was: 0.14.0) > Jackson fails to serialize LocalDate when

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1430596213 ## CI report: * 0ba77cfa61aba32f120f9d46b589baf8bff9c9bd Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7672: [HUDI-5557]Avoid converting columns that are not indexed in CSI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7672: URL: https://github.com/apache/hudi/pull/7672#issuecomment-1430595952 ## CI report: * 34b46d43bb9e5f23cc8a2f03a95bf09195329dfd Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7951: [HUDI-5796] Adding auto inferring partition from incoming df

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7951: URL: https://github.com/apache/hudi/pull/7951#issuecomment-1430592172 ## CI report: * 7209efd0df54978907b937f1a2aaef0e6b1f74b0 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7672: [HUDI-5557]Avoid converting columns that are not indexed in CSI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7672: URL: https://github.com/apache/hudi/pull/7672#issuecomment-1430591607 ## CI report: * 34b46d43bb9e5f23cc8a2f03a95bf09195329dfd Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1430591938 ## CI report: * 0ba77cfa61aba32f120f9d46b589baf8bff9c9bd Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7951: [HUDI-5796] Adding auto inferring partition from incoming df

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7951: URL: https://github.com/apache/hudi/pull/7951#issuecomment-1430586014 ## CI report: * 7209efd0df54978907b937f1a2aaef0e6b1f74b0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1430585785 ## CI report: * 0ba77cfa61aba32f120f9d46b589baf8bff9c9bd Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7950: [MINOR] Revisited `HoodieDeltaWriteStat` to avoid using `Option` as it's going to be improperly serialized to JSON

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7950: URL: https://github.com/apache/hudi/pull/7950#issuecomment-1430580182 ## CI report: * f71048d68c99e122e9d8e65d7429c32bdb00d64e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1430579556 ## CI report: * 0ba77cfa61aba32f120f9d46b589baf8bff9c9bd UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-5796) Infer partition path automatically from incoming df if not explicitly set

2023-02-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5796: - Labels: pull-request-available (was: ) > Infer partition path automatically from incoming df if

[GitHub] [hudi] nsivabalan opened a new pull request, #7951: [HUDI-5796] Adding auto inferring partition from incoming df

2023-02-14 Thread via GitHub
nsivabalan opened a new pull request, #7951: URL: https://github.com/apache/hudi/pull/7951 ### Change Logs If someone tries to write to hudi in following syntax, we should infer the partition automatically if hoodie's partition path field is not explicitly set. ```

[jira] [Created] (HUDI-5796) Infer partition path automatically from incoming df if not explicitly set

2023-02-14 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-5796: - Summary: Infer partition path automatically from incoming df if not explicitly set Key: HUDI-5796 URL: https://issues.apache.org/jira/browse/HUDI-5796

[GitHub] [hudi] hudi-bot commented on pull request #7950: [MINOR] Revisited `HoodieDeltaWriteStat` to avoid using `Option` as it's going to be improperly serialized to JSON

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7950: URL: https://github.com/apache/hudi/pull/7950#issuecomment-1430538909 ## CI report: * f71048d68c99e122e9d8e65d7429c32bdb00d64e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] alexeykudinkin opened a new pull request, #7950: [MINOR] Revisited `HoodieDeltaWriteStat` to avoid using `Option` as it's going to be improperly serialized to JSON

2023-02-14 Thread via GitHub
alexeykudinkin opened a new pull request, #7950: URL: https://github.com/apache/hudi/pull/7950 ### Change Logs Revisited `HoodieDeltaWriteStat` to avoid using `Option` as it's going to be improperly serialized to JSON by auto-generated serializer. ### Impact Will fix

[GitHub] [hudi] hudi-bot commented on pull request #7945: [MINOR] added some useful scripts

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7945: URL: https://github.com/apache/hudi/pull/7945#issuecomment-1430529138 ## CI report: * 82e515b97274f26f022194236711b1e847c882f8 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7949: [HUDI-5795] Ensure we only have a single push gw client and hence a single connection pool

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7949: URL: https://github.com/apache/hudi/pull/7949#issuecomment-1430529218 ## CI report: * d84a59f5668f181672f3324d032ce56043acbbde Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7949: [HUDI-5795] Ensure we only have a single push gw client and hence a single connection pool

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7949: URL: https://github.com/apache/hudi/pull/7949#issuecomment-1430501383 ## CI report: * d84a59f5668f181672f3324d032ce56043acbbde UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] jonvex opened a new pull request, #7949: [HUDI-5795] Ensure we only have a single push gw client and hence a single connection pool

2023-02-14 Thread via GitHub
jonvex opened a new pull request, #7949: URL: https://github.com/apache/hudi/pull/7949 ### Change Logs Currently we maintain a single Metrics instance per table (and a separate one for metadata table). That means we create a separate instance for PushGateway, the client for push

[jira] [Updated] (HUDI-5795) Use only single connection per push gateway

2023-02-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5795: - Labels: pull-request-available (was: ) > Use only single connection per push gateway >

[jira] [Created] (HUDI-5795) Use only single connection per push gateway

2023-02-14 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-5795: - Summary: Use only single connection per push gateway Key: HUDI-5795 URL: https://issues.apache.org/jira/browse/HUDI-5795 Project: Apache Hudi Issue Type:

[GitHub] [hudi] hudi-bot commented on pull request #7947: [MINOR] DO NOT MERGE try reporting action

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7947: URL: https://github.com/apache/hudi/pull/7947#issuecomment-1430487450 ## CI report: * d3bca1cd0f23d598d84a84fadd5e5fba093491d3 UNKNOWN * 3d321cd0e7b02cfab893ba538ad04967a43a42b7 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1430487068 ## CI report: * c3d027696958b320912712447bcf41c3f2d28221 UNKNOWN * 42c476ac607042f10d25e29e61e4939e88abeeb1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1430475534 ## CI report: * c3d027696958b320912712447bcf41c3f2d28221 UNKNOWN * 42c476ac607042f10d25e29e61e4939e88abeeb1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7944: [HUDI-5791] Handle empty payloads for AbstractDebeziumAvroPayload

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7944: URL: https://github.com/apache/hudi/pull/7944#issuecomment-1430426040 ## CI report: * 7fd3c79d35216c8ee4b5e8e0df6dda429168b06a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7940: [HUDI-5787] HMSDDLExecutor should set table type to EXTERNAL_TABLE when hoodie.datasource.hive_sync.create_managed_table of sync config is fal

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7940: URL: https://github.com/apache/hudi/pull/7940#issuecomment-1430425976 ## CI report: * 7d067c88e32e27a325d62471017946482632cd60 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1430425730 ## CI report: * c3d027696958b320912712447bcf41c3f2d28221 UNKNOWN * 8394d8e4a660a026fcf7e2f127cb1f1299e7c467 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7792: [MINOR] Improving logging and tracking of failures for metadata validator

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7792: URL: https://github.com/apache/hudi/pull/7792#issuecomment-1430425488 ## CI report: * 6795e0cbe9f6ebc75f54d2a7e6a6594f8ed3622a UNKNOWN * ff77639bedacc62b7026784674f1c353d41c791c Azure:

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #7914: [HUDI-5080] Unpersist only relevant RDDs instead of all

2023-02-14 Thread via GitHub
alexeykudinkin commented on code in PR #7914: URL: https://github.com/apache/hudi/pull/7914#discussion_r1106414946 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/common/HoodieSparkEngineContext.java: ## @@ -58,6 +61,7 @@ public class

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1430418006 ## CI report: * c3d027696958b320912712447bcf41c3f2d28221 UNKNOWN * 8394d8e4a660a026fcf7e2f127cb1f1299e7c467 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7947: [MINOR] DO NOT MERGE try reporting action

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7947: URL: https://github.com/apache/hudi/pull/7947#issuecomment-1430418363 ## CI report: * d3bca1cd0f23d598d84a84fadd5e5fba093491d3 UNKNOWN * 3d321cd0e7b02cfab893ba538ad04967a43a42b7 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7948: [HUDI-5794] Failing new commits on any pending restore commits

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7948: URL: https://github.com/apache/hudi/pull/7948#issuecomment-1430418430 ## CI report: * 44ccfacd787a566ff73343955389b080576ab225 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7948: [HUDI-5794] Failing new commits on any pending restore commits

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7948: URL: https://github.com/apache/hudi/pull/7948#issuecomment-1430411544 ## CI report: * 44ccfacd787a566ff73343955389b080576ab225 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7947: [MINOR] DO NOT MERGE try reporting action

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7947: URL: https://github.com/apache/hudi/pull/7947#issuecomment-1430411502 ## CI report: * 6fea7064f9d4d422efe8e38f2d803596df9bdd11 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1430411151 ## CI report: * c3d027696958b320912712447bcf41c3f2d28221 UNKNOWN * 8394d8e4a660a026fcf7e2f127cb1f1299e7c467 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7792: [MINOR] Improving logging and tracking of failures for metadata validator

2023-02-14 Thread via GitHub
hudi-bot commented on PR #7792: URL: https://github.com/apache/hudi/pull/7792#issuecomment-1430410893 ## CI report: * 6795e0cbe9f6ebc75f54d2a7e6a6594f8ed3622a UNKNOWN * ff77639bedacc62b7026784674f1c353d41c791c Azure:

[jira] [Updated] (HUDI-5794) Fail any new commits if there is any inflight restore in timeline

2023-02-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5794: - Labels: pull-request-available (was: ) > Fail any new commits if there is any inflight restore

  1   2   3   >