[GitHub] [hudi] hudi-bot commented on pull request #8353: [MINOR] Remove unused code

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8353: URL: https://github.com/apache/hudi/pull/8353#issuecomment-1493229240 ## CI report: * cc012c55987f2d62eff0d00d9d5432200167601d Azure:

[GitHub] [hudi] bithw1 opened a new issue, #8356: [SUPPORT]What is the final for the MOR compaction operation.

2023-04-01 Thread via GitHub
bithw1 opened a new issue, #8356: URL: https://github.com/apache/hudi/issues/8356 Hi, I am running the following flink sql that writes the records to the hudi table using flink. I have enabled the compaction option by setting `'compaction.async.enabled'='true',` The whole sql

[GitHub] [hudi] TranHuyTiep commented on issue #8340: [SUPPORT] cannot assign instance of java.lang.invoke.SerializedLambda

2023-04-01 Thread via GitHub
TranHuyTiep commented on issue #8340: URL: https://github.com/apache/hudi/issues/8340#issuecomment-1493224689 > is it can work in your local ? not k8s ? yes, it can work in local I set up spark_conf.setMaster("local[*]") can work in k8s but not create executor and run in one driver

[GitHub] [hudi] hudi-bot commented on pull request #8355: [HUDI-6016] HoodieCLIUtils supports creating HoodieClient with non-default database

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8355: URL: https://github.com/apache/hudi/pull/8355#issuecomment-1493223583 ## CI report: * a00ea5107f04b2ad26ea37ae5a6e7b462b0aecbf Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8355: [HUDI-6016] HoodieCLIUtils supports creating HoodieClient with non-default database

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8355: URL: https://github.com/apache/hudi/pull/8355#issuecomment-1493222731 ## CI report: * a00ea5107f04b2ad26ea37ae5a6e7b462b0aecbf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8349: [HUDI-6012] Delete base path when failed to run bootstrap procedure

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8349: URL: https://github.com/apache/hudi/pull/8349#issuecomment-1493221815 ## CI report: * a1d57ff0e1f246cefa8f078c87dee970ab0f3e5e Azure:

[GitHub] [hudi] DavidZ1 commented on issue #8267: [SUPPORT] Why some delta commit logs files are not converted to parquet ?

2023-04-01 Thread via GitHub
DavidZ1 commented on issue #8267: URL: https://github.com/apache/hudi/issues/8267#issuecomment-1493220098 We use the offline method for compaction. It is normal to start the compaction, but after running for a period of time, we found that the compaction is delayed a lot, and the instant

[jira] [Updated] (HUDI-6016) HoodieCLIUtils supports creating HoodieClient with non-default database

2023-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6016: - Labels: pull-request-available (was: ) > HoodieCLIUtils supports creating HoodieClient with

[GitHub] [hudi] huangxiaopingRD opened a new pull request, #8355: [HUDI-6016] HoodieCLIUtils supports creating HoodieClient with non-default database

2023-04-01 Thread via GitHub
huangxiaopingRD opened a new pull request, #8355: URL: https://github.com/apache/hudi/pull/8355 ### Change Logs If the database is not specified, `getHoodieCatalogTable` will default to look up the table in the `default` database, if it is not a table in the `default`

[GitHub] [hudi] DavidZ1 commented on issue #8267: [SUPPORT] Why some delta commit logs files are not converted to parquet ?

2023-04-01 Thread via GitHub
DavidZ1 commented on issue #8267: URL: https://github.com/apache/hudi/issues/8267#issuecomment-1493216537 Yes, I understand, we test the effect of different bucket numbers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Created] (HUDI-6016) HoodieCLIUtils supports creating HoodieClient with non-default database

2023-04-01 Thread xiaoping.huang (Jira)
xiaoping.huang created HUDI-6016: Summary: HoodieCLIUtils supports creating HoodieClient with non-default database Key: HUDI-6016 URL: https://issues.apache.org/jira/browse/HUDI-6016 Project: Apache

[GitHub] [hudi] codope commented on a diff in pull request #8076: [HUDI-5884] Support bulk_insert for insert_overwrite and insert_overwrite_table

2023-04-01 Thread via GitHub
codope commented on code in PR #8076: URL: https://github.com/apache/hudi/pull/8076#discussion_r1155233044 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/clustering/run/strategy/SparkSingleFileSortExecutionStrategy.java: ## @@ -77,8 +78,11 @@ public

[GitHub] [hudi] bvaradar commented on pull request #7255: [HUDI-5250] use the estimate record size when estimation threshold is l…

2023-04-01 Thread via GitHub
bvaradar commented on PR #7255: URL: https://github.com/apache/hudi/pull/7255#issuecomment-1493212690 @honeyaya : Interested in taking this PR to completion ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] bvaradar commented on pull request #7457: [HUDI-5389] Remove Hudi Cli Duplicates Code.

2023-04-01 Thread via GitHub
bvaradar commented on PR #7457: URL: https://github.com/apache/hudi/pull/7457#issuecomment-1493212484 @slfan1989 : Did you accidentally close this PR ? Asking because you mentioned you will update the PR. Thanks -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] bvaradar commented on pull request #7143: [HUDI-5175] Improving FileIndex load performance in PARALLELISM mode

2023-04-01 Thread via GitHub
bvaradar commented on PR #7143: URL: https://github.com/apache/hudi/pull/7143#issuecomment-1493211715 @zhangyue19921010 : Thanks for the PR. Please look at the question and comments above. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Updated] (HUDI-5175) Improving FileIndex load performance in PARALLELISM mode

2023-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5175: - Labels: pull-request-available (was: ) > Improving FileIndex load performance in PARALLELISM

[GitHub] [hudi] bvaradar commented on a diff in pull request #7143: [HUDI-5175] Improving FileIndex load performance in PARALLELISM mode

2023-04-01 Thread via GitHub
bvaradar commented on code in PR #7143: URL: https://github.com/apache/hudi/pull/7143#discussion_r1155230011 ## hudi-common/src/main/java/org/apache/hudi/BaseHoodieTableFileIndex.java: ## @@ -229,17 +238,93 @@ protected List getInputFileSlices(PartitionPath partition) { }

[GitHub] [hudi] hudi-bot commented on pull request #8354: Exclude pentaho deps from hive-exec

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8354: URL: https://github.com/apache/hudi/pull/8354#issuecomment-1493206770 ## CI report: * a83de6a86d5479a97f23680724054d988ab9ae38 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8353: [MINOR] Remove unused code

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8353: URL: https://github.com/apache/hudi/pull/8353#issuecomment-1493206765 ## CI report: * cc012c55987f2d62eff0d00d9d5432200167601d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8354: Exclude pentaho deps from hive-exec

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8354: URL: https://github.com/apache/hudi/pull/8354#issuecomment-1493205886 ## CI report: * a83de6a86d5479a97f23680724054d988ab9ae38 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8353: [MINOR] Remove unused code

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8353: URL: https://github.com/apache/hudi/pull/8353#issuecomment-1493205872 ## CI report: * cc012c55987f2d62eff0d00d9d5432200167601d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] codope opened a new pull request, #8354: Exclude pentaho deps from hive-exec

2023-04-01 Thread via GitHub
codope opened a new pull request, #8354: URL: https://github.com/apache/hudi/pull/8354 ### Change Logs Hudi build on new machine (or remove the `.m2`) is failing due to ``` [ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process

[GitHub] [hudi] lvyanquan commented on a diff in pull request #8349: [HUDI-6012] Delete base path when failed to run bootstrap procedure

2023-04-01 Thread via GitHub
lvyanquan commented on code in PR #8349: URL: https://github.com/apache/hudi/pull/8349#discussion_r1155228399 ## hudi-spark-datasource/hudi-spark/src/main/java/org/apache/hudi/cli/BootstrapExecutorUtils.java: ## @@ -182,6 +182,13 @@ public void execute() throws IOException {

[GitHub] [hudi] huangxiaopingRD opened a new pull request, #8353: [MINOR] Remove unused code

2023-04-01 Thread via GitHub
huangxiaopingRD opened a new pull request, #8353: URL: https://github.com/apache/hudi/pull/8353 ### Change Logs Remove unused code ### Impact no ### Risk level (write none, low medium or high below) none ### Documentation Update ###

[GitHub] [hudi] KnightChess commented on issue #8340: [SUPPORT] cannot assign instance of java.lang.invoke.SerializedLambda

2023-04-01 Thread via GitHub
KnightChess commented on issue #8340: URL: https://github.com/apache/hudi/issues/8340#issuecomment-1493198904 is it can work in your local ? not k8s ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[hudi] branch master updated (9a79a6d4631 -> 35401194599)

2023-04-01 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 9a79a6d4631 [HUDI-5649] Unify all the loggers to slf4j (#7955) (#7955) add 35401194599 [HUDI-5780] Refactor

[GitHub] [hudi] yihua merged pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
yihua merged PR #8184: URL: https://github.com/apache/hudi/pull/8184 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #8349: [HUDI-6012] Delete base path when failed to run bootstrap procedure

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8349: URL: https://github.com/apache/hudi/pull/8349#issuecomment-1493196451 ## CI report: * 1f8525dea0a58bcb174efb7bd8a42f32183d6df1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8349: [HUDI-6012] Delete base path when failed to run bootstrap procedure

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8349: URL: https://github.com/apache/hudi/pull/8349#issuecomment-1493195273 ## CI report: * 1f8525dea0a58bcb174efb7bd8a42f32183d6df1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8344: [HUDI-5968] Fix global index duplicate when update partition

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8344: URL: https://github.com/apache/hudi/pull/8344#issuecomment-1493194480 ## CI report: * fa1b1525a163af85271f0dc9e0d5765ea2075044 Azure:

[GitHub] [hudi] lvyanquan commented on a diff in pull request #8349: [HUDI-6012] Delete base path when failed to run bootstrap procedure

2023-04-01 Thread via GitHub
lvyanquan commented on code in PR #8349: URL: https://github.com/apache/hudi/pull/8349#discussion_r1155223998 ## hudi-spark-datasource/hudi-spark/src/main/java/org/apache/hudi/cli/BootstrapExecutorUtils.java: ## @@ -182,6 +182,13 @@ public void execute() throws IOException {

[GitHub] [hudi] lvyanquan commented on a diff in pull request #8349: [HUDI-6012] Delete base path when failed to run bootstrap procedure

2023-04-01 Thread via GitHub
lvyanquan commented on code in PR #8349: URL: https://github.com/apache/hudi/pull/8349#discussion_r1155223998 ## hudi-spark-datasource/hudi-spark/src/main/java/org/apache/hudi/cli/BootstrapExecutorUtils.java: ## @@ -182,6 +182,13 @@ public void execute() throws IOException {

[GitHub] [hudi] hudi-bot commented on pull request #8344: [HUDI-5968] Fix global index duplicate when update partition

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8344: URL: https://github.com/apache/hudi/pull/8344#issuecomment-1493151752 ## CI report: * 51b9969e85c03f3f5c8274782d6ac5810c760ab1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8344: [HUDI-5968] Fix global index duplicate when update partition

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8344: URL: https://github.com/apache/hudi/pull/8344#issuecomment-1493149491 ## CI report: * 51b9969e85c03f3f5c8274782d6ac5810c760ab1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8352: [HUDI-6015] Refresh the table after executing rollback to instantTime

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8352: URL: https://github.com/apache/hudi/pull/8352#issuecomment-1493146909 ## CI report: * 4b24209938c245227cd6f1ccc1b428d50f3b51a9 Azure:

[GitHub] [hudi] xushiyan commented on a diff in pull request #8344: [HUDI-5968] Fix global index duplicate when update partition

2023-04-01 Thread via GitHub
xushiyan commented on code in PR #8344: URL: https://github.com/apache/hudi/pull/8344#discussion_r1155185037 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/simple/HoodieGlobalSimpleIndex.java: ## @@ -135,8 +135,8 @@ private HoodieData> getTaggedRecords(

[GitHub] [hudi] hudi-bot commented on pull request #8350: [HUDI-6014] Remove unused import in hudi-spark

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8350: URL: https://github.com/apache/hudi/pull/8350#issuecomment-1493131581 ## CI report: * 7348e1ee8204fe07f1ede4dc3ef569662b2294d5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8184: URL: https://github.com/apache/hudi/pull/8184#issuecomment-1493131516 ## CI report: * 91c817cde3999d618830b882c0905b3a3af567f1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7881: [HUDI-5723] Automate and standardize enum configs

2023-04-01 Thread via GitHub
hudi-bot commented on PR #7881: URL: https://github.com/apache/hudi/pull/7881#issuecomment-1493112605 ## CI report: * c378a74c177a2f1a924609a44f0978ee347d272a UNKNOWN * fac9401a3fcaa99283e204f335d7d0d38dc1b748 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8351: [HUDI-6013] Support database name for meta sync in bootstrap

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8351: URL: https://github.com/apache/hudi/pull/8351#issuecomment-1493094361 ## CI report: * 62cce26c004b5dabd45271bda4141a730ddad6cb Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7881: [HUDI-5723] Automate and standardize enum configs

2023-04-01 Thread via GitHub
hudi-bot commented on PR #7881: URL: https://github.com/apache/hudi/pull/7881#issuecomment-1493074608 ## CI report: * c378a74c177a2f1a924609a44f0978ee347d272a UNKNOWN * 8674a4b5d21a0b6254e02a4c36e69a9056e0f2e3 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8352: [HUDI-6015] Refresh the table after executing rollback to instantTime

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8352: URL: https://github.com/apache/hudi/pull/8352#issuecomment-1493073594 ## CI report: * 4b24209938c245227cd6f1ccc1b428d50f3b51a9 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7881: [HUDI-5723] Automate and standardize enum configs

2023-04-01 Thread via GitHub
hudi-bot commented on PR #7881: URL: https://github.com/apache/hudi/pull/7881#issuecomment-1493073405 ## CI report: * c378a74c177a2f1a924609a44f0978ee347d272a UNKNOWN * 8674a4b5d21a0b6254e02a4c36e69a9056e0f2e3 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8352: [HUDI-6015] Refresh the table after executing rollback to instantTime

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8352: URL: https://github.com/apache/hudi/pull/8352#issuecomment-1493071944 ## CI report: * 4b24209938c245227cd6f1ccc1b428d50f3b51a9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8349: [HUDI-6012] Delete base path when failed to run bootstrap procedure

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8349: URL: https://github.com/apache/hudi/pull/8349#issuecomment-1493071842 ## CI report: * 1f8525dea0a58bcb174efb7bd8a42f32183d6df1 Azure:

[jira] [Updated] (HUDI-6015) Refresh the table after executing rollback to instantTime

2023-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6015: - Labels: pull-request-available (was: ) > Refresh the table after executing rollback to

[GitHub] [hudi] huangxiaopingRD opened a new pull request, #8352: [HUDI-6015] Refresh the table after executing rollback to instantTime

2023-04-01 Thread via GitHub
huangxiaopingRD opened a new pull request, #8352: URL: https://github.com/apache/hudi/pull/8352 ### Change Logs Spark will cache some meta information of the table. After the RollbackToInstantTimeProcedure is executed on the table, the meta information will change and the table

[jira] [Created] (HUDI-6015) Refresh the table after executing rollback to instantTime

2023-04-01 Thread xiaoping.huang (Jira)
xiaoping.huang created HUDI-6015: Summary: Refresh the table after executing rollback to instantTime Key: HUDI-6015 URL: https://issues.apache.org/jira/browse/HUDI-6015 Project: Apache Hudi

[GitHub] [hudi] hudi-bot commented on pull request #7674: Bump mysql-connector-java from 8.0.22 to 8.0.28 in /hudi-platform-service/hudi-metaserver/hudi-metaserver-server

2023-04-01 Thread via GitHub
hudi-bot commented on PR #7674: URL: https://github.com/apache/hudi/pull/7674#issuecomment-1493054669 ## CI report: * 1a2a3dec3dc7711148db3a1ac1a9bf4b6234dff5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8350: [HUDI-6014] Remove unused import in hudi-spark

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8350: URL: https://github.com/apache/hudi/pull/8350#issuecomment-1493043019 ## CI report: * 144ee6c32ea038bc30194425dd8ef5101b24d5a1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8184: URL: https://github.com/apache/hudi/pull/8184#issuecomment-1493042927 ## CI report: * 698b05e1e29fde7cff6e450e666dd87bff00d85f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8350: [HUDI-6014] Remove unused import in hudi-spark

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8350: URL: https://github.com/apache/hudi/pull/8350#issuecomment-1493041598 ## CI report: * bc3780ce4f668b7455e3e787f740e3c54bc0fb8a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8184: URL: https://github.com/apache/hudi/pull/8184#issuecomment-1493041484 ## CI report: * 698b05e1e29fde7cff6e450e666dd87bff00d85f Azure:

[GitHub] [hudi] huangxiaopingRD commented on pull request #8350: [HUDI-6014] Remove unused import in hudi-spark

2023-04-01 Thread via GitHub
huangxiaopingRD commented on PR #8350: URL: https://github.com/apache/hudi/pull/8350#issuecomment-1493034132 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #7515: Bump gson from 2.6.2 to 2.8.9 in /packaging/hudi-cli-bundle

2023-04-01 Thread via GitHub
hudi-bot commented on PR #7515: URL: https://github.com/apache/hudi/pull/7515#issuecomment-1493007338 ## CI report: * c1b20713d7ad85c536f38407082b0e9f183325ed Azure:

[GitHub] [hudi] LinMingQiang commented on a diff in pull request #8338: [HUDI-5996] Verify the consistency of bucket num at job sta…

2023-04-01 Thread via GitHub
LinMingQiang commented on code in PR #8338: URL: https://github.com/apache/hudi/pull/8338#discussion_r1155123399 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/util/StreamerUtil.java: ## @@ -217,18 +218,52 @@ public static HoodieTableMetaClient

[GitHub] [hudi] chenbodeng719 commented on issue #8166: [SUPPORT] Hudi Bucket Index

2023-04-01 Thread via GitHub
chenbodeng719 commented on issue #8166: URL: https://github.com/apache/hudi/issues/8166#issuecomment-1492990599 @soumilshah1995 How can I use flink to do this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] hudi-bot commented on pull request #8350: [HUDI-6014] Remove unused import in hudi-spark

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8350: URL: https://github.com/apache/hudi/pull/8350#issuecomment-1492989109 ## CI report: * bc3780ce4f668b7455e3e787f740e3c54bc0fb8a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8347: [HUDI-5173] Fix new config naming around single file group clustering

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8347: URL: https://github.com/apache/hudi/pull/8347#issuecomment-1492989100 ## CI report: * 1cb0d7904acccd83eabd47b28841dd159be9711e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8350: [HUDI-6014] Remove unused import in hudi-spark

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8350: URL: https://github.com/apache/hudi/pull/8350#issuecomment-1492976543 ## CI report: * bc3780ce4f668b7455e3e787f740e3c54bc0fb8a Azure:

[jira] [Updated] (HUDI-6014) Remove unused import in hudi-spark

2023-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6014: - Labels: pull-request-available (was: ) > Remove unused import in hudi-spark >

[GitHub] [hudi] hudi-bot commented on pull request #8351: [HUDI-6013] Support database name for meta sync in bootstrap

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8351: URL: https://github.com/apache/hudi/pull/8351#issuecomment-1492976548 ## CI report: * 62cce26c004b5dabd45271bda4141a730ddad6cb Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8346: [HUDI-6004] Allow procedures to operate table which is not in the current session

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8346: URL: https://github.com/apache/hudi/pull/8346#issuecomment-1492976520 ## CI report: * b12bb9dd0337f8939bec1129a5b28e520c57dabc Azure:

[GitHub] [hudi] soumilshah1995 commented on issue #8166: [SUPPORT] Hudi Bucket Index

2023-04-01 Thread via GitHub
soumilshah1995 commented on issue #8166: URL: https://github.com/apache/hudi/issues/8166#issuecomment-1492976512 Please refer to following video https://www.youtube.com/watch?v=lOQFUrfJFP4=248s hope this helps -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] chenbodeng719 commented on issue #8166: [SUPPORT] Hudi Bucket Index

2023-04-01 Thread via GitHub
chenbodeng719 commented on issue #8166: URL: https://github.com/apache/hudi/issues/8166#issuecomment-1492976098 @KnightChess Hi, I use below conf to test bulk insert. There comes out only one parquet. Did I miss something? I expect 5 parquets( 5 buckets). My dataset is about 120GB. ```

[GitHub] [hudi] hudi-bot commented on pull request #8351: [HUDI-6013] Support database name for meta sync in bootstrap

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8351: URL: https://github.com/apache/hudi/pull/8351#issuecomment-1492975078 ## CI report: * 62cce26c004b5dabd45271bda4141a730ddad6cb UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Created] (HUDI-6014) Remove unused import in hudi-spark

2023-04-01 Thread xiaoping.huang (Jira)
xiaoping.huang created HUDI-6014: Summary: Remove unused import in hudi-spark Key: HUDI-6014 URL: https://issues.apache.org/jira/browse/HUDI-6014 Project: Apache Hudi Issue Type: Improvement

[jira] [Updated] (HUDI-6013) Support database name for meta sync in bootstrap

2023-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6013: - Labels: pull-request-available (was: ) > Support database name for meta sync in bootstrap >

[GitHub] [hudi] huangxiaopingRD opened a new pull request, #8351: [HUDI-6013] Support database name for meta sync in bootstrap

2023-04-01 Thread via GitHub
huangxiaopingRD opened a new pull request, #8351: URL: https://github.com/apache/hudi/pull/8351 ### Change Logs Support database name for meta sync in bootstrap. ### Impact no ### Risk level (write none, low medium or high below) none ### Documentation

[jira] [Created] (HUDI-6013) Support database name for meta sync in bootstrap

2023-04-01 Thread xiaoping.huang (Jira)
xiaoping.huang created HUDI-6013: Summary: Support database name for meta sync in bootstrap Key: HUDI-6013 URL: https://issues.apache.org/jira/browse/HUDI-6013 Project: Apache Hudi Issue

[GitHub] [hudi] chenbodeng719 commented on issue #8279: [SUPPORT]I use flink to bulk insert a mor table with bucket index. But it seems that you can not change the write.tasks when you stop insert and

2023-04-01 Thread via GitHub
chenbodeng719 commented on issue #8279: URL: https://github.com/apache/hudi/issues/8279#issuecomment-1492970849 I use below conf to test bulk insert. There is only one parquet. Did I miss something? I expect 5 parquet. My dataset is about 120GB. ``` CREATE TABLE

[GitHub] [hudi] huangxiaopingRD commented on a diff in pull request #8349: [HUDI-6012] Delete base path when failed to run bootstrap procedure

2023-04-01 Thread via GitHub
huangxiaopingRD commented on code in PR #8349: URL: https://github.com/apache/hudi/pull/8349#discussion_r1155108286 ## hudi-spark-datasource/hudi-spark/src/main/java/org/apache/hudi/cli/BootstrapExecutorUtils.java: ## @@ -182,6 +182,13 @@ public void execute() throws

[GitHub] [hudi] huangxiaopingRD commented on a diff in pull request #8349: [HUDI-6012] Delete base path when failed to run bootstrap procedure

2023-04-01 Thread via GitHub
huangxiaopingRD commented on code in PR #8349: URL: https://github.com/apache/hudi/pull/8349#discussion_r1155108150 ## hudi-spark-datasource/hudi-spark/src/main/java/org/apache/hudi/cli/BootstrapExecutorUtils.java: ## Review Comment: If `syncHive` fails when

[GitHub] [hudi] hudi-bot commented on pull request #8350: [MINOR] Remove unused import

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8350: URL: https://github.com/apache/hudi/pull/8350#issuecomment-1492961549 ## CI report: * bc3780ce4f668b7455e3e787f740e3c54bc0fb8a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8350: [MINOR] Remove unused import

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8350: URL: https://github.com/apache/hudi/pull/8350#issuecomment-1492960321 ## CI report: * bc3780ce4f668b7455e3e787f740e3c54bc0fb8a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8184: URL: https://github.com/apache/hudi/pull/8184#issuecomment-1492958877 ## CI report: * 698b05e1e29fde7cff6e450e666dd87bff00d85f Azure:

[GitHub] [hudi] huangxiaopingRD opened a new pull request, #8350: [MINOR] Remove unused import

2023-04-01 Thread via GitHub
huangxiaopingRD opened a new pull request, #8350: URL: https://github.com/apache/hudi/pull/8350 ### Change Logs Remove unused import ### Impact No ### Risk level (write none, low medium or high below) none ### Documentation Update ### Contributor's

[jira] [Closed] (HUDI-5649) Unify all the loggers to slf4j

2023-04-01 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-5649. Resolution: Fixed Fixed via master branch: 9a79a6d463106dc1c579ae5bc194a2f1605980ad > Unify all the

[jira] [Updated] (HUDI-5649) Unify all the loggers to slf4j

2023-04-01 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-5649: - Fix Version/s: 0.14.0 > Unify all the loggers to slf4j > -- > >

[hudi] branch master updated (9c97340e001 -> 9a79a6d4631)

2023-04-01 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 9c97340e001 Bump protobuf-java from 3.21.5 to 3.21.7 (#6871) add 9a79a6d4631 [HUDI-5649] Unify all the loggers

[GitHub] [hudi] danny0405 merged pull request #7955: [HUDI-5649] Unify all the loggers to slf4j

2023-04-01 Thread via GitHub
danny0405 merged PR #7955: URL: https://github.com/apache/hudi/pull/7955 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #8231: [HUDI-5963] Release 0.13.1 prep

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8231: URL: https://github.com/apache/hudi/pull/8231#issuecomment-1492945709 ## CI report: * 55838f0c1b495a57289b7f907560fa5b2c566981 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8349: [HUDI-6012] Delete base path when failed to run bootstrap procedure

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8349: URL: https://github.com/apache/hudi/pull/8349#issuecomment-1492921694 ## CI report: * 1f8525dea0a58bcb174efb7bd8a42f32183d6df1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8349: [HUDI-6012] Delete base path when failed to run bootstrap procedure

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8349: URL: https://github.com/apache/hudi/pull/8349#issuecomment-1492920494 ## CI report: * 1f8525dea0a58bcb174efb7bd8a42f32183d6df1 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8345: [HUDI-6011] Fix cli show archived commits breaks for replacecommit

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8345: URL: https://github.com/apache/hudi/pull/8345#issuecomment-1492919336 ## CI report: * ff23f8bdae6dc5eac49789350c1d2a79c3538949 Azure:

[jira] [Updated] (HUDI-6012) delete base path when failed to run bootstrap procedure

2023-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6012: - Labels: pull-request-available (was: ) > delete base path when failed to run bootstrap procedure

[GitHub] [hudi] lvyanquan opened a new pull request, #8349: [HUDI-6012] Delete base path when failed to run bootstrap procedure

2023-04-01 Thread via GitHub
lvyanquan opened a new pull request, #8349: URL: https://github.com/apache/hudi/pull/8349 ### Change Logs Deleted the `base_path` we created when bootstrap failed. `base_path` is always empty when we start bootstrap as we have checked in

[jira] [Updated] (HUDI-6012) delete base path when failed to run bootstrap procedure

2023-04-01 Thread lvyanquan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lvyanquan updated HUDI-6012: Description: [run_bootstrap](https://hudi.apache.org/docs/next/procedures#run_bootstrap) procedure is

[jira] [Created] (HUDI-6012) delete base path when failed to run bootstrap procedure

2023-04-01 Thread lvyanquan (Jira)
lvyanquan created HUDI-6012: --- Summary: delete base path when failed to run bootstrap procedure Key: HUDI-6012 URL: https://issues.apache.org/jira/browse/HUDI-6012 Project: Apache Hudi Issue Type:

[GitHub] [hudi] hudi-bot commented on pull request #7955: [HUDI-5649] Unify all the loggers to slf4j

2023-04-01 Thread via GitHub
hudi-bot commented on PR #7955: URL: https://github.com/apache/hudi/pull/7955#issuecomment-1492893722 ## CI report: * 7c0823ea668154194f11e562f79fa9a6ecda2bee Azure:

[GitHub] [hudi] chenbodeng719 commented on issue #8279: [SUPPORT]I use flink to bulk insert a mor table with bucket index. But it seems that you can not change the write.tasks when you stop insert and

2023-04-01 Thread via GitHub
chenbodeng719 commented on issue #8279: URL: https://github.com/apache/hudi/issues/8279#issuecomment-1492884944 > You do not declare the index type as bucket while doing the bulk_insert. So do you mean I should change my bulk insert conf like below ``` CREATE TABLE

[GitHub] [hudi] bithw1 opened a new issue, #8348: [SUPPORT]One question about flink hudi streaming query

2023-04-01 Thread via GitHub
bithw1 opened a new issue, #8348: URL: https://github.com/apache/hudi/issues/8348 Hi, I am reading at https://hudi.apache.org/docs/flink-quick-start-guide#streaming-query The example query is as follows: ``` CREATE TABLE t1( uuid VARCHAR(20) PRIMARY KEY NOT

[GitHub] [hudi] hudi-bot commented on pull request #7674: Bump mysql-connector-java from 8.0.22 to 8.0.28 in /hudi-platform-service/hudi-metaserver/hudi-metaserver-server

2023-04-01 Thread via GitHub
hudi-bot commented on PR #7674: URL: https://github.com/apache/hudi/pull/7674#issuecomment-1492880365 ## CI report: * c00d18e74a380a8a9d6f3bba0a8cef91dd9210d2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7515: Bump gson from 2.6.2 to 2.8.9 in /packaging/hudi-cli-bundle

2023-04-01 Thread via GitHub
hudi-bot commented on PR #7515: URL: https://github.com/apache/hudi/pull/7515#issuecomment-1492879107 ## CI report: * b5389217bd15707ddd4de7036b439587bb1e5bfb Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7674: Bump mysql-connector-java from 8.0.22 to 8.0.28 in /hudi-platform-service/hudi-metaserver/hudi-metaserver-server

2023-04-01 Thread via GitHub
hudi-bot commented on PR #7674: URL: https://github.com/apache/hudi/pull/7674#issuecomment-1492879147 ## CI report: * c00d18e74a380a8a9d6f3bba0a8cef91dd9210d2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8347: [HUDI-5173] Fix new config naming around single file group clustering

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8347: URL: https://github.com/apache/hudi/pull/8347#issuecomment-1492868731 ## CI report: * 1cb0d7904acccd83eabd47b28841dd159be9711e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7515: Bump gson from 2.6.2 to 2.8.9 in /packaging/hudi-cli-bundle

2023-04-01 Thread via GitHub
hudi-bot commented on PR #7515: URL: https://github.com/apache/hudi/pull/7515#issuecomment-1492868419 ## CI report: * b5389217bd15707ddd4de7036b439587bb1e5bfb Azure:

[hudi] branch dependabot/maven/hudi-platform-service/hudi-metaserver/hudi-metaserver-server/mysql-mysql-connector-java-8.0.28 updated (c00d18e74a3 -> 1a2a3dec3dc)

2023-04-01 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch dependabot/maven/hudi-platform-service/hudi-metaserver/hudi-metaserver-server/mysql-mysql-connector-java-8.0.28 in repository https://gitbox.apache.org/repos/asf/hudi.git omit c00d18e74a3

[GitHub] [hudi] yihua merged pull request #6871: Bump protobuf-java from 3.21.5 to 3.21.7

2023-04-01 Thread via GitHub
yihua merged PR #6871: URL: https://github.com/apache/hudi/pull/6871 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated (c7397013f64 -> 9c97340e001)

2023-04-01 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from c7397013f64 [HUDI-5954] Infer cleaning policy based on clean configs (#8238) add 9c97340e001 Bump protobuf-java

  1   2   >