[hudi] branch dependabot/maven/packaging/hudi-cli-bundle/com.google.code.gson-gson-2.8.9 updated (b5389217bd1 -> c1b20713d7a)

2023-04-01 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch dependabot/maven/packaging/hudi-cli-bundle/com.google.code.gson-gson-2.8.9 in repository https://gitbox.apache.org/repos/asf/hudi.git discard b5389217bd1 Bump gson from 2.6.2 to 2.8.9 in

[GitHub] [hudi] yihua commented on pull request #7515: Bump gson from 2.6.2 to 2.8.9 in /packaging/hudi-cli-bundle

2023-04-01 Thread via GitHub
yihua commented on PR #7515: URL: https://github.com/apache/hudi/pull/7515#issuecomment-1492867096 @rahil-c could you clarify if the gson upgrade is OK? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] hudi-bot commented on pull request #8347: [HUDI-5173] Fix new config naming around single file group clustering

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8347: URL: https://github.com/apache/hudi/pull/8347#issuecomment-1492867098 ## CI report: * 1cb0d7904acccd83eabd47b28841dd159be9711e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8346: [HUDI-6004] Allow procedures to operate table which is not in the current session

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8346: URL: https://github.com/apache/hudi/pull/8346#issuecomment-1492867084 ## CI report: * b12bb9dd0337f8939bec1129a5b28e520c57dabc Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8184: URL: https://github.com/apache/hudi/pull/8184#issuecomment-1492866978 ## CI report: * ce2c0d014825259c24332b9d9198430fcfd99c5f Azure:

[GitHub] [hudi] yihua merged pull request #8334: [MINOR][DOCS] Remove preCombineField which is not in table

2023-04-01 Thread via GitHub
yihua merged PR #8334: URL: https://github.com/apache/hudi/pull/8334 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch asf-site updated: [DOCS] Remove preCombineField which is not in table (#8334)

2023-04-01 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 0c19ca03e0b [DOCS] Remove preCombineField

[GitHub] [hudi] yihua commented on a diff in pull request #7159: [HUDI-5173] Skip if there is only one file in clusteringGroup

2023-04-01 Thread via GitHub
yihua commented on code in PR #7159: URL: https://github.com/apache/hudi/pull/7159#discussion_r1155072822 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieClusteringConfig.java: ## @@ -182,6 +182,12 @@ public class HoodieClusteringConfig extends

[GitHub] [hudi] hudi-bot commented on pull request #8346: [HUDI-6004] Allow procedures to operate table which is not in the current session

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8346: URL: https://github.com/apache/hudi/pull/8346#issuecomment-1492865452 ## CI report: * b12bb9dd0337f8939bec1129a5b28e520c57dabc UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8184: URL: https://github.com/apache/hudi/pull/8184#issuecomment-1492865320 ## CI report: * 96564776159cf216ca345a9f78d926c5e421dd23 Azure:

[GitHub] [hudi] yihua opened a new pull request, #8347: [HUDI-5173] Fix new config naming around single file group clustering

2023-04-01 Thread via GitHub
yihua opened a new pull request, #8347: URL: https://github.com/apache/hudi/pull/8347 ### Change Logs This PR fixes the naming of the new config, from `hoodie.clustering.plan.strategy..single.group.clustering.enabled` to

[GitHub] [hudi] TranHuyTiep commented on issue #8340: [SUPPORT] cannot assign instance of java.lang.invoke.SerializedLambda

2023-04-01 Thread via GitHub
TranHuyTiep commented on issue #8340: URL: https://github.com/apache/hudi/issues/8340#issuecomment-1492861891 > can you provide a simple reproduce step, like `code` or `sql` Here is my code `# -*- coding: utf-8 -*- from pyspark.conf import SparkConf from pyspark.sql

[hudi] branch master updated: [HUDI-5954] Infer cleaning policy based on clean configs (#8238)

2023-04-01 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new c7397013f64 [HUDI-5954] Infer cleaning policy

[GitHub] [hudi] yihua merged pull request #8238: [HUDI-5954] Infer cleaning policy based on clean configs

2023-04-01 Thread via GitHub
yihua merged PR #8238: URL: https://github.com/apache/hudi/pull/8238 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] wecharyu commented on pull request #8296: [HUDI-5986] Empty preCombineKey should never be stored in hoodie.properties

2023-04-01 Thread via GitHub
wecharyu commented on PR #8296: URL: https://github.com/apache/hudi/pull/8296#issuecomment-1492861298 Empty precombineKey set by insertintoCommand will not affect the write operation, because Hudi determine hasPrecombineColumn by `hoodie.properties` from hoodieCatalogTable:

[GitHub] [hudi] yihua commented on pull request #8238: [HUDI-5954] Infer cleaning policy based on clean configs

2023-04-01 Thread via GitHub
yihua commented on PR #8238: URL: https://github.com/apache/hudi/pull/8238#issuecomment-1492861245 CI is green. https://user-images.githubusercontent.com/2497195/229271805-6db678af-348c-48c9-8862-de80acbe56ae.png;> -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] yihua commented on a diff in pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
yihua commented on code in PR #8184: URL: https://github.com/apache/hudi/pull/8184#discussion_r1155070220 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java: ## @@ -282,8 +226,8 @@ public OffsetRange[] getNextOffsetRanges(Option

[GitHub] [hudi] yihua commented on a diff in pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
yihua commented on code in PR #8184: URL: https://github.com/apache/hudi/pull/8184#discussion_r1155069638 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/config/SourceTestConfig.java: ## @@ -0,0 +1,49 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [hudi] yihua commented on a diff in pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
yihua commented on code in PR #8184: URL: https://github.com/apache/hudi/pull/8184#discussion_r1155069525 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/config/HoodieIncrSourceConfig.java: ## @@ -0,0 +1,86 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [hudi] yihua commented on a diff in pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
yihua commented on code in PR #8184: URL: https://github.com/apache/hudi/pull/8184#discussion_r1155069491 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/config/SqlSourceConfig.java: ## @@ -0,0 +1,43 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [hudi] yihua commented on a diff in pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
yihua commented on code in PR #8184: URL: https://github.com/apache/hudi/pull/8184#discussion_r1155069426 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/SqlSource.java: ## @@ -91,6 +92,7 @@ protected Pair>, String> fetchNextBatch( */ private static

[GitHub] [hudi] yihua commented on a diff in pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
yihua commented on code in PR #8184: URL: https://github.com/apache/hudi/pull/8184#discussion_r1155069305 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/JdbcSource.java: ## @@ -262,82 +264,89 @@ private String checkpoint(Dataset rowDataset, boolean

[GitHub] [hudi] yihua commented on a diff in pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
yihua commented on code in PR #8184: URL: https://github.com/apache/hudi/pull/8184#discussion_r1155069167 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/GcsEventsHoodieIncrSource.java: ## @@ -114,19 +111,19 @@ public GcsEventsHoodieIncrSource(TypedProperties

[GitHub] [hudi] yihua commented on a diff in pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
yihua commented on code in PR #8184: URL: https://github.com/apache/hudi/pull/8184#discussion_r1155068927 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/config/GCSEventsSourceConfig.java: ## @@ -0,0 +1,48 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[jira] [Updated] (HUDI-6004) failed to execute Spark procedure for table not in current database

2023-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6004: - Labels: pull-request-available (was: ) > failed to execute Spark procedure for table not in

[GitHub] [hudi] lvyanquan opened a new pull request, #8346: [HUDI-6004] Allow procedures to operate table which is not in the current session

2023-04-01 Thread via GitHub
lvyanquan opened a new pull request, #8346: URL: https://github.com/apache/hudi/pull/8346 ### Change Logs 1. Add a new method to `HoodieCLIUtils.scala` so that we could get HoodieCatalogTable which is not in the current session. `hoodie.properties` file only record table name with

[GitHub] [hudi] yihua commented on a diff in pull request #8184: [HUDI-5780] Refactor Deltastreamer source configs to use HoodieConfig/ConfigProperty

2023-04-01 Thread via GitHub
yihua commented on code in PR #8184: URL: https://github.com/apache/hudi/pull/8184#discussion_r1155061104 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/GcsEventsHoodieIncrSource.java: ## @@ -114,19 +111,19 @@ public GcsEventsHoodieIncrSource(TypedProperties

[GitHub] [hudi] hudi-bot commented on pull request #8128: [HUDI-5782] Tweak defaults and remove unnecessary configs after config review

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8128: URL: https://github.com/apache/hudi/pull/8128#issuecomment-1492854094 ## CI report: * f0b1d2eb5f656f064748ae84b2411a176a459cf8 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8231: [HUDI-5963] Release 0.13.1 prep

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8231: URL: https://github.com/apache/hudi/pull/8231#issuecomment-1492852998 ## CI report: * eeb33425481da36251ac0f7ce72989badedac484 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8231: [HUDI-5963] Release 0.13.1 prep

2023-04-01 Thread via GitHub
hudi-bot commented on PR #8231: URL: https://github.com/apache/hudi/pull/8231#issuecomment-1492851761 ## CI report: * eeb33425481da36251ac0f7ce72989badedac484 Azure:

<    1   2