[GitHub] [hudi] codope commented on a diff in pull request #9071: [HUDI-6453] Cascade Glue schema changes to partitions

2023-08-13 Thread via GitHub
codope commented on code in PR #9071: URL: https://github.com/apache/hudi/pull/9071#discussion_r1292982378 ## hudi-aws/src/main/java/org/apache/hudi/aws/sync/AWSGlueCatalogSyncClient.java: ## @@ -330,7 +312,6 @@ && getTable(awsGlue, databaseName,

[GitHub] [hudi] hudi-bot commented on pull request #8718: [HUDI-6214] Enabling compaction by default for batch writes with MOR table

2023-08-13 Thread via GitHub
hudi-bot commented on PR #8718: URL: https://github.com/apache/hudi/pull/8718#issuecomment-1676693683 ## CI report: * 52129fa71d4b109e09daa47ef1af35108ac93235 Azure:

[jira] [Updated] (HUDI-6683) Added kafka key as part of hudi metadata columns for Json & Avro KafkaSource

2023-08-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6683: - Labels: pull-request-available (was: ) > Added kafka key as part of hudi metadata columns for

[GitHub] [hudi] prathit06 commented on pull request #9403: [HUDI-6683] Added kafka key as part of hudi metadata columns for Json & Avro KafkaSource

2023-08-13 Thread via GitHub
prathit06 commented on PR #9403: URL: https://github.com/apache/hudi/pull/9403#issuecomment-1676690811 Hi @danny0405 , if all looks good, can we merge this PR ? Please let me if any other action item. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] hudi-bot commented on pull request #8718: [HUDI-6214] Enabling compaction by default for batch writes with MOR table

2023-08-13 Thread via GitHub
hudi-bot commented on PR #8718: URL: https://github.com/apache/hudi/pull/8718#issuecomment-1676688380 ## CI report: * 52129fa71d4b109e09daa47ef1af35108ac93235 Azure:

[GitHub] [hudi] ksoullpwk opened a new issue, #9440: [SUPPORT] Trino cannot read when there is replacecommit metadata

2023-08-13 Thread via GitHub
ksoullpwk opened a new issue, #9440: URL: https://github.com/apache/hudi/issues/9440 **Describe the problem you faced** After upgraded from 400 to 422, Hudi connector in Trino cannot read any data if there is replacecommit. **To Reproduce** Steps to reproduce the

[GitHub] [hudi] hudi-bot commented on pull request #9438: [MINOR] Remove duplicate switch branch in HoodieInputFormatUtils

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9438: URL: https://github.com/apache/hudi/pull/9438#issuecomment-1676683624 ## CI report: * ff7b031efa78db64e7440cf6f311ca2390768156 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9438: [MINOR] Remove duplicate switch branch in HoodieInputFormatUtils

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9438: URL: https://github.com/apache/hudi/pull/9438#issuecomment-1676647904 ## CI report: * ff7b031efa78db64e7440cf6f311ca2390768156 Azure:

[GitHub] [hudi] danny0405 commented on issue #9435: [SUPPORT] Trino can't read tables created by Flink Hudi conector

2023-08-13 Thread via GitHub
danny0405 commented on issue #9435: URL: https://github.com/apache/hudi/issues/9435#issuecomment-1676624532 Did you check the log of JM to ensure the hive sync works as expected? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Closed] (HUDI-6690) Generate test jars for hudi-utilities and hudi-hive-sync modules

2023-08-13 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-6690. Resolution: Fixed Fixed via master branch: 6a0ba2d4e466408d85aa0b22dc32e9581acdb3e3 > Generate test jars

[jira] [Updated] (HUDI-6690) Generate test jars for hudi-utilities and hudi-hive-sync modules

2023-08-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6690: - Labels: pull-request-available (was: ) > Generate test jars for hudi-utilities and

[hudi] branch master updated (a5e5c7ba1e2 -> 6a0ba2d4e46)

2023-08-13 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from a5e5c7ba1e2 [HUDI-6675] Fix Clean action will delete the whole table (#9413) add 6a0ba2d4e46 [HUDI-6690]

[GitHub] [hudi] danny0405 merged pull request #9297: [HUDI-6690] Generate test jars for hudi-utilities and hudi-hive-sync modules

2023-08-13 Thread via GitHub
danny0405 merged PR #9297: URL: https://github.com/apache/hudi/pull/9297 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (HUDI-6690) Generate test jars for hudi-utilities and hudi-hive-sync modules

2023-08-13 Thread Danny Chen (Jira)
Danny Chen created HUDI-6690: Summary: Generate test jars for hudi-utilities and hudi-hive-sync modules Key: HUDI-6690 URL: https://issues.apache.org/jira/browse/HUDI-6690 Project: Apache Hudi

[jira] [Updated] (HUDI-6690) Generate test jars for hudi-utilities and hudi-hive-sync modules

2023-08-13 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-6690: - Fix Version/s: 0.14.0 > Generate test jars for hudi-utilities and hudi-hive-sync modules >

[jira] [Updated] (HUDI-6675) Clean action will delete the whole table

2023-08-13 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-6675: - Fix Version/s: 0.14.0 > Clean action will delete the whole table >

[jira] [Closed] (HUDI-6675) Clean action will delete the whole table

2023-08-13 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-6675. Resolution: Fixed Fixed via master branch: a5e5c7ba1e2db1b3d8d8fd6da441998d54e57a80 > Clean action will

[hudi] branch master updated: [HUDI-6675] Fix Clean action will delete the whole table (#9413)

2023-08-13 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a5e5c7ba1e2 [HUDI-6675] Fix Clean action will

[GitHub] [hudi] hudi-bot commented on pull request #9437: [HUDI-6689] Add record index validation in MDT validator

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9437: URL: https://github.com/apache/hudi/pull/9437#issuecomment-1676509231 ## CI report: * f0f16cb886023e9f9eba3073583a786803944e9b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9437: [HUDI-6689] Add record index validation in MDT validator

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9437: URL: https://github.com/apache/hudi/pull/9437#issuecomment-1676473918 ## CI report: * d8489b0399eebc8a5da866f303592ce1d1d2e920 Azure:

[GitHub] [hudi] nfarah86 opened a new pull request, #9439: updated video section with new contnet

2023-08-13 Thread via GitHub
nfarah86 opened a new pull request, #9439: URL: https://github.com/apache/hudi/pull/9439 added a talk, blogs & videos to the hudi website cc @bhasudha or @yihua or @nsivabalan to review please https://github.com/apache/hudi/assets/5392555/52eaf5cb-a358-4e7b-a5c2-c2409bd14613;>

[GitHub] [hudi] hudi-bot commented on pull request #9437: [HUDI-6689] Add record index validation in MDT validator

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9437: URL: https://github.com/apache/hudi/pull/9437#issuecomment-1676464638 ## CI report: * d8489b0399eebc8a5da866f303592ce1d1d2e920 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9438: Duplicate switch branch in HoodieInputFormatUtils

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9438: URL: https://github.com/apache/hudi/pull/9438#issuecomment-1676400462 ## CI report: * ff7b031efa78db64e7440cf6f311ca2390768156 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9297: Generate test jars for hudi-utilities and hudi-hive-sync modules

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9297: URL: https://github.com/apache/hudi/pull/9297#issuecomment-1676400382 ## CI report: * fa3e9e07708fa20056f46c58b2631d1225496049 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9438: Duplicate switch branch in HoodieInputFormatUtils

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9438: URL: https://github.com/apache/hudi/pull/9438#issuecomment-1676344067 ## CI report: * ff7b031efa78db64e7440cf6f311ca2390768156 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9438: Duplicate switch branch in HoodieInputFormatUtils

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9438: URL: https://github.com/apache/hudi/pull/9438#issuecomment-1676341906 ## CI report: * ff7b031efa78db64e7440cf6f311ca2390768156 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #9297: Generate test jars for hudi-utilities and hudi-hive-sync modules

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9297: URL: https://github.com/apache/hudi/pull/9297#issuecomment-1676341831 ## CI report: * fa3e9e07708fa20056f46c58b2631d1225496049 Azure:

[GitHub] [hudi] empcl commented on pull request #9297: Generate test jars for hudi-utilities and hudi-hive-sync modules

2023-08-13 Thread via GitHub
empcl commented on PR #9297: URL: https://github.com/apache/hudi/pull/9297#issuecomment-1676340131 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] empcl opened a new pull request, #9438: Duplicate switch branch in HoodieInputFormatUtils

2023-08-13 Thread via GitHub
empcl opened a new pull request, #9438: URL: https://github.com/apache/hudi/pull/9438 ### Change Logs Duplicate switch branch in HoodieInputFormatUtils ### Impact Duplicate switch branch in HoodieInputFormatUtils ### Risk level (write none, low medium or high below)

[GitHub] [hudi] hudi-bot commented on pull request #9437: [HUDI-6689] Add record index validation in MDT validator

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9437: URL: https://github.com/apache/hudi/pull/9437#issuecomment-1676305656 ## CI report: * d8489b0399eebc8a5da866f303592ce1d1d2e920 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9437: [HUDI-6689] Add record index validation in MDT validator

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9437: URL: https://github.com/apache/hudi/pull/9437#issuecomment-1676272610 ## CI report: * d8489b0399eebc8a5da866f303592ce1d1d2e920 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #9437: [HUDI-6689] Add record index validation in MDT validator

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9437: URL: https://github.com/apache/hudi/pull/9437#issuecomment-1676259980 ## CI report: * d8489b0399eebc8a5da866f303592ce1d1d2e920 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-6689) Add record index validation in metadata table validator

2023-08-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6689: - Labels: pull-request-available (was: ) > Add record index validation in metadata table validator

[GitHub] [hudi] yihua opened a new pull request, #9437: [HUDI-6689] Add record index validation in MDT validator

2023-08-13 Thread via GitHub
yihua opened a new pull request, #9437: URL: https://github.com/apache/hudi/pull/9437 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance

[jira] [Assigned] (HUDI-6689) Add record index validation in metadata table validator

2023-08-13 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-6689: --- Assignee: Ethan Guo > Add record index validation in metadata table validator >

[jira] [Created] (HUDI-6689) Add record index validation in metadata table validator

2023-08-13 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-6689: --- Summary: Add record index validation in metadata table validator Key: HUDI-6689 URL: https://issues.apache.org/jira/browse/HUDI-6689 Project: Apache Hudi Issue Type:

[GitHub] [hudi] hudi-bot commented on pull request #9436: [HUDI-6688] Fix partition validation to only consider commits in metadata table validator

2023-08-13 Thread via GitHub
hudi-bot commented on PR #9436: URL: https://github.com/apache/hudi/pull/9436#issuecomment-1676246189 ## CI report: * 59fb286d6c6e6a1a3ab1eafa3723e8f2824c79cf Azure: