[jira] [Updated] (HUDI-3288) Partition specific compaction strategy for the metadata table

[ https://issues.apache.org/jira/browse/HUDI-3288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3288: - Priority: Critical (was: Blocker) > Partition specific compaction strategy for the metadata table > -

[jira] [Updated] (HUDI-3288) Partition specific compaction strategy for the metadata table

[ https://issues.apache.org/jira/browse/HUDI-3288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3288: - Issue Type: Improvement (was: Task) > Partition specific compaction strategy for the metadata table > ---

[jira] [Updated] (HUDI-3317) Partition specific pointed lookup/reading strategy for metadata table

[ https://issues.apache.org/jira/browse/HUDI-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3317: - Issue Type: Improvement (was: Task) > Partition specific pointed lookup/reading strategy for metadata tab

[jira] [Updated] (HUDI-3317) Partition specific pointed lookup/reading strategy for metadata table

[ https://issues.apache.org/jira/browse/HUDI-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3317: - Priority: Critical (was: Blocker) > Partition specific pointed lookup/reading strategy for metadata table

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1053981830 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * 4ff0d57275e8f907d945c60bd93c2bef227c7c3d Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1052203919 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * 4ff0d57275e8f907d945c60bd93c2bef227c7

[jira] [Updated] (HUDI-3374) metadata index for secondary keys

[ https://issues.apache.org/jira/browse/HUDI-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3374: - Issue Type: New Feature (was: Task) > metadata index for secondary keys > ---

[jira] [Updated] (HUDI-3323) Refactor: Metadata various partitions payload merging using delegation pattern

[ https://issues.apache.org/jira/browse/HUDI-3323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3323: - Issue Type: Improvement (was: Task) > Refactor: Metadata various partitions payload merging using delegat

[jira] [Updated] (HUDI-3364) Support column stats indexing for subset of columns

[ https://issues.apache.org/jira/browse/HUDI-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3364: - Issue Type: New Feature (was: Task) > Support column stats indexing for subset of columns > -

[jira] [Updated] (HUDI-3364) Support column stats indexing for subset of columns

[ https://issues.apache.org/jira/browse/HUDI-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3364: - Component/s: index metadata > Support column stats indexing for subset of columns > -

[jira] [Updated] (HUDI-3364) Support column stats indexing for subset of columns

[ https://issues.apache.org/jira/browse/HUDI-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3364: - Story Points: 1 (was: 2) > Support column stats indexing for subset of columns >

[jira] [Updated] (HUDI-3374) metadata index for secondary keys

[ https://issues.apache.org/jira/browse/HUDI-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3374: - Component/s: index metadata > metadata index for secondary keys > ---

[jira] [Updated] (HUDI-3374) metadata index for secondary keys

[ https://issues.apache.org/jira/browse/HUDI-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3374: - Story Points: 4 (was: 2) > metadata index for secondary keys > - > >

[jira] [Updated] (HUDI-3374) metadata index for secondary keys

[ https://issues.apache.org/jira/browse/HUDI-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3374: - Summary: metadata index for secondary keys (was: Column stats index initialization for MOR table - handle

[jira] [Assigned] (HUDI-3374) Column stats index initialization for MOR table - handle log files

[ https://issues.apache.org/jira/browse/HUDI-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3374: Assignee: Sagar Sumit (was: Manoj Govindassamy) > Column stats index initialization for MOR table

[jira] [Assigned] (HUDI-3364) Support column stats indexing for subset of columns

[ https://issues.apache.org/jira/browse/HUDI-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3364: Assignee: Sagar Sumit (was: Manoj Govindassamy) > Support column stats indexing for subset of colu

[jira] [Closed] (HUDI-3181) Address test failures after enabling metadata index for bloom filters and column stats

[ https://issues.apache.org/jira/browse/HUDI-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-3181. - Resolution: Fixed Covered in https://github.com/apache/hudi/pull/4848 > Address test failures after enabl

[jira] [Commented] (HUDI-2584) Unit tests for bloom filter index based out of metadata table.

[ https://issues.apache.org/jira/browse/HUDI-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17498740#comment-17498740 ] Sagar Sumit commented on HUDI-2584: --- Covered in https://github.com/apache/hudi/pull/4848

[jira] [Updated] (HUDI-2584) Unit tests for bloom filter index based out of metadata table.

[ https://issues.apache.org/jira/browse/HUDI-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2584: -- Status: Patch Available (was: In Progress) > Unit tests for bloom filter index based out of metadata ta

[jira] [Assigned] (HUDI-3405) Query Integration: Graceful fallback when indexes are not available

[ https://issues.apache.org/jira/browse/HUDI-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-3405: - Assignee: Alexey Kudinkin > Query Integration: Graceful fallback when indexes are not available >

[GitHub] [hudi] hudi-bot removed a comment on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot removed a comment on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053919010 ## CI report: * cdaabab72ea658e40f6e78aea5f80284d9f6cdfb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot commented on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053959626 ## CI report: * a1c9b418d6ce372d52a97b1ac9b00121e6280901 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4848: [HUDI-3356][HUDI-3203] HoodieData for metadata index records, bloom and colstats init

hudi-bot commented on pull request #4848: URL: https://github.com/apache/hudi/pull/4848#issuecomment-1053957438 ## CI report: * 48399d1f4e5fc3acf04ded4e9ed6e1fbfb34aebd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4848: [HUDI-3356][HUDI-3203] HoodieData for metadata index records, bloom and colstats init

hudi-bot removed a comment on pull request #4848: URL: https://github.com/apache/hudi/pull/4848#issuecomment-1053955444 ## CI report: * 48399d1f4e5fc3acf04ded4e9ed6e1fbfb34aebd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4848: [HUDI-3356][HUDI-3203] HoodieData for metadata index records, bloom and colstats init

hudi-bot commented on pull request #4848: URL: https://github.com/apache/hudi/pull/4848#issuecomment-1053955444 ## CI report: * 48399d1f4e5fc3acf04ded4e9ed6e1fbfb34aebd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4848: [HUDI-3356][HUDI-3203] HoodieData for metadata index records, bloom and colstats init

hudi-bot removed a comment on pull request #4848: URL: https://github.com/apache/hudi/pull/4848#issuecomment-1048722584 ## CI report: * 48399d1f4e5fc3acf04ded4e9ed6e1fbfb34aebd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4924: [WIP][CI Test Only - 2][HUDI-1180] Upgrade HBase to 2.4.9

hudi-bot removed a comment on pull request #4924: URL: https://github.com/apache/hudi/pull/4924#issuecomment-1053949920 ## CI report: * a9c0bcb8a33a8c046732a4aa135423f84f65235d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4924: [WIP][CI Test Only - 2][HUDI-1180] Upgrade HBase to 2.4.9

hudi-bot commented on pull request #4924: URL: https://github.com/apache/hudi/pull/4924#issuecomment-1053951773 ## CI report: * a9c0bcb8a33a8c046732a4aa135423f84f65235d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4924: [WIP][CI Test Only - 2][HUDI-1180] Upgrade HBase to 2.4.9

hudi-bot commented on pull request #4924: URL: https://github.com/apache/hudi/pull/4924#issuecomment-1053949920 ## CI report: * a9c0bcb8a33a8c046732a4aa135423f84f65235d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] yihua opened a new pull request #4924: [WIP][CI Test Only - 2][HUDI-1180] Upgrade HBase to 2.4.9

yihua opened a new pull request #4924: URL: https://github.com/apache/hudi/pull/4924 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose o

[GitHub] [hudi] stayrascal commented on a change in pull request #4920: #4923 Fix String convert issue and overwrite putAll method in Typed…

stayrascal commented on a change in pull request #4920: URL: https://github.com/apache/hudi/pull/4920#discussion_r815621307 ## File path: hudi-common/src/main/java/org/apache/hudi/common/config/TypedProperties.java ## @@ -63,11 +64,22 @@ public Enumeration propertyNames() {

[GitHub] [hudi] stayrascal commented on a change in pull request #4920: #4923 Fix String convert issue and overwrite putAll method in Typed…

stayrascal commented on a change in pull request #4920: URL: https://github.com/apache/hudi/pull/4920#discussion_r815618613 ## File path: hudi-common/src/test/java/org/apache/hudi/common/properties/TestTypedProperties.java ## @@ -99,8 +99,37 @@ public void testPropertiesOrder(

[GitHub] [hudi] stayrascal commented on pull request #4920: #4923 Fix String convert issue and overwrite putAll method in Typed…

stayrascal commented on pull request #4920: URL: https://github.com/apache/hudi/pull/4920#issuecomment-1053943299 > Thanks @nsivabalan review this PR. I failed to create a Jira card, not sure where I can create the card or I didn't have the permission. Instead, I create an issue [h

[GitHub] [hudi] stayrascal opened a new issue #4923: [SUPPORT] Enhance `TypedProperties` class to support running with Java 11

stayrascal opened a new issue #4923: URL: https://github.com/apache/hudi/issues/4923 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at dev-subsc

[GitHub] [hudi] codope commented on a change in pull request #4848: [HUDI-3356][HUDI-3203] HoodieData for metadata index records, bloom and colstats init

codope commented on a change in pull request #4848: URL: https://github.com/apache/hudi/pull/4848#discussion_r815607975 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieAppendHandle.java ## @@ -339,6 +385,13 @@ private void processAppendResul

[GitHub] [hudi] hudi-bot removed a comment on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot removed a comment on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053917136 ## CI report: * cdaabab72ea658e40f6e78aea5f80284d9f6cdfb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot commented on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053919010 ## CI report: * cdaabab72ea658e40f6e78aea5f80284d9f6cdfb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] codope commented on a change in pull request #4848: [HUDI-3356][HUDI-3203] HoodieData for metadata index records, bloom and colstats init

codope commented on a change in pull request #4848: URL: https://github.com/apache/hudi/pull/4848#discussion_r815600163 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java ## @@ -347,64 +348,62 @@ public void

[GitHub] [hudi] hudi-bot removed a comment on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot removed a comment on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053914960 ## CI report: * cdaabab72ea658e40f6e78aea5f80284d9f6cdfb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot commented on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053917136 ## CI report: * cdaabab72ea658e40f6e78aea5f80284d9f6cdfb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot commented on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053914960 ## CI report: * cdaabab72ea658e40f6e78aea5f80284d9f6cdfb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot removed a comment on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053879401 ## CI report: * 911d7ac0445cfec6dd87779ce5e4a55d585520aa Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] codope commented on a change in pull request #4848: [HUDI-3356][HUDI-3203] HoodieData for metadata index records, bloom and colstats init

codope commented on a change in pull request #4848: URL: https://github.com/apache/hudi/pull/4848#discussion_r815594460 ## File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java ## @@ -848,41 +857,40 @@ public static HoodieTableFileSystemVie

[GitHub] [hudi] codope commented on a change in pull request #4848: [HUDI-3356][HUDI-3203] HoodieData for metadata index records, bloom and colstats init

codope commented on a change in pull request #4848: URL: https://github.com/apache/hudi/pull/4848#discussion_r815594374 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodieDeltaWriteStat.java ## @@ -69,4 +73,24 @@ public void addLogFiles(String logFile)

[GitHub] [hudi] hudi-bot commented on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot commented on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053879401 ## CI report: * 911d7ac0445cfec6dd87779ce5e4a55d585520aa Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot removed a comment on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053877885 ## CI report: * 911d7ac0445cfec6dd87779ce5e4a55d585520aa Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot removed a comment on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053839989 ## CI report: * 911d7ac0445cfec6dd87779ce5e4a55d585520aa Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot commented on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053877885 ## CI report: * 911d7ac0445cfec6dd87779ce5e4a55d585520aa Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] codope commented on pull request #4919: [HUDI-3521] Fixing kafka key and value serializer value type from class to string

codope commented on pull request #4919: URL: https://github.com/apache/hudi/pull/4919#issuecomment-1053856892 Looks good to me. I was just waiting for CI success 👍 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] hudi-bot commented on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot commented on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053839989 ## CI report: * 911d7ac0445cfec6dd87779ce5e4a55d585520aa Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot removed a comment on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053838149 ## CI report: * 911d7ac0445cfec6dd87779ce5e4a55d585520aa UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

hudi-bot commented on pull request #4922: URL: https://github.com/apache/hudi/pull/4922#issuecomment-1053838149 ## CI report: * 911d7ac0445cfec6dd87779ce5e4a55d585520aa UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Commented] (HUDI-2283) Support Clustering Command For Spark Sql

[ https://issues.apache.org/jira/browse/HUDI-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17498693#comment-17498693 ] Forward Xu commented on HUDI-2283: -- Link : [https://github.com/apache/hudi/pull/4901]  >

[jira] [Updated] (HUDI-3441) Clean up markers of completed commits in .hoodie/.temp folder

[ https://issues.apache.org/jira/browse/HUDI-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3441: - Labels: pull-request-available (was: ) > Clean up markers of completed commits in .hoodie/.temp f

[GitHub] [hudi] XuQianJin-Stars opened a new pull request #4922: [HUDI-3441] Clean up markers of completed commits in .hoodie/.temp fo…

XuQianJin-Stars opened a new pull request #4922: URL: https://github.com/apache/hudi/pull/4922 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4902: [HUDI-3497] Adding Datatable validator tool

zhangyue19921010 commented on a change in pull request #4902: URL: https://github.com/apache/hudi/pull/4902#discussion_r815536487 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieDataTableValidator.java ## @@ -0,0 +1,473 @@ +/* + * Licensed to the Apa

[hudi] branch master updated (d5444ff -> 1932152)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from d5444ff [HUDI-3018] Adding validation to dataframe scheme to ensure reserved field does not have diff data type (#

[GitHub] [hudi] danny0405 merged pull request #4862: [MINOR] Change MINI_BATCH_SIZE to 2048

danny0405 merged pull request #4862: URL: https://github.com/apache/hudi/pull/4862 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [hudi] cafelo-pfdrive commented on issue #4873: Processing time very Slow Updating records into Hudi Dataset(MOR) using AWS Glue

cafelo-pfdrive commented on issue #4873: URL: https://github.com/apache/hudi/issues/4873#issuecomment-1053805595 @Gatsby-Lee really appreciate your answer. here it goes the latest .hoddie folder. I see new "clean" file. What type of file should create it for the compaction? ![im

[GitHub] [hudi] zhangyue19921010 commented on pull request #4902: [HUDI-3497] Adding Datatable validator tool

zhangyue19921010 commented on pull request #4902: URL: https://github.com/apache/hudi/pull/4902#issuecomment-1053793481 > @zhangyue19921010 : Can you help review this as well. Sure will do it ASAP -- This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [hudi] cuibo01 commented on a change in pull request #4862: [MINOR] Change MINI_BATCH_SIZE to 2048

cuibo01 commented on a change in pull request #4862: URL: https://github.com/apache/hudi/pull/4862#discussion_r815533927 ## File path: hudi-flink/src/main/java/org/apache/hudi/source/StreamReadOperator.java ## @@ -64,7 +64,7 @@ private static final Logger LOG = LoggerFac

[GitHub] [hudi] guanziyue commented on pull request #4913: [HUDI-1517] create marker file for every log file

guanziyue commented on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1053786323 Hi @yihua This PR is ready for review. Could you have a look when you have spare time. -- This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [hudi] hudi-bot removed a comment on pull request #4913: [HUDI-1517] create marker file for every log file

hudi-bot removed a comment on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1053747305 ## CI report: * 4306f2a75ddbb6c0eca86d8fcf35c889d923b557 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4913: [HUDI-1517] create marker file for every log file

hudi-bot commented on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1053784297 ## CI report: * 0c81e53f83757b49d9e5f5df3bbeebdd076b99b5 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] melin closed issue #4857: [SUPPORT]Failed to create a table

melin closed issue #4857: URL: https://github.com/apache/hudi/issues/4857 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi

[GitHub] [hudi] guanziyue commented on pull request #4444: [HUDI-3026] don't allow HoodieAppendHandle roll over to next fileID

guanziyue commented on pull request #: URL: https://github.com/apache/hudi/pull/#issuecomment-1053753544 Hi @nsivabalan This problem may be solved if we have HUDI-1517. [https://github.com/apache/hudi/pull/4913](url) And this case is also covered in the UT of HUDI-1517. So coul

[GitHub] [hudi] hudi-bot commented on pull request #4913: [WIP][HUDI-1517] create marker file for every log file

hudi-bot commented on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1053747305 ## CI report: * 4306f2a75ddbb6c0eca86d8fcf35c889d923b557 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4913: [WIP][HUDI-1517] create marker file for every log file

hudi-bot removed a comment on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1053746046 ## CI report: * 4306f2a75ddbb6c0eca86d8fcf35c889d923b557 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4913: [WIP][HUDI-1517] create marker file for every log file

hudi-bot commented on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1053746046 ## CI report: * 4306f2a75ddbb6c0eca86d8fcf35c889d923b557 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4913: [WIP][HUDI-1517] create marker file for every log file

hudi-bot removed a comment on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1053703958 ## CI report: * 4306f2a75ddbb6c0eca86d8fcf35c889d923b557 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4913: [WIP][HUDI-1517] create marker file for every log file

hudi-bot removed a comment on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1053682593 ## CI report: * 6816a4b47b88108172b46fece160e4e078345687 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4913: [WIP][HUDI-1517] create marker file for every log file

hudi-bot commented on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1053703958 ## CI report: * 4306f2a75ddbb6c0eca86d8fcf35c889d923b557 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4913: [WIP][HUDI-1517] create marker file for every log file

hudi-bot removed a comment on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1053681646 ## CI report: * 6816a4b47b88108172b46fece160e4e078345687 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4913: [WIP][HUDI-1517] create marker file for every log file

hudi-bot commented on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1053682593 ## CI report: * 6816a4b47b88108172b46fece160e4e078345687 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4913: [WIP][HUDI-1517] create marker file for every log file

hudi-bot commented on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1053681646 ## CI report: * 6816a4b47b88108172b46fece160e4e078345687 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4913: [WIP][HUDI-1517] create marker file for every log file

hudi-bot removed a comment on pull request #4913: URL: https://github.com/apache/hudi/pull/4913#issuecomment-1051907113 ## CI report: * 6816a4b47b88108172b46fece160e4e078345687 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4385: [HUDI-1436]: provided option to trigger clean every nth commit

hudi-bot removed a comment on pull request #4385: URL: https://github.com/apache/hudi/pull/4385#issuecomment-1053654965 ## CI report: * 029a857e7114a119a21126bc48d0d554bda66f10 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4385: [HUDI-1436]: provided option to trigger clean every nth commit

hudi-bot commented on pull request #4385: URL: https://github.com/apache/hudi/pull/4385#issuecomment-1053671792 ## CI report: * 70a7b69be4ab3c02be63c51df85f2b624aeb4187 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4921: [HUDI-3520] Introduce DeleteSupportSchemaPostProcessor to support add…

hudi-bot commented on pull request #4921: URL: https://github.com/apache/hudi/pull/4921#issuecomment-1053659135 ## CI report: * 71dd885fe63ff14942b9b09db3b199c15c6d45c6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4921: [HUDI-3520] Introduce DeleteSupportSchemaPostProcessor to support add…

hudi-bot removed a comment on pull request #4921: URL: https://github.com/apache/hudi/pull/4921#issuecomment-1053641655 ## CI report: * 89eb9f69f46e6f14cd57bb99666ef3f1f9a0e245 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[jira] [Updated] (HUDI-3524) Decouple basic and advanced configs in website

[ https://issues.apache.org/jira/browse/HUDI-3524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3524: -- Priority: Critical (was: Major) > Decouple basic and advanced configs in website >

[jira] [Updated] (HUDI-3524) Decouple basic and advanced configs in website

[ https://issues.apache.org/jira/browse/HUDI-3524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3524: -- Description: Spark Datasource Configs Read configs: hoodie.datasource.query.type Wri

[GitHub] [hudi] hudi-bot removed a comment on pull request #4385: [HUDI-1436]: provided option to trigger clean every nth commit

hudi-bot removed a comment on pull request #4385: URL: https://github.com/apache/hudi/pull/4385#issuecomment-1053654374 ## CI report: * 029a857e7114a119a21126bc48d0d554bda66f10 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4385: [HUDI-1436]: provided option to trigger clean every nth commit

hudi-bot commented on pull request #4385: URL: https://github.com/apache/hudi/pull/4385#issuecomment-1053654965 ## CI report: * 029a857e7114a119a21126bc48d0d554bda66f10 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4385: [HUDI-1436]: provided option to trigger clean every nth commit

hudi-bot removed a comment on pull request #4385: URL: https://github.com/apache/hudi/pull/4385#issuecomment-1046241730 ## CI report: * 029a857e7114a119a21126bc48d0d554bda66f10 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4385: [HUDI-1436]: provided option to trigger clean every nth commit

hudi-bot commented on pull request #4385: URL: https://github.com/apache/hudi/pull/4385#issuecomment-1053654374 ## CI report: * 029a857e7114a119a21126bc48d0d554bda66f10 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4468: [HUDI-3130] Fixing Hive getSchema for RT tables addressing different partitions having different schemas

hudi-bot commented on pull request #4468: URL: https://github.com/apache/hudi/pull/4468#issuecomment-1053651107 ## CI report: * 256f7d8d49e502ee5504815dcb2df7e4453e67a7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4468: [HUDI-3130] Fixing Hive getSchema for RT tables addressing different partitions having different schemas

hudi-bot removed a comment on pull request #4468: URL: https://github.com/apache/hudi/pull/4468#issuecomment-1053633442 ## CI report: * c032433e87c4eccf92b90cea68e2811ef2a0f225 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Updated] (HUDI-3524) Decouple basic and advanced configs in website

[ https://issues.apache.org/jira/browse/HUDI-3524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3524: -- Fix Version/s: 0.11.0 > Decouple basic and advanced configs in website > ---

[jira] [Created] (HUDI-3524) Decouple basic and advanced configs in website

sivabalan narayanan created HUDI-3524: - Summary: Decouple basic and advanced configs in website Key: HUDI-3524 URL: https://issues.apache.org/jira/browse/HUDI-3524 Project: Apache Hudi Is

[jira] [Closed] (HUDI-3521) NPE exception with docker demo with latest master

[ https://issues.apache.org/jira/browse/HUDI-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3521. - Resolution: Fixed > NPE exception with docker demo with latest master > --

[jira] [Reopened] (HUDI-3521) NPE exception with docker demo with latest master

[ https://issues.apache.org/jira/browse/HUDI-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-3521: --- > NPE exception with docker demo with latest master >

[jira] [Resolved] (HUDI-3521) NPE exception with docker demo with latest master

[ https://issues.apache.org/jira/browse/HUDI-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-3521. --- > NPE exception with docker demo with latest master >

[GitHub] [hudi] hudi-bot commented on pull request #4921: [HUDI-3520] Introduce DeleteSupportSchemaPostProcessor to support add…

hudi-bot commented on pull request #4921: URL: https://github.com/apache/hudi/pull/4921#issuecomment-1053641655 ## CI report: * 89eb9f69f46e6f14cd57bb99666ef3f1f9a0e245 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4921: [HUDI-3520] Introduce DeleteSupportSchemaPostProcessor to support add…

hudi-bot removed a comment on pull request #4921: URL: https://github.com/apache/hudi/pull/4921#issuecomment-1053630713 ## CI report: * 89eb9f69f46e6f14cd57bb99666ef3f1f9a0e245 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4840: [HUDI-2917] rollback insert data appended to log file when using Hbase Index

hudi-bot removed a comment on pull request #4840: URL: https://github.com/apache/hudi/pull/4840#issuecomment-1053615846 ## CI report: * 260c29fa4d9e1d0e45e9ee771d51ed3f6b2f7c5f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4840: [HUDI-2917] rollback insert data appended to log file when using Hbase Index

hudi-bot commented on pull request #4840: URL: https://github.com/apache/hudi/pull/4840#issuecomment-1053635693 ## CI report: * 260c29fa4d9e1d0e45e9ee771d51ed3f6b2f7c5f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4468: [HUDI-3130] Fixing Hive getSchema for RT tables addressing different partitions having different schemas

hudi-bot commented on pull request #4468: URL: https://github.com/apache/hudi/pull/4468#issuecomment-1053633442 ## CI report: * c032433e87c4eccf92b90cea68e2811ef2a0f225 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4468: [HUDI-3130] Fixing Hive getSchema for RT tables addressing different partitions having different schemas

hudi-bot removed a comment on pull request #4468: URL: https://github.com/apache/hudi/pull/4468#issuecomment-1053632716 ## CI report: * c032433e87c4eccf92b90cea68e2811ef2a0f225 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4468: [HUDI-3130] Fixing Hive getSchema for RT tables addressing different partitions having different schemas

hudi-bot removed a comment on pull request #4468: URL: https://github.com/apache/hudi/pull/4468#issuecomment-1052128438 ## CI report: * c032433e87c4eccf92b90cea68e2811ef2a0f225 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

  1   2   3   >