[jira] [Updated] (HUDI-3495) Reading keys in parallel from HoodieMetadataMergedLogRecordReader may lead to empty results even if key exists

[ https://issues.apache.org/jira/browse/HUDI-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3495: - Fix Version/s: (was: 0.11.0) > Reading keys in parallel from HoodieMetadataMergedLogRecordReader may l

[jira] [Updated] (HUDI-3495) Reading keys in parallel from HoodieMetadataMergedLogRecordReader may lead to empty results even if key exists

[ https://issues.apache.org/jira/browse/HUDI-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3495: - Priority: Blocker (was: Major) > Reading keys in parallel from HoodieMetadataMergedLogRecordReader may le

[jira] [Updated] (HUDI-3427) Investigate timeouts in Hudi Kafka Connect Sink

[ https://issues.apache.org/jira/browse/HUDI-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3427: - Priority: Blocker (was: Critical) > Investigate timeouts in Hudi Kafka Connect Sink > ---

[jira] [Updated] (HUDI-3427) Investigate timeouts in Hudi Kafka Connect Sink

[ https://issues.apache.org/jira/browse/HUDI-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3427: - Issue Type: Bug (was: Improvement) > Investigate timeouts in Hudi Kafka Connect Sink > --

[jira] [Updated] (HUDI-3427) Investigate timeouts in Hudi Kafka Connect Sink

[ https://issues.apache.org/jira/browse/HUDI-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3427: - Component/s: kafka-connect > Investigate timeouts in Hudi Kafka Connect Sink > ---

[jira] [Updated] (HUDI-3427) Investigate timeouts in Hudi Kafka Connect Sink

[ https://issues.apache.org/jira/browse/HUDI-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3427: - Fix Version/s: 0.12.0 (was: 0.11.0) > Investigate timeouts in Hudi Kafka Connect Si

[jira] [Updated] (HUDI-3321) HFileWriter, HFileReader and HFileDataBlock should avoid hardcoded key field name

[ https://issues.apache.org/jira/browse/HUDI-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3321: - Labels: (was: code-cleanup) > HFileWriter, HFileReader and HFileDataBlock should avoid hardcoded key fie

[GitHub] [hudi] hudi-bot commented on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot commented on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1082595329 ## CI report: * 7ee24be4d11864af37bf300250d571e15d5f9ae9 UNKNOWN * 9a9e544ba48a52c7b54134fc9533c3e5a51ccfff UNKNOWN * 7217b7d0fac7b96b042b0a91d587f3518f3ce3e4 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot removed a comment on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1082530026 ## CI report: * 7ee24be4d11864af37bf300250d571e15d5f9ae9 UNKNOWN * 9a9e544ba48a52c7b54134fc9533c3e5a51ccfff UNKNOWN * f69bbf06e9cb669dfe0785b5eee8501ba5687

[GitHub] [hudi] hudi-bot removed a comment on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot removed a comment on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1082590199 ## CI report: * 9ba5c351c32f9f364c30b4bc9a814075150d9728 UNKNOWN * 53b4cec7d05dd0bb5a622ffb33597471da7711de UNKNOWN * e3140bb9abef7d5e9dc0405b9f8b12f11c243

[GitHub] [hudi] hudi-bot commented on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot commented on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1082595287 ## CI report: * 9ba5c351c32f9f364c30b4bc9a814075150d9728 UNKNOWN * 53b4cec7d05dd0bb5a622ffb33597471da7711de UNKNOWN * e3140bb9abef7d5e9dc0405b9f8b12f11c2438da UNKN

[jira] [Closed] (HUDI-3307) Implement a repair tool for bring back table into a clean state

[ https://issues.apache.org/jira/browse/HUDI-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3307. Resolution: Done > Implement a repair tool for bring back table into a clean state > ---

[jira] [Assigned] (HUDI-3307) Implement a repair tool for bring back table into a clean state

[ https://issues.apache.org/jira/browse/HUDI-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3307: Assignee: sivabalan narayanan (was: Ethan Guo) > Implement a repair tool for bring back table into

[jira] [Updated] (HUDI-3307) Implement a repair tool for bring back table into a clean state

[ https://issues.apache.org/jira/browse/HUDI-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3307: - Issue Type: New Feature (was: Task) > Implement a repair tool for bring back table into a clean state > -

[jira] [Updated] (HUDI-3307) Implement a repair tool for bring back table into a clean state

[ https://issues.apache.org/jira/browse/HUDI-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3307: - Component/s: cli > Implement a repair tool for bring back table into a clean state > -

[jira] [Updated] (HUDI-3301) MergedLogRecordReader inline reading should be stateless and thread safe

[ https://issues.apache.org/jira/browse/HUDI-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3301: - Labels: (was: HUDI-bug) > MergedLogRecordReader inline reading should be stateless and thread safe > ---

[jira] [Updated] (HUDI-3301) MergedLogRecordReader inline reading should be stateless and thread safe

[ https://issues.apache.org/jira/browse/HUDI-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3301: - Fix Version/s: 0.12.0 (was: 0.11.0) > MergedLogRecordReader inline reading should b

[GitHub] [hudi] xiarixiaoyao commented on pull request #4012: [HUDI-2777] Data import performance deteriorates because multiple Spark jobs are started when data is written to disks.

xiarixiaoyao commented on pull request #4012: URL: https://github.com/apache/hudi/pull/4012#issuecomment-1082593749 @vinothchandar @xushiyan in line 121 SparkRDDWriteClient.java, we call collect for rdd, which will trigger compute again. ``` List writeStats = writeStatuses.

[jira] [Updated] (HUDI-3300) Timeline server FSViewManager should avoid point lookup for metadata file partition

[ https://issues.apache.org/jira/browse/HUDI-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3300: - Issue Type: Bug (was: Task) > Timeline server FSViewManager should avoid point lookup for metadata file

[jira] [Updated] (HUDI-3300) Timeline server FSViewManager should avoid point lookup for metadata file partition

[ https://issues.apache.org/jira/browse/HUDI-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3300: - Fix Version/s: 0.12.0 (was: 0.11.0) > Timeline server FSViewManager should avoid po

[jira] [Updated] (HUDI-3298) Explore and Try Byteman for error injection on Hudi write flow

[ https://issues.apache.org/jira/browse/HUDI-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3298: - Fix Version/s: (was: 0.12.0) > Explore and Try Byteman for error injection on Hudi write flow > --

[jira] [Updated] (HUDI-3298) Explore and Try Byteman for error injection on Hudi write flow

[ https://issues.apache.org/jira/browse/HUDI-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3298: - Priority: Minor (was: Critical) > Explore and Try Byteman for error injection on Hudi write flow > --

[jira] [Updated] (HUDI-3298) Explore and Try Byteman for error injection on Hudi write flow

[ https://issues.apache.org/jira/browse/HUDI-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3298: - Epic Link: HUDI-1236 (was: HUDI-1292) > Explore and Try Byteman for error injection on Hudi write flow >

[jira] [Updated] (HUDI-3298) Explore and Try Byteman for error injection on Hudi write flow

[ https://issues.apache.org/jira/browse/HUDI-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3298: - Issue Type: Improvement (was: Test) > Explore and Try Byteman for error injection on Hudi write flow > --

[jira] [Updated] (HUDI-3298) Explore and Try Byteman for error injection on Hudi write flow

[ https://issues.apache.org/jira/browse/HUDI-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3298: - Fix Version/s: 0.12.0 (was: 0.11.0) > Explore and Try Byteman for error injection o

[jira] [Updated] (HUDI-3298) Explore and Try Byteman for error injection on Hudi write flow

[ https://issues.apache.org/jira/browse/HUDI-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3298: - Issue Type: Test (was: Task) > Explore and Try Byteman for error injection on Hudi write flow > -

[jira] [Updated] (HUDI-3066) Very slow file listing after enabling metadata for existing tables in 0.10.0 release

[ https://issues.apache.org/jira/browse/HUDI-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3066: - Priority: Blocker (was: Critical) > Very slow file listing after enabling metadata for existing tables in

[jira] [Updated] (HUDI-3066) Very slow file listing after enabling metadata for existing tables in 0.10.0 release

[ https://issues.apache.org/jira/browse/HUDI-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3066: - Epic Link: HUDI-1292 > Very slow file listing after enabling metadata for existing tables in 0.10.0 > rel

[jira] [Updated] (HUDI-3066) Very slow file listing after enabling metadata for existing tables in 0.10.0 release

[ https://issues.apache.org/jira/browse/HUDI-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3066: - Labels: metadata performance pull-request-available (was: performance pull-request-available) > Very slo

[jira] [Updated] (HUDI-3050) Unable to find server port

[ https://issues.apache.org/jira/browse/HUDI-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3050: - Component/s: (was: kafka-connect) > Unable to find server port > -- > >

[jira] [Closed] (HUDI-3050) Unable to find server port

[ https://issues.apache.org/jira/browse/HUDI-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3050. Assignee: Danny Chen (was: Ethan Guo) Resolution: Fixed > Unable to find server port > --

[GitHub] [hudi] hudi-bot removed a comment on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot removed a comment on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1079644731 ## CI report: * 9ba5c351c32f9f364c30b4bc9a814075150d9728 UNKNOWN * 53b4cec7d05dd0bb5a622ffb33597471da7711de UNKNOWN * e3140bb9abef7d5e9dc0405b9f8b12f11c243

[GitHub] [hudi] hudi-bot commented on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot commented on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1082590199 ## CI report: * 9ba5c351c32f9f364c30b4bc9a814075150d9728 UNKNOWN * 53b4cec7d05dd0bb5a622ffb33597471da7711de UNKNOWN * e3140bb9abef7d5e9dc0405b9f8b12f11c2438da UNKN

[jira] [Comment Edited] (HUDI-3050) Unable to find server port

[ https://issues.apache.org/jira/browse/HUDI-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476358#comment-17476358 ] Raymond Xu edited comment on HUDI-3050 at 3/30/22, 3:44 AM: [~

[jira] [Comment Edited] (HUDI-3050) Unable to find server port

[ https://issues.apache.org/jira/browse/HUDI-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476358#comment-17476358 ] Raymond Xu edited comment on HUDI-3050 at 3/30/22, 3:44 AM: [~

[jira] [Updated] (HUDI-2893) Metadata table not found warn logs repeated

[ https://issues.apache.org/jira/browse/HUDI-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2893: - Priority: Blocker (was: Major) > Metadata table not found warn logs repeated > -

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082563171 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082588956 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[jira] [Updated] (HUDI-2839) Align configs across Spark datasource, write client, etc

[ https://issues.apache.org/jira/browse/HUDI-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2839: - Fix Version/s: 0.12.0 (was: 0.11.0) > Align configs across Spark datasource, write

[jira] [Updated] (HUDI-2736) Redundant metadata table initialization by the metadata writer

[ https://issues.apache.org/jira/browse/HUDI-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2736: - Fix Version/s: 0.12.0 (was: 0.11.0) > Redundant metadata table initialization by th

[jira] [Updated] (HUDI-2736) Redundant metadata table initialization by the metadata writer

[ https://issues.apache.org/jira/browse/HUDI-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2736: - Component/s: code-quality > Redundant metadata table initialization by the metadata writer > -

[jira] [Updated] (HUDI-2458) Relax compaction in metadata being fenced based on inflight requests in data table

[ https://issues.apache.org/jira/browse/HUDI-2458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2458: - Fix Version/s: (was: 0.11.0) > Relax compaction in metadata being fenced based on inflight requests in

[GitHub] [hudi] vinothchandar commented on a change in pull request #4880: [HUDI-2752] The MOR DELETE block breaks the event time sequence of CDC

vinothchandar commented on a change in pull request #4880: URL: https://github.com/apache/hudi/pull/4880#discussion_r838084378 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java ## @@ -153,9 +154,29 @@ protected void proc

[GitHub] [hudi] hudi-bot commented on pull request #4012: [HUDI-2777] Data import performance deteriorates because multiple Spark jobs are started when data is written to disks.

hudi-bot commented on pull request #4012: URL: https://github.com/apache/hudi/pull/4012#issuecomment-1082580093 ## CI report: * 22c0d5a0e58f7410f65111cb766e19996dc0cff0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4012: [HUDI-2777] Data import performance deteriorates because multiple Spark jobs are started when data is written to disks.

hudi-bot removed a comment on pull request #4012: URL: https://github.com/apache/hudi/pull/4012#issuecomment-1082578530 ## CI report: * 22c0d5a0e58f7410f65111cb766e19996dc0cff0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot removed a comment on pull request #5134: [MINOR] Fix NPE when build HoodieFileIndex

hudi-bot removed a comment on pull request #5134: URL: https://github.com/apache/hudi/pull/5134#issuecomment-1079409464 ## CI report: * a699c9dec9db71622933ad3ef298aa0ba114374b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5134: [MINOR] Fix NPE when build HoodieFileIndex

hudi-bot commented on pull request #5134: URL: https://github.com/apache/hudi/pull/5134#issuecomment-1082579039 ## CI report: * a699c9dec9db71622933ad3ef298aa0ba114374b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4012: [HUDI-2777] Data import performance deteriorates because multiple Spark jobs are started when data is written to disks.

hudi-bot commented on pull request #4012: URL: https://github.com/apache/hudi/pull/4012#issuecomment-1082578530 ## CI report: * 22c0d5a0e58f7410f65111cb766e19996dc0cff0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot removed a comment on pull request #4012: [HUDI-2777] Data import performance deteriorates because multiple Spark jobs are started when data is written to disks.

hudi-bot removed a comment on pull request #4012: URL: https://github.com/apache/hudi/pull/4012#issuecomment-978209669 ## CI report: Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is a

[GitHub] [hudi] xiarixiaoyao commented on pull request #5134: [MINOR] Fix NPE when build HoodieFileIndex

xiarixiaoyao commented on pull request #5134: URL: https://github.com/apache/hudi/pull/5134#issuecomment-1082577665 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [hudi] xiarixiaoyao commented on pull request #5134: [MINOR] Fix NPE when build HoodieFileIndex

xiarixiaoyao commented on pull request #5134: URL: https://github.com/apache/hudi/pull/5134#issuecomment-1082576382 @KnightChess i also find this problem， in our product env Thank you very much for your fix -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] xiarixiaoyao commented on pull request #4421: [HUDI-3096] fixed the bug that the cow table(contains decimalType) wriite by flink cannot be read by spark.

xiarixiaoyao commented on pull request #4421: URL: https://github.com/apache/hudi/pull/4421#issuecomment-1082573012 > > @danny0405 Thank you for your attention I suggest include to 0.11. What do you suggest？ > > Yes, could you test hive 2.x and 3.x both for this patch ? Thanks in ad

[GitHub] [hudi] xiarixiaoyao commented on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

xiarixiaoyao commented on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1082572127 kindly ping @alexeykudinkin could you pls help me review again， thank you very much -- This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [hudi] danny0405 commented on pull request #4421: [HUDI-3096] fixed the bug that the cow table(contains decimalType) wriite by flink cannot be read by spark.

danny0405 commented on pull request #4421: URL: https://github.com/apache/hudi/pull/4421#issuecomment-1082571819 > @danny0405 Thank you for your attention I suggest include to 0.11. What do you suggest？ Yes, could you test hive 2.x and 3.x both for this patch ? Thanks in advance ~

[GitHub] [hudi] danny0405 closed issue #5150: [SUPPORT] bucket_bulk_insert so slow and generate too many hdfs small flie with Flink BUCKET index

danny0405 closed issue #5150: URL: https://github.com/apache/hudi/issues/5150 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@

[GitHub] [hudi] xiarixiaoyao commented on pull request #4421: [HUDI-3096] fixed the bug that the cow table(contains decimalType) wriite by flink cannot be read by spark.

xiarixiaoyao commented on pull request #4421: URL: https://github.com/apache/hudi/pull/4421#issuecomment-1082568876 @danny0405 Thank you for your attention I suggest include to 0.11. What do you suggest？ -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Closed] (HUDI-3408) fixed the bug that BUCKET_INDEX cannot process special characters

[ https://issues.apache.org/jira/browse/HUDI-3408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Meng closed HUDI-3408. -- Resolution: Won't Fix This is not a common problem， let me close it > fixed the bug that BUCKET_INDEX cannot pr

[GitHub] [hudi] xiarixiaoyao commented on pull request #4785: [HUDI-3408] fixed the bug that BUCKET_INDEX cannot process special ch…

xiarixiaoyao commented on pull request #4785: URL: https://github.com/apache/hudi/pull/4785#issuecomment-1082564919 @danny0405 @minihippo Thank you very much for your review. maybe this is not a very common problem in product env， let me close it。 -- This is an automated message fro

[GitHub] [hudi] xiarixiaoyao closed pull request #4785: [HUDI-3408] fixed the bug that BUCKET_INDEX cannot process special ch…

xiarixiaoyao closed pull request #4785: URL: https://github.com/apache/hudi/pull/4785 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082561316 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082563171 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

hudi-bot removed a comment on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1082542829 ## CI report: * f76bbaa375989de317451e753297596917fe2f77 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

hudi-bot commented on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1082561598 ## CI report: * f76bbaa375989de317451e753297596917fe2f77 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082559744 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082561316 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] hudi-bot commented on pull request #5173: [HUDI-3721]Delete MDT if necessary when trigger rollback to savepoint through cli

hudi-bot commented on pull request #5173: URL: https://github.com/apache/hudi/pull/5173#issuecomment-1082560082 ## CI report: * 5d56ed5abd6767e23a551e385956ee892352cf48 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5173: [HUDI-3721]Delete MDT if necessary when trigger rollback to savepoint through cli

hudi-bot removed a comment on pull request #5173: URL: https://github.com/apache/hudi/pull/5173#issuecomment-1082521015 ## CI report: * 5d56ed5abd6767e23a551e385956ee892352cf48 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082559744 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082552898 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] danny0405 commented on issue #4248: [SUPPORT] flink write hudi problem

danny0405 commented on issue #4248: URL: https://github.com/apache/hudi/issues/4248#issuecomment-1082554323 Yes, flink does not use the file handle to control the size, all the size is configured through the bucket assigner, the the size control is just an estimate, i guess you use the MOR

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082552898 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082547582 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] danny0405 commented on pull request #4421: [HUDI-3096] fixed the bug that the cow table(contains decimalType) wriite by flink cannot be read by spark.

danny0405 commented on pull request #4421: URL: https://github.com/apache/hudi/pull/4421#issuecomment-1082551874 @xiarixiaoyao Do we plan to include this patch into release 0.11.0 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [hudi] danny0405 commented on a change in pull request #4785: [HUDI-3408] fixed the bug that BUCKET_INDEX cannot process special ch…

danny0405 commented on a change in pull request #4785: URL: https://github.com/apache/hudi/pull/4785#discussion_r838058918 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bucket/BucketIdentifier.java ## @@ -43,7 +43,7 @@ public static int getBu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1081965935 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1082547582 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] hudi-bot commented on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot commented on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1082544271 ## CI report: * 333da7447af7d602ffa3067a759cecc62e4365d8 UNKNOWN * a119a051dbe0a0921b6bd58fbb0f1bbd3d647fa8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot removed a comment on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1082540650 ## CI report: * 333da7447af7d602ffa3067a759cecc62e4365d8 UNKNOWN * a119a051dbe0a0921b6bd58fbb0f1bbd3d647fa8 Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4489: [HUDI-3135] Make delete partitions lazy to be executed by the cleaner

XuQianJin-Stars commented on pull request #4489: URL: https://github.com/apache/hudi/pull/4489#issuecomment-1082543361 > @XuQianJin-Stars @xushiyan : We are in need of this patch for async indexer feature in metadata table. So, I took over and pushed an update. I have fixed the description

[GitHub] [hudi] hudi-bot removed a comment on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

hudi-bot removed a comment on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1082540945 ## CI report: * 7b62ff1b2204b0845fcc9b7bb271781a25dbc030 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

hudi-bot commented on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1082542829 ## CI report: * f76bbaa375989de317451e753297596917fe2f77 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

hudi-bot removed a comment on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1082528695 ## CI report: * 7b62ff1b2204b0845fcc9b7bb271781a25dbc030 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

hudi-bot commented on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1082540945 ## CI report: * 7b62ff1b2204b0845fcc9b7bb271781a25dbc030 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot commented on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1082540650 ## CI report: * 333da7447af7d602ffa3067a759cecc62e4365d8 UNKNOWN * a119a051dbe0a0921b6bd58fbb0f1bbd3d647fa8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot removed a comment on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1082206671 ## CI report: * 333da7447af7d602ffa3067a759cecc62e4365d8 UNKNOWN * a119a051dbe0a0921b6bd58fbb0f1bbd3d647fa8 Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] xiarixiaoyao edited a comment on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

xiarixiaoyao edited a comment on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1082534853 @alexeykudinkin addressed the comment， The code has been modified according to your opinion but i still have a I have a question， do we really need force set

[GitHub] [hudi] xiarixiaoyao commented on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

xiarixiaoyao commented on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1082534853 @alexeykudinkin addressed the comment but i still have a I have a question， do we really need force set spark.sql.parquet.recordLevelFilter.enabled=true to mor/cow snapsh

[GitHub] [hudi] hudi-bot commented on pull request #5174: [Minor]Make cli 'commit rollback' using rollbackUsingMarkers false as default

hudi-bot commented on pull request #5174: URL: https://github.com/apache/hudi/pull/5174#issuecomment-1082531603 ## CI report: * 6d09991ecdecbf15c37352e713a3add4213755e0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5174: [Minor]Make cli 'commit rollback' using rollbackUsingMarkers false as default

hudi-bot removed a comment on pull request #5174: URL: https://github.com/apache/hudi/pull/5174#issuecomment-1082530218 ## CI report: * 6d09991ecdecbf15c37352e713a3add4213755e0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4489: [HUDI-3135] Make delete partitions lazy to be executed by the cleaner

hudi-bot commented on pull request #4489: URL: https://github.com/apache/hudi/pull/4489#issuecomment-1082531223 ## CI report: * e1e36f49a55f272ad4871c7fe7d66075394c4eee Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4489: [HUDI-3135] Make delete partitions lazy to be executed by the cleaner

hudi-bot removed a comment on pull request #4489: URL: https://github.com/apache/hudi/pull/4489#issuecomment-1082529817 ## CI report: * e1e36f49a55f272ad4871c7fe7d66075394c4eee Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] nsivabalan commented on pull request #4489: [HUDI-3135] Make delete partitions lazy to be executed by the cleaner

nsivabalan commented on pull request #4489: URL: https://github.com/apache/hudi/pull/4489#issuecomment-1082530377 @XuQianJin-Stars @xushiyan : We are in need of this patch for async indexer feature in metadata table. So, I took over and pushed an update. I have fixed the description to exp

[GitHub] [hudi] hudi-bot commented on pull request #5174: [Minor]Make cli 'commit rollback' using rollbackUsingMarkers false as default

hudi-bot commented on pull request #5174: URL: https://github.com/apache/hudi/pull/5174#issuecomment-1082530218 ## CI report: * 6d09991ecdecbf15c37352e713a3add4213755e0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot commented on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1082530026 ## CI report: * 7ee24be4d11864af37bf300250d571e15d5f9ae9 UNKNOWN * 9a9e544ba48a52c7b54134fc9533c3e5a51ccfff UNKNOWN * f69bbf06e9cb669dfe0785b5eee8501ba56871fe Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot removed a comment on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1082513487 ## CI report: * 7ee24be4d11864af37bf300250d571e15d5f9ae9 UNKNOWN * 9a9e544ba48a52c7b54134fc9533c3e5a51ccfff UNKNOWN * f69bbf06e9cb669dfe0785b5eee8501ba5687

[GitHub] [hudi] hudi-bot commented on pull request #4489: [HUDI-3135] Make delete partitions lazy to be executed by the cleaner

hudi-bot commented on pull request #4489: URL: https://github.com/apache/hudi/pull/4489#issuecomment-1082529817 ## CI report: * e1e36f49a55f272ad4871c7fe7d66075394c4eee Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4489: [HUDI-3135] Make delete partitions lazy to be executed by the cleaner

hudi-bot removed a comment on pull request #4489: URL: https://github.com/apache/hudi/pull/4489#issuecomment-1080845852 ## CI report: * e1e36f49a55f272ad4871c7fe7d66075394c4eee Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

hudi-bot commented on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1082528695 ## CI report: * 7b62ff1b2204b0845fcc9b7bb271781a25dbc030 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

hudi-bot removed a comment on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1082527212 ## CI report: * 7b62ff1b2204b0845fcc9b7bb271781a25dbc030 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] zhangyue19921010 opened a new pull request #5174: [Minor]Make cli 'commit rollback' using rollbackUsingMarkers false as default

zhangyue19921010 opened a new pull request #5174: URL: https://github.com/apache/hudi/pull/5174 When users trigger 'commit rollback' for a committed instant, it will throw followed exception when set rollbackUsingMarkers true as default. We may need a common strategy for rollback

<    1   2   3   4   5   6   7   >