[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079620376 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079624873 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] xiarixiaoyao commented on pull request #4709: [HUDI-3338] custom relation instead of HadoopFsRelation

xiarixiaoyao commented on pull request #4709: URL: https://github.com/apache/hudi/pull/4709#issuecomment-1079624811 @alexeykudinkin find the root cause. we should set sqlContext.sparkSession.sessionState.conf.setConfString("spark.sql.parquet.enableVectorizedReader", "true") for c

[GitHub] [hudi] alexeykudinkin commented on pull request #4709: [HUDI-3338] custom relation instead of HadoopFsRelation

alexeykudinkin commented on pull request #4709: URL: https://github.com/apache/hudi/pull/4709#issuecomment-1079622208 @xiarixiaoyao can you please also paste the schema of your table? Would it be possible for you to enable vectorization (uncomment it in `HoodieBaseRelation`) and measure ag

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079620376 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079616902 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

xiarixiaoyao commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079620172 @bvaradar finished all comments, 1) remove old hudi relation 2) add check for bootstrap table could you pls help me review again, thanks -- This is an automated me

[GitHub] [hudi] 1Ricco commented on pull request #5124: [HUDI-3689] Fix delta streamer tests

1Ricco commented on pull request #5124: URL: https://github.com/apache/hudi/pull/5124#issuecomment-1079619467 > > ## CI report: > > * b2c97b8a2191e8db945ebc679e9470ca242da0ca Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot removed a comment on pull request #5135: [HUDI-3716] OOM occurred when use bulk_insert cow table with flink BU…

hudi-bot removed a comment on pull request #5135: URL: https://github.com/apache/hudi/pull/5135#issuecomment-1079591079 ## CI report: * b5098ca28ad5206c8c0acf340b17fa21dc12366a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5135: [HUDI-3716] OOM occurred when use bulk_insert cow table with flink BU…

hudi-bot commented on pull request #5135: URL: https://github.com/apache/hudi/pull/5135#issuecomment-1079618004 ## CI report: * b5098ca28ad5206c8c0acf340b17fa21dc12366a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079616902 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079591680 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] xiarixiaoyao commented on pull request #4709: [HUDI-3338] custom relation instead of HadoopFsRelation

xiarixiaoyao commented on pull request #4709: URL: https://github.com/apache/hudi/pull/4709#issuecomment-1079605361 @YannByron @xushiyan this is test result http://schemas.microsoft.com/office/2004/12/omml"; xmlns="http://www.w3.org/TR/REC-html40";>

[GitHub] [hudi] hudi-bot removed a comment on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot removed a comment on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1079589375 ## CI report: * 9ba5c351c32f9f364c30b4bc9a814075150d9728 UNKNOWN * 53b4cec7d05dd0bb5a622ffb33597471da7711de UNKNOWN * e3140bb9abef7d5e9dc0405b9f8b12f11c243

[GitHub] [hudi] hudi-bot commented on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot commented on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1079604726 ## CI report: * 9ba5c351c32f9f364c30b4bc9a814075150d9728 UNKNOWN * 53b4cec7d05dd0bb5a622ffb33597471da7711de UNKNOWN * e3140bb9abef7d5e9dc0405b9f8b12f11c2438da UNKN

[GitHub] [hudi] hudi-bot commented on pull request #4945: [HUDI-3538] Support Compaction Command Based on Call Procedure Command for Spark SQL

hudi-bot commented on pull request #4945: URL: https://github.com/apache/hudi/pull/4945#issuecomment-1079597091 ## CI report: * 1e6045ac77f45a33e66fa1c5be6027cb4fd94a52 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4945: [HUDI-3538] Support Compaction Command Based on Call Procedure Command for Spark SQL

hudi-bot removed a comment on pull request #4945: URL: https://github.com/apache/hudi/pull/4945#issuecomment-1079596278 ## CI report: * 1e6045ac77f45a33e66fa1c5be6027cb4fd94a52 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] Guanpx commented on issue #5132: [SUPPORT] OOM occurred when use bulk_insert cow table with flink BUCKET index

Guanpx commented on issue #5132: URL: https://github.com/apache/hudi/issues/5132#issuecomment-1079596952 > see #5135 Thank you very much, I will try again when it's merged.👍🏻 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [hudi] hudi-bot removed a comment on pull request #4945: [HUDI-3538] Support Compaction Command Based on Call Procedure Command for Spark SQL

hudi-bot removed a comment on pull request #4945: URL: https://github.com/apache/hudi/pull/4945#issuecomment-1079249526 ## CI report: * 1e6045ac77f45a33e66fa1c5be6027cb4fd94a52 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4945: [HUDI-3538] Support Compaction Command Based on Call Procedure Command for Spark SQL

hudi-bot commented on pull request #4945: URL: https://github.com/apache/hudi/pull/4945#issuecomment-1079596278 ## CI report: * 1e6045ac77f45a33e66fa1c5be6027cb4fd94a52 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[hudi] branch master updated (51034fe -> 0c09a97)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 51034fe [HUDI-3396] Refactoring `MergeOnReadRDD` to avoid duplication, fetch only projected columns (#4888) a

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079591680 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079590948 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] hudi-bot commented on pull request #5135: [HUDI-3716] OOM occurred when use bulk_insert cow table with flink BU…

hudi-bot commented on pull request #5135: URL: https://github.com/apache/hudi/pull/5135#issuecomment-1079591079 ## CI report: * b5098ca28ad5206c8c0acf340b17fa21dc12366a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5135: [HUDI-3716] OOM occurred when use bulk_insert cow table with flink BU…

hudi-bot removed a comment on pull request #5135: URL: https://github.com/apache/hudi/pull/5135#issuecomment-1079590343 ## CI report: * b5098ca28ad5206c8c0acf340b17fa21dc12366a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079590948 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079469064 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] hudi-bot commented on pull request #5135: [HUDI-3716] OOM occurred when use bulk_insert cow table with flink BU…

hudi-bot commented on pull request #5135: URL: https://github.com/apache/hudi/pull/5135#issuecomment-1079590343 ## CI report: * b5098ca28ad5206c8c0acf340b17fa21dc12366a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Updated] (HUDI-3716) OOM occurred when use bulk_insert cow table with flink BUCKET index

[ https://issues.apache.org/jira/browse/HUDI-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3716: - Labels: pull-request-available (was: ) > OOM occurred when use bulk_insert cow table with flink B

[GitHub] [hudi] danny0405 commented on issue #5132: [SUPPORT] OOM occurred when use bulk_insert cow table with flink BUCKET index

danny0405 commented on issue #5132: URL: https://github.com/apache/hudi/issues/5132#issuecomment-1079589489 see https://github.com/apache/hudi/pull/5135 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] hudi-bot removed a comment on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot removed a comment on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1079585326 ## CI report: * 9ba5c351c32f9f364c30b4bc9a814075150d9728 UNKNOWN * 53b4cec7d05dd0bb5a622ffb33597471da7711de UNKNOWN * e3140bb9abef7d5e9dc0405b9f8b12f11c243

[GitHub] [hudi] hudi-bot commented on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot commented on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1079589375 ## CI report: * 9ba5c351c32f9f364c30b4bc9a814075150d9728 UNKNOWN * 53b4cec7d05dd0bb5a622ffb33597471da7711de UNKNOWN * e3140bb9abef7d5e9dc0405b9f8b12f11c2438da UNKN

[GitHub] [hudi] danny0405 opened a new pull request #5135: [HUDI-3716] OOM occurred when use bulk_insert cow table with flink BU…

danny0405 opened a new pull request #5135: URL: https://github.com/apache/hudi/pull/5135 …CKET index ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* #

[jira] [Commented] (HUDI-3435) Do not throw exception when instant to rollback does not exist in metadata table active timeline

[ https://issues.apache.org/jira/browse/HUDI-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512664#comment-17512664 ] Danny Chen commented on HUDI-3435: -- Fixed via master branch: 0c09a973fb0470a47411f734d2d5

[jira] [Resolved] (HUDI-3435) Do not throw exception when instant to rollback does not exist in metadata table active timeline

[ https://issues.apache.org/jira/browse/HUDI-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-3435. -- > Do not throw exception when instant to rollback does not exist in metadata > table active timeline >

[GitHub] [hudi] danny0405 merged pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

danny0405 merged pull request #4821: URL: https://github.com/apache/hudi/pull/4821 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1079588515 ## CI report: * fdcd586ec9cdf54bd07d60f4631289203d8c2002 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1079565432 ## CI report: * 2f1368dc4ac772db5d02b555dc041ccd49cb189b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot removed a comment on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1079300756 ## CI report: * 9ba5c351c32f9f364c30b4bc9a814075150d9728 UNKNOWN * 53b4cec7d05dd0bb5a622ffb33597471da7711de UNKNOWN * e3140bb9abef7d5e9dc0405b9f8b12f11c243

[GitHub] [hudi] hudi-bot commented on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot commented on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1079585326 ## CI report: * 9ba5c351c32f9f364c30b4bc9a814075150d9728 UNKNOWN * 53b4cec7d05dd0bb5a622ffb33597471da7711de UNKNOWN * e3140bb9abef7d5e9dc0405b9f8b12f11c2438da UNKN

[GitHub] [hudi] XuQianJin-Stars commented on a change in pull request #4945: [HUDI-3538] Support Compaction Command Based on Call Procedure Command for Spark SQL

XuQianJin-Stars commented on a change in pull request #4945: URL: https://github.com/apache/hudi/pull/4945#discussion_r835704792 ## File path: hudi-spark-datasource/hudi-spark/src/main/java/org/apache/spark/sql/hudi/command/procedures/ProcedureConstEnum.java ## @@ -0,0 +1,63 @

[GitHub] [hudi] hudi-bot commented on pull request #5129: [HUDI-3709] Fixing `ParquetWriter` impls not respecting Parquet Max File Size limit

hudi-bot commented on pull request #5129: URL: https://github.com/apache/hudi/pull/5129#issuecomment-1079583193 ## CI report: * dd1c5ba905eb898ae3fe65b900bdafec751e4e9f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5129: [HUDI-3709] Fixing `ParquetWriter` impls not respecting Parquet Max File Size limit

hudi-bot removed a comment on pull request #5129: URL: https://github.com/apache/hudi/pull/5129#issuecomment-1079562670 ## CI report: * dd1c5ba905eb898ae3fe65b900bdafec751e4e9f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] XuQianJin-Stars commented on a change in pull request #4945: [HUDI-3538] Support Compaction Command Based on Call Procedure Command for Spark SQL

XuQianJin-Stars commented on a change in pull request #4945: URL: https://github.com/apache/hudi/pull/4945#discussion_r835704792 ## File path: hudi-spark-datasource/hudi-spark/src/main/java/org/apache/spark/sql/hudi/command/procedures/ProcedureConstEnum.java ## @@ -0,0 +1,63 @

[GitHub] [hudi] hudi-bot commented on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot commented on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1079572814 ## CI report: * d68f9448706f659685b357a469be1d2f40968760 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot removed a comment on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1079550978 ## CI report: * 89aa73e03fbc8b318668c6e01f7c720fde657d7f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot removed a comment on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079541607 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * 02c1f87d52c983eee4bf75d4b75eef3084825

[GitHub] [hudi] hudi-bot commented on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot commented on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079568075 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * 02c1f87d52c983eee4bf75d4b75eef308482568f Azur

[jira] [Updated] (HUDI-3717) Avoid double-listing w/in BaseHoodieTableFileIndex

[ https://issues.apache.org/jira/browse/HUDI-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3717: -- Attachment: Screen Shot 2022-03-25 at 7.14.20 PM.png > Avoid double-listing w/in BaseHoodieTable

[jira] [Updated] (HUDI-3717) Avoid double-listing w/in BaseHoodieTableFileIndex

[ https://issues.apache.org/jira/browse/HUDI-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3717: -- Description: Currently in `BaseHoodieTableFileIndex::loadPartitionPathFiles` essentially does f

[jira] [Assigned] (HUDI-3717) Avoid double-listing w/in BaseHoodieTableFileIndex

[ https://issues.apache.org/jira/browse/HUDI-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin reassigned HUDI-3717: - Assignee: Alexey Kudinkin > Avoid double-listing w/in BaseHoodieTableFileIndex >

[jira] [Updated] (HUDI-3717) Avoid double-listing w/in BaseHoodieTableFileIndex

[ https://issues.apache.org/jira/browse/HUDI-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3717: -- Fix Version/s: 0.11.0 > Avoid double-listing w/in BaseHoodieTableFileIndex > ---

[jira] [Commented] (HUDI-2606) Ensure query engines not access MDT if disabled

[ https://issues.apache.org/jira/browse/HUDI-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512659#comment-17512659 ] sivabalan narayanan commented on HUDI-2606: --- [~xushiyan] [~guoyihua] : this need

[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1079565432 ## CI report: * 2f1368dc4ac772db5d02b555dc041ccd49cb189b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1079544872 ## CI report: * 2f1368dc4ac772db5d02b555dc041ccd49cb189b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[jira] [Created] (HUDI-3717) Avoid double-listing w/in BaseHoodieTableFileIndex

Alexey Kudinkin created HUDI-3717: - Summary: Avoid double-listing w/in BaseHoodieTableFileIndex Key: HUDI-3717 URL: https://issues.apache.org/jira/browse/HUDI-3717 Project: Apache Hudi Issue

[GitHub] [hudi] hudi-bot commented on pull request #5129: [HUDI-3709] Fixing `ParquetWriter` impls not respecting Parquet Max File Size limit

hudi-bot commented on pull request #5129: URL: https://github.com/apache/hudi/pull/5129#issuecomment-1079562670 ## CI report: * dd1c5ba905eb898ae3fe65b900bdafec751e4e9f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5129: [HUDI-3709] Fixing `ParquetWriter` impls not respecting Parquet Max File Size limit

hudi-bot removed a comment on pull request #5129: URL: https://github.com/apache/hudi/pull/5129#issuecomment-1079498537 ## CI report: * dd1c5ba905eb898ae3fe65b900bdafec751e4e9f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] alexeykudinkin commented on pull request #5129: [HUDI-3709] Fixing `ParquetWriter` impls not respecting Parquet Max File Size limit

alexeykudinkin commented on pull request #5129: URL: https://github.com/apache/hudi/pull/5129#issuecomment-1079561708 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[jira] [Commented] (HUDI-3577) NPE in HoodieTimelineArchiver

[ https://issues.apache.org/jira/browse/HUDI-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512658#comment-17512658 ] Alexey Kudinkin commented on HUDI-3577: --- This becomes more frequent now:  [https://d

[GitHub] [hudi] alexeykudinkin commented on a change in pull request #5129: [HUDI-3709] Fixing `ParquetWriter` impls not respecting Parquet Max File Size limit

alexeykudinkin commented on a change in pull request #5129: URL: https://github.com/apache/hudi/pull/5129#discussion_r835695328 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/action/commit/TestCopyOnWriteActionExecutor.java ## @@ -437,7 +437,7

[GitHub] [hudi] alexeykudinkin commented on a change in pull request #5129: [HUDI-3709] Fixing `ParquetWriter` impls not respecting Parquet Max File Size limit

alexeykudinkin commented on a change in pull request #5129: URL: https://github.com/apache/hudi/pull/5129#discussion_r835695328 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/action/commit/TestCopyOnWriteActionExecutor.java ## @@ -437,7 +437,7

[GitHub] [hudi] hudi-bot commented on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot commented on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1079550978 ## CI report: * 89aa73e03fbc8b318668c6e01f7c720fde657d7f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot removed a comment on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1079550043 ## CI report: * 89aa73e03fbc8b318668c6e01f7c720fde657d7f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

xiarixiaoyao commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079550894 https://github.com/apache/hudi/pull/4910#discussion_r834319573 @bvaradar @YannByron this is test result http://schemas.microsoft.com/office/2004/12/omml"; xmlns="http

[GitHub] [hudi] hudi-bot commented on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot commented on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1079550043 ## CI report: * 89aa73e03fbc8b318668c6e01f7c720fde657d7f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot removed a comment on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1079223959 ## CI report: * 89aa73e03fbc8b318668c6e01f7c720fde657d7f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1079544872 ## CI report: * 2f1368dc4ac772db5d02b555dc041ccd49cb189b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1079544203 ## CI report: * 5f5a78275b36b700036ce07e4e69cf925ec069a6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1079544203 ## CI report: * 5f5a78275b36b700036ce07e4e69cf925ec069a6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1079542308 ## CI report: * 5f5a78275b36b700036ce07e4e69cf925ec069a6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1079542308 ## CI report: * 5f5a78275b36b700036ce07e4e69cf925ec069a6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1078872799 ## CI report: * 5f5a78275b36b700036ce07e4e69cf925ec069a6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot removed a comment on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079536657 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * 02c1f87d52c983eee4bf75d4b75eef3084825

[GitHub] [hudi] hudi-bot commented on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot commented on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079541607 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * 02c1f87d52c983eee4bf75d4b75eef308482568f Azur

[GitHub] [hudi] alexeykudinkin commented on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

alexeykudinkin commented on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079541327 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

XuQianJin-Stars commented on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1079540723 hi @alexeykudinkin can you continue review this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Created] (HUDI-3716) OOM occurred when use bulk_insert cow table with flink BUCKET index

Danny Chen created HUDI-3716: Summary: OOM occurred when use bulk_insert cow table with flink BUCKET index Key: HUDI-3716 URL: https://issues.apache.org/jira/browse/HUDI-3716 Project: Apache Hudi

[GitHub] [hudi] danny0405 closed issue #5132: [SUPPORT] OOM occurred when use bulk_insert cow table with flink BUCKET index

danny0405 closed issue #5132: URL: https://github.com/apache/hudi/issues/5132 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@

[GitHub] [hudi] danny0405 commented on issue #5132: [SUPPORT] OOM occurred when use bulk_insert cow table with flink BUCKET index

danny0405 commented on issue #5132: URL: https://github.com/apache/hudi/issues/5132#issuecomment-1079539012 Thanks for the report, would fix it then. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hudi] hudi-bot commented on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot commented on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079536657 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * 02c1f87d52c983eee4bf75d4b75eef308482568f Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot removed a comment on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079517263 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * 565ef8a48032deedad3397b5fda8d44c80b87

[GitHub] [hudi] hudi-bot removed a comment on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot removed a comment on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079496987 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * 565ef8a48032deedad3397b5fda8d44c80b87

[GitHub] [hudi] hudi-bot commented on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot commented on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079517263 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * 565ef8a48032deedad3397b5fda8d44c80b8759e Azur

[GitHub] [hudi] nsivabalan commented on a change in pull request #5129: [HUDI-3709] Fixing `ParquetWriter` impls not respecting Parquet Max File Size limit

nsivabalan commented on a change in pull request #5129: URL: https://github.com/apache/hudi/pull/5129#discussion_r835666707 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/action/commit/TestCopyOnWriteActionExecutor.java ## @@ -437,7 +437,7 @@ p

[GitHub] [hudi] hudi-bot removed a comment on pull request #5129: [HUDI-3709] Fixing `ParquetWriter` impls not respecting Parquet Max File Size limit

hudi-bot removed a comment on pull request #5129: URL: https://github.com/apache/hudi/pull/5129#issuecomment-1079445841 ## CI report: * f39251d5065a8c1b3510aa86ff75407e209f3992 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5129: [HUDI-3709] Fixing `ParquetWriter` impls not respecting Parquet Max File Size limit

hudi-bot commented on pull request #5129: URL: https://github.com/apache/hudi/pull/5129#issuecomment-1079498537 ## CI report: * dd1c5ba905eb898ae3fe65b900bdafec751e4e9f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot commented on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079496987 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * 565ef8a48032deedad3397b5fda8d44c80b8759e Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot removed a comment on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079495832 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * d79a96077fa8032ac7a64ea28289fab26baca

[GitHub] [hudi] hudi-bot removed a comment on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot removed a comment on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079492024 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * d79a96077fa8032ac7a64ea28289fab26baca

[GitHub] [hudi] hudi-bot commented on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot commented on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079495832 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * d79a96077fa8032ac7a64ea28289fab26baca86b Azur

[GitHub] [hudi] hudi-bot commented on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot commented on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079492024 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * d79a96077fa8032ac7a64ea28289fab26baca86b Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot removed a comment on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079460355 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * d79a96077fa8032ac7a64ea28289fab26baca

[GitHub] [hudi] yihua commented on a change in pull request #4962: [HUDI-3355] Issue with out of order commits in the timeline when ingestion writers using SparkAllowUpdateStrategy

yihua commented on a change in pull request #4962: URL: https://github.com/apache/hudi/pull/4962#discussion_r835650297 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/TransactionUtils.java ## @@ -137,4 +126,27 @@ throw new HoodieI

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079141828 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1079469064 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot removed a comment on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079458782 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * 400082cfd7f770c6878ddc80379d1f4ce2711

[GitHub] [hudi] hudi-bot commented on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot commented on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079460355 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * d79a96077fa8032ac7a64ea28289fab26baca86b Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot removed a comment on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079452078 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * 400082cfd7f770c6878ddc80379d1f4ce2711

[GitHub] [hudi] hudi-bot commented on pull request #4955: [HUDI-3549] Removing dependency on "spark-avro"

hudi-bot commented on pull request #4955: URL: https://github.com/apache/hudi/pull/4955#issuecomment-1079458782 ## CI report: * 6dbbd9e3967088c373531341453fafd3d07ef522 UNKNOWN * b5ce6517e6ff251cfd7d91e4670493eb28b713ea UNKNOWN * 400082cfd7f770c6878ddc80379d1f4ce27115f5 Azur

  1   2   3   4   >