[GitHub] [hudi] yihua closed pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
yihua closed pull request #4320: URL: https://github.com/apache/hudi/pull/4320 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4317: [WIP][Minor] Debug TestHoodieDeltaStreamerWithMultiWriter
hudi-bot commented on pull request #4317: URL: https://github.com/apache/hudi/pull/4317#issuecomment-994466956 ## CI report: * 69c02777482f14cdde476554f29de83a2518e466 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4315) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4317: [WIP][Minor] Debug TestHoodieDeltaStreamerWithMultiWriter
hudi-bot removed a comment on pull request #4317: URL: https://github.com/apache/hudi/pull/4317#issuecomment-994464104 ## CI report: * 5a0a7d71e8b51805197ec69441b8f783e4b3548b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4306) * 69c02777482f14cdde476554f29de83a2518e466 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4317: [WIP][Minor] Debug TestHoodieDeltaStreamerWithMultiWriter
hudi-bot commented on pull request #4317: URL: https://github.com/apache/hudi/pull/4317#issuecomment-994464104 ## CI report: * 5a0a7d71e8b51805197ec69441b8f783e4b3548b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4306) * 69c02777482f14cdde476554f29de83a2518e466 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4317: [WIP][Minor] Debug TestHoodieDeltaStreamerWithMultiWriter
hudi-bot removed a comment on pull request #4317: URL: https://github.com/apache/hudi/pull/4317#issuecomment-994411896 ## CI report: * 5a0a7d71e8b51805197ec69441b8f783e4b3548b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4306) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
hudi-bot commented on pull request #4320: URL: https://github.com/apache/hudi/pull/4320#issuecomment-994458382 ## CI report: * cce978a2ca4845d2a7b40b4f97522304e547dd23 UNKNOWN * Unknown: [CANCELED](TBD) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
hudi-bot removed a comment on pull request #4320: URL: https://github.com/apache/hudi/pull/4320#issuecomment-994435557 ## CI report: * cce978a2ca4845d2a7b40b4f97522304e547dd23 UNKNOWN * Unknown: [CANCELED](TBD) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
nsivabalan commented on pull request #4320: URL: https://github.com/apache/hudi/pull/4320#issuecomment-994455766 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4322: [WIP][DO_NOT_MERGE] Increasing timer for docker compose health checks
hudi-bot removed a comment on pull request #4322: URL: https://github.com/apache/hudi/pull/4322#issuecomment-994440068 ## CI report: * 23e246efede94e95ffbc727f01c4be27eade3c96 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4312) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4314) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4321: [WIP][DO_NOT_MERGE] Adding a delay to integ tests just after init
hudi-bot removed a comment on pull request #4321: URL: https://github.com/apache/hudi/pull/4321#issuecomment-994440008 ## CI report: * d441591fe0372a8561e3d08821da05bd8e26d35c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4311) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4313) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4321: [WIP][DO_NOT_MERGE] Adding a delay to integ tests just after init
hudi-bot commented on pull request #4321: URL: https://github.com/apache/hudi/pull/4321#issuecomment-99924 ## CI report: * d441591fe0372a8561e3d08821da05bd8e26d35c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4313) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4311) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4322: [WIP][DO_NOT_MERGE] Increasing timer for docker compose health checks
hudi-bot commented on pull request #4322: URL: https://github.com/apache/hudi/pull/4322#issuecomment-99950 ## CI report: * 23e246efede94e95ffbc727f01c4be27eade3c96 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4314) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4312) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4321: [WIP][DO_NOT_MERGE] Adding a delay to integ tests just after init
hudi-bot removed a comment on pull request #4321: URL: https://github.com/apache/hudi/pull/4321#issuecomment-994435586 ## CI report: * d441591fe0372a8561e3d08821da05bd8e26d35c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4322: [WIP][DO_NOT_MERGE] Increasing timer for docker compose health checks
hudi-bot commented on pull request #4322: URL: https://github.com/apache/hudi/pull/4322#issuecomment-994440068 ## CI report: * 23e246efede94e95ffbc727f01c4be27eade3c96 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4312) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4314) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4321: [WIP][DO_NOT_MERGE] Adding a delay to integ tests just after init
hudi-bot commented on pull request #4321: URL: https://github.com/apache/hudi/pull/4321#issuecomment-994440008 ## CI report: * d441591fe0372a8561e3d08821da05bd8e26d35c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4311) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4313) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4322: [WIP][DO_NOT_MERGE] Increasing timer for docker compose health checks
hudi-bot removed a comment on pull request #4322: URL: https://github.com/apache/hudi/pull/4322#issuecomment-994435611 ## CI report: * 23e246efede94e95ffbc727f01c4be27eade3c96 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
hudi-bot removed a comment on pull request #4320: URL: https://github.com/apache/hudi/pull/4320#issuecomment-994431593 ## CI report: * Unknown: [CANCELED](TBD) * cce978a2ca4845d2a7b40b4f97522304e547dd23 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4322: [WIP][DO_NOT_MERGE] Increasing timer for docker compose health checks
hudi-bot commented on pull request #4322: URL: https://github.com/apache/hudi/pull/4322#issuecomment-994435611 ## CI report: * 23e246efede94e95ffbc727f01c4be27eade3c96 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
hudi-bot commented on pull request #4320: URL: https://github.com/apache/hudi/pull/4320#issuecomment-994435557 ## CI report: * cce978a2ca4845d2a7b40b4f97522304e547dd23 UNKNOWN * Unknown: [CANCELED](TBD) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4321: [WIP][DO_NOT_MERGE] Adding a delay to integ tests just after init
hudi-bot commented on pull request #4321: URL: https://github.com/apache/hudi/pull/4321#issuecomment-994435586 ## CI report: * d441591fe0372a8561e3d08821da05bd8e26d35c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan edited a comment on pull request #4322: [WIP][DO_NOT_MERGE] Increasing timer for docker compose health checks
nsivabalan edited a comment on pull request #4322: URL: https://github.com/apache/hudi/pull/4322#issuecomment-994433050 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] zhangyue19921010 closed pull request #4317: [WIP][Minor] Expand deltaStreamer timeout in TestHoodieDeltaStreamerWithMultiWriter
zhangyue19921010 closed pull request #4317: URL: https://github.com/apache/hudi/pull/4317 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan edited a comment on pull request #4321: [WIP][DO_NOT_MERGE] Adding a delay to integ tests just after init
nsivabalan edited a comment on pull request #4321: URL: https://github.com/apache/hudi/pull/4321#issuecomment-994432644 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HUDI-3022) Fix npe for isDropPartition method
[ https://issues.apache.org/jira/browse/HUDI-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Forward Xu updated HUDI-3022: - Attachment: image-2021-12-15-15-38-42-773.png Description: Fix npe for isDropPartition method !image-2021-12-15-15-38-42-773.png! was:Fix npe for isDropPartition method > Fix npe for isDropPartition method > -- > > Key: HUDI-3022 > URL: https://issues.apache.org/jira/browse/HUDI-3022 > Project: Apache Hudi > Issue Type: Bug >Reporter: Forward Xu >Assignee: Forward Xu >Priority: Major > Labels: pull-request-available > Attachments: image-2021-12-15-15-38-42-773.png > > > Fix npe for isDropPartition method > !image-2021-12-15-15-38-42-773.png! -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [hudi] nsivabalan commented on pull request #4322: [WIP][DO_NOT_MERGE] Increasing timer for docker compose health checks
nsivabalan commented on pull request #4322: URL: https://github.com/apache/hudi/pull/4322#issuecomment-994433050 @hudi-bot azure run -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #4321: [WIP][DO_NOT_MERGE] Adding a delay to integ tests just after init
nsivabalan commented on pull request #4321: URL: https://github.com/apache/hudi/pull/4321#issuecomment-994432644 @hudi-bot azure run -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
hudi-bot commented on pull request #4320: URL: https://github.com/apache/hudi/pull/4320#issuecomment-994431593 ## CI report: * Unknown: [CANCELED](TBD) * cce978a2ca4845d2a7b40b4f97522304e547dd23 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
hudi-bot removed a comment on pull request #4320: URL: https://github.com/apache/hudi/pull/4320#issuecomment-994427611 ## CI report: * 700824580cf9c1faddd5fa8227c361462d44 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4310) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] yihua commented on pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
yihua commented on pull request #4320: URL: https://github.com/apache/hudi/pull/4320#issuecomment-994431492 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.
hudi-bot commented on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-994431355 ## CI report: * 8f8ae385baf21dacd4b9fedd3670133160001dc0 UNKNOWN * 019e161bb908731244e13cdf36d12781956f0114 UNKNOWN * 65f3ac5b054e953cf7e4eee48bc8b0e91f67be2e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4307) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.
hudi-bot removed a comment on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-994362072 ## CI report: * 8f8ae385baf21dacd4b9fedd3670133160001dc0 UNKNOWN * 019e161bb908731244e13cdf36d12781956f0114 UNKNOWN * 20a7639dd92ac0bfae83733a1ed7e553af69cea1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4046) * 65f3ac5b054e953cf7e4eee48bc8b0e91f67be2e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4307) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan opened a new pull request #4322: [WIP][DO_NOT_MERGE] Increasing timer for docker compose health checks
nsivabalan opened a new pull request #4322: URL: https://github.com/apache/hudi/pull/4322 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose of the pull request *(For example: This pull request adds quick-start document.)* ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle rule in checkstyle.xml* ## Verify this pull request *(Please pick either of the following options)* This pull request is a trivial rework / code cleanup without any test coverage. *(or)* This pull request is already covered by existing tests, such as *(please describe tests)*. (or) This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end.* - *Added HoodieClientWriteTest to verify the change.* - *Manually verified the change by running a job locally.* ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc changes done or have another open PR - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] nsivabalan opened a new pull request #4321: [WIP][DO_NOT_MERGE] Adding a delay to integ tests just after init
nsivabalan opened a new pull request #4321: URL: https://github.com/apache/hudi/pull/4321 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose of the pull request *(For example: This pull request adds quick-start document.)* ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle rule in checkstyle.xml* ## Verify this pull request *(Please pick either of the following options)* This pull request is a trivial rework / code cleanup without any test coverage. *(or)* This pull request is already covered by existing tests, such as *(please describe tests)*. (or) This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end.* - *Added HoodieClientWriteTest to verify the change.* - *Manually verified the change by running a job locally.* ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc changes done or have another open PR - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
hudi-bot commented on pull request #4320: URL: https://github.com/apache/hudi/pull/4320#issuecomment-994427611 ## CI report: * 700824580cf9c1faddd5fa8227c361462d44 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4310) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
hudi-bot removed a comment on pull request #4320: URL: https://github.com/apache/hudi/pull/4320#issuecomment-994424026 ## CI report: * 700824580cf9c1faddd5fa8227c361462d44 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
hudi-bot commented on pull request #4320: URL: https://github.com/apache/hudi/pull/4320#issuecomment-994424026 ## CI report: * 700824580cf9c1faddd5fa8227c361462d44 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] yihua opened a new pull request #4320: [DO NOT MERGE][MINOR] Add connectivity check to namenode during IT setup
yihua opened a new pull request #4320: URL: https://github.com/apache/hudi/pull/4320 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose of the pull request *(For example: This pull request adds quick-start document.)* ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle rule in checkstyle.xml* ## Verify this pull request *(Please pick either of the following options)* This pull request is a trivial rework / code cleanup without any test coverage. *(or)* This pull request is already covered by existing tests, such as *(please describe tests)*. (or) This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end.* - *Added HoodieClientWriteTest to verify the change.* - *Manually verified the change by running a job locally.* ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc changes done or have another open PR - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4282: [WIP][DO_NOT_MERGE] Enabling debug logs to investigate IT test failure
hudi-bot removed a comment on pull request #4282: URL: https://github.com/apache/hudi/pull/4282#issuecomment-994414690 ## CI report: * d0137288e20b40b17cb115c8546ae0f1036fb61d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4293) * a488562ca54332cc20ac3bfc5b4e1bbf054602f9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4282: [WIP][DO_NOT_MERGE] Enabling debug logs to investigate IT test failure
hudi-bot commented on pull request #4282: URL: https://github.com/apache/hudi/pull/4282#issuecomment-994417188 ## CI report: * d0137288e20b40b17cb115c8546ae0f1036fb61d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4293) * a488562ca54332cc20ac3bfc5b4e1bbf054602f9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4309) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4319: [HUDI-3022] Fix npe for isDropPartition method
hudi-bot commented on pull request #4319: URL: https://github.com/apache/hudi/pull/4319#issuecomment-994414805 ## CI report: * 21b562775fd5ac08614369ef33c924510113e990 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4308) * 298805a152b4b994914b570d6230a2499bf77e15 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4319: [HUDI-3022] Fix npe for isDropPartition method
hudi-bot removed a comment on pull request #4319: URL: https://github.com/apache/hudi/pull/4319#issuecomment-994411931 ## CI report: * 21b562775fd5ac08614369ef33c924510113e990 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4308) * 298805a152b4b994914b570d6230a2499bf77e15 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4282: [WIP][DO_NOT_MERGE] Enabling debug logs to investigate IT test failure
hudi-bot removed a comment on pull request #4282: URL: https://github.com/apache/hudi/pull/4282#issuecomment-994242146 ## CI report: * d0137288e20b40b17cb115c8546ae0f1036fb61d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4293) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4282: [WIP][DO_NOT_MERGE] Enabling debug logs to investigate IT test failure
hudi-bot commented on pull request #4282: URL: https://github.com/apache/hudi/pull/4282#issuecomment-994414690 ## CI report: * d0137288e20b40b17cb115c8546ae0f1036fb61d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4293) * a488562ca54332cc20ac3bfc5b4e1bbf054602f9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4317: [WIP][Minor] Expand deltaStreamer timeout in TestHoodieDeltaStreamerWithMultiWriter
hudi-bot commented on pull request #4317: URL: https://github.com/apache/hudi/pull/4317#issuecomment-994411896 ## CI report: * 5a0a7d71e8b51805197ec69441b8f783e4b3548b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4306) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4319: [HUDI-3022] Fix npe for isDropPartition method
hudi-bot commented on pull request #4319: URL: https://github.com/apache/hudi/pull/4319#issuecomment-994411931 ## CI report: * 21b562775fd5ac08614369ef33c924510113e990 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4308) * 298805a152b4b994914b570d6230a2499bf77e15 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4317: [WIP][Minor] Expand deltaStreamer timeout in TestHoodieDeltaStreamerWithMultiWriter
hudi-bot removed a comment on pull request #4317: URL: https://github.com/apache/hudi/pull/4317#issuecomment-994352060 ## CI report: * 5a0a7d71e8b51805197ec69441b8f783e4b3548b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4306) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4319: [HUDI-3022] Fix npe for isDropPartition method
hudi-bot removed a comment on pull request #4319: URL: https://github.com/apache/hudi/pull/4319#issuecomment-994408437 ## CI report: * 21b562775fd5ac08614369ef33c924510113e990 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4308) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4319: [HUDI-3022] Fix npe for isDropPartition method
hudi-bot commented on pull request #4319: URL: https://github.com/apache/hudi/pull/4319#issuecomment-994408437 ## CI report: * 21b562775fd5ac08614369ef33c924510113e990 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4308) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4319: [HUDI-3022] Fix npe for isDropPartition method
hudi-bot removed a comment on pull request #4319: URL: https://github.com/apache/hudi/pull/4319#issuecomment-994406807 ## CI report: * 21b562775fd5ac08614369ef33c924510113e990 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4319: [HUDI-3022] Fix npe for isDropPartition method
hudi-bot commented on pull request #4319: URL: https://github.com/apache/hudi/pull/4319#issuecomment-994406807 ## CI report: * 21b562775fd5ac08614369ef33c924510113e990 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4270: [HUDI-2811] Support Spark 3.2
hudi-bot removed a comment on pull request #4270: URL: https://github.com/apache/hudi/pull/4270#issuecomment-994306259 ## CI report: * 38fc71de42b6d4a73de6c5acef52b55d6a278f7d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4294) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4304) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4270: [HUDI-2811] Support Spark 3.2
hudi-bot commented on pull request #4270: URL: https://github.com/apache/hudi/pull/4270#issuecomment-994406673 ## CI report: * 38fc71de42b6d4a73de6c5acef52b55d6a278f7d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4294) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4304) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HUDI-3022) Fix npe for isDropPartition method
[ https://issues.apache.org/jira/browse/HUDI-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3022: - Labels: pull-request-available (was: ) > Fix npe for isDropPartition method > -- > > Key: HUDI-3022 > URL: https://issues.apache.org/jira/browse/HUDI-3022 > Project: Apache Hudi > Issue Type: Bug >Reporter: Forward Xu >Assignee: Forward Xu >Priority: Major > Labels: pull-request-available > > Fix npe for isDropPartition method -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [hudi] XuQianJin-Stars opened a new pull request #4319: [HUDI-3022] Fix npe for isDropPartition method
XuQianJin-Stars opened a new pull request #4319: URL: https://github.com/apache/hudi/pull/4319 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose of the pull request *(For example: This pull request adds quick-start document.)* ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle rule in checkstyle.xml* ## Verify this pull request *(Please pick either of the following options)* This pull request is a trivial rework / code cleanup without any test coverage. *(or)* This pull request is already covered by existing tests, such as *(please describe tests)*. (or) This change added tests and can be verified as follows: *(example:)* - *Added integration tests for end-to-end.* - *Added HoodieClientWriteTest to verify the change.* - *Manually verified the change by running a job locally.* ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is green - [ ] Necessary doc changes done or have another open PR - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (HUDI-3022) Fix npe for isDropPartition method
Forward Xu created HUDI-3022: Summary: Fix npe for isDropPartition method Key: HUDI-3022 URL: https://issues.apache.org/jira/browse/HUDI-3022 Project: Apache Hudi Issue Type: Bug Reporter: Forward Xu Assignee: Forward Xu Fix npe for isDropPartition method -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [hudi] stym06 opened a new issue #4318: [SUPPORT] Duplicate records in COW table withing same partition path
stym06 opened a new issue #4318: URL: https://github.com/apache/hudi/issues/4318 **Describe the problem you faced** We have written IOT data from Kafka to Azure blob using Deltastreamer utility in continuous mode and are querying the table through Presto. We are seeing duplicate records with the same _hoodie_record_key but different commit file number and different parquet file in the same partition path. ``` _hoodie_commit_time | _hoodie_commit_seqno | _hoodie_record_key| _hoodie_partition_path | _hoodie_file_name | master_timestamp | timest -+--+-++---+--+- 20211206002458 | 20211206002458_1_4116796 | vehicle_identification_number:P53ACDCB2AKA00081,timestamp:1638708846929 | dt=2021-12-05 | 5885895a-78d1-468b-9e7b-045d77644d1c-0_1-1706-2959_20211206002458.parquet | 1638708851906 | 16387088 20211206120116 | 20211206120116_1_1745292 | vehicle_identification_number:P53ACDCB2AKA00081,timestamp:1638708846929 | dt=2021-12-05 | df619ce7-cd21-41fc-9e6b-68386748bde4-0_1-470-1174_20211206120116.parquet | 1638708851906 | 1638708 ``` **Environment Description** * Hudi version : 0.9.0 * Spark version : 2.4.4 * Hive version : 3.1.2 * Hadoop version : 3.1.2 * Storage (HDFS/S3/GCS..) : Azure Blob * Running on Docker? (yes/no) : K8s -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] Arun-kc closed issue #4267: [SUPPORT] Hudi partition values not getting reflected in Athena
Arun-kc closed issue #4267: URL: https://github.com/apache/hudi/issues/4267 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] Arun-kc commented on issue #4267: [SUPPORT] Hudi partition values not getting reflected in Athena
Arun-kc commented on issue #4267: URL: https://github.com/apache/hudi/issues/4267#issuecomment-994400248 Hi @Carl-Zhou-CN and @nikita-sheremet-clearscale I tried the same with hudi connector version `0.9.0` and it's working fine now. The partition is getting reflected in Athena. Seems the problem was with the hudi connector version `0.5.1`. Thanks for the help both of you I'm closing this issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.
zhangyue19921010 commented on a change in pull request #4078:
URL: https://github.com/apache/hudi/pull/4078#discussion_r769306591
##
File path:
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java
##
@@ -183,6 +217,24 @@ public void testArchiveTableWithArchival(boolean
enableMetadata) throws Exceptio
}
}
+ @ParameterizedTest
+ @MethodSource("testArchiveTableWithArchivalCleanUp")
+ public void testArchiveTableWithArchivalCleanUp(boolean enableMetadata,
boolean enableArchiveClean, int archiveFilesToKeep) throws Exception {
+HoodieWriteConfig writeConfig =
initTestTableAndGetWriteConfig(enableMetadata, 2, 3, 2, enableArchiveClean,
archiveFilesToKeep);
+for (int i = 1; i < 10; i++) {
+ testTable.doWriteOperation("000" + i, WriteOperationType.UPSERT, i
== 1 ? Arrays.asList("p1", "p2") : Collections.emptyList(), Arrays.asList("p1",
"p2"), 2);
+ // trigger archival
+ archiveAndGetCommitsList(writeConfig);
+}
+String archivePath = metaClient.getArchivePath();
+RemoteIterator iter = metaClient.getFs().listFiles(new
Path(archivePath), false);
+ArrayList files = new ArrayList<>();
+while (iter.hasNext()) {
+ files.add(iter.next());
+}
+assertEquals(archiveFilesToKeep, files.size());
Review comment:
Changed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.
zhangyue19921010 commented on a change in pull request #4078:
URL: https://github.com/apache/hudi/pull/4078#discussion_r769306460
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieCompactionConfig.java
##
@@ -249,6 +249,18 @@
+ "record size estimate compute dynamically based on commit
metadata. "
+ " This is critical in computing the insert parallelism and
bin-packing inserts into small files.");
+ public static final ConfigProperty ARCHIVE_FILES_TO_KEEP_PROP =
ConfigProperty
+ .key("hoodie.keep.archive.files")
+ .defaultValue("10")
+ .withDocumentation("The numbers of kept archive files under archived");
+
+ public static final ConfigProperty CLEAN_ARCHIVE_FILE_ENABLE_DROP =
ConfigProperty
+ .key("hoodie.archive.clean.enable")
Review comment:
Tanks for your review. Changed as `hoodie.auto.trim.archive.files` and
`hoodie.max.archive.files`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Updated] (HUDI-3021) HoodieAppendHandle#appendDataAndDeleteBlocks writer object occurred NPE
[ https://issues.apache.org/jira/browse/HUDI-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WangMinChao updated HUDI-3021: -- Affects Version/s: 0.10.0 > HoodieAppendHandle#appendDataAndDeleteBlocks writer object occurred NPE > --- > > Key: HUDI-3021 > URL: https://issues.apache.org/jira/browse/HUDI-3021 > Project: Apache Hudi > Issue Type: Bug > Components: CLI, Common Core >Affects Versions: 0.10.0 >Reporter: WangMinChao >Priority: Major > Attachments: image-2021-12-15-14-47-07-756.png, > image-2021-12-15-14-47-20-965.png > > > !image-2021-12-15-14-47-20-965.png!!image-2021-12-15-14-47-07-756.png! -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (HUDI-3021) HoodieAppendHandle#appendDataAndDeleteBlocks writer object occurred NPE
[ https://issues.apache.org/jira/browse/HUDI-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WangMinChao updated HUDI-3021: -- Component/s: Flink Integration > HoodieAppendHandle#appendDataAndDeleteBlocks writer object occurred NPE > --- > > Key: HUDI-3021 > URL: https://issues.apache.org/jira/browse/HUDI-3021 > Project: Apache Hudi > Issue Type: Bug > Components: CLI, Common Core, Flink Integration >Affects Versions: 0.10.0 >Reporter: WangMinChao >Priority: Major > Attachments: image-2021-12-15-14-47-07-756.png, > image-2021-12-15-14-47-20-965.png > > > !image-2021-12-15-14-47-20-965.png!!image-2021-12-15-14-47-07-756.png! -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (HUDI-3021) HoodieAppendHandle#appendDataAndDeleteBlocks writer object occurred NPE
WangMinChao created HUDI-3021: - Summary: HoodieAppendHandle#appendDataAndDeleteBlocks writer object occurred NPE Key: HUDI-3021 URL: https://issues.apache.org/jira/browse/HUDI-3021 Project: Apache Hudi Issue Type: Bug Components: CLI, Common Core Reporter: WangMinChao Attachments: image-2021-12-15-14-47-07-756.png, image-2021-12-15-14-47-20-965.png !image-2021-12-15-14-47-20-965.png!!image-2021-12-15-14-47-07-756.png! -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [hudi] danny0405 commented on pull request #4291: [HUDI-2990] Sync to HMS when deleting partitions
danny0405 commented on pull request #4291: URL: https://github.com/apache/hudi/pull/4291#issuecomment-994377572  User reported an NPE here, please check again ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4312: [DO NOT MERGE][MINOR] Increase timeouts for IT tests
hudi-bot removed a comment on pull request #4312: URL: https://github.com/apache/hudi/pull/4312#issuecomment-994288684 ## CI report: * 56793e5125f74bdb96bfe5472b1383fd836ac57c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4296) * c8e5438b7096a2bd1337cf56b86df6e142f1a5a7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4302) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4312: [DO NOT MERGE][MINOR] Increase timeouts for IT tests
hudi-bot commented on pull request #4312: URL: https://github.com/apache/hudi/pull/4312#issuecomment-994369009 ## CI report: * c8e5438b7096a2bd1337cf56b86df6e142f1a5a7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4302) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.
hudi-bot removed a comment on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-994313754 ## CI report: * 8f8ae385baf21dacd4b9fedd3670133160001dc0 UNKNOWN * 019e161bb908731244e13cdf36d12781956f0114 UNKNOWN * 20a7639dd92ac0bfae83733a1ed7e553af69cea1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4046) * 65f3ac5b054e953cf7e4eee48bc8b0e91f67be2e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.
hudi-bot commented on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-994362072 ## CI report: * 8f8ae385baf21dacd4b9fedd3670133160001dc0 UNKNOWN * 019e161bb908731244e13cdf36d12781956f0114 UNKNOWN * 20a7639dd92ac0bfae83733a1ed7e553af69cea1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4046) * 65f3ac5b054e953cf7e4eee48bc8b0e91f67be2e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4307) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4316: DONT MERGE - PR for testing
hudi-bot removed a comment on pull request #4316: URL: https://github.com/apache/hudi/pull/4316#issuecomment-994318808 ## CI report: * c5bfd8cd3e7185e751ed9bbef9408ed7cddb7424 UNKNOWN * Unknown: [CANCELED](TBD) * a1af791bcb19f2773108fc127d9b239537306dcf Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4305) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4316: DONT MERGE - PR for testing
hudi-bot commented on pull request #4316: URL: https://github.com/apache/hudi/pull/4316#issuecomment-994357986 ## CI report: * c5bfd8cd3e7185e751ed9bbef9408ed7cddb7424 UNKNOWN * a1af791bcb19f2773108fc127d9b239537306dcf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4305) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4317: [WIP][Minor] Expand deltaStreamer timeout in TestHoodieDeltaStreamerWithMultiWriter
hudi-bot commented on pull request #4317: URL: https://github.com/apache/hudi/pull/4317#issuecomment-994352060 ## CI report: * 5a0a7d71e8b51805197ec69441b8f783e4b3548b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4306) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4317: [WIP][Minor] Expand deltaStreamer timeout in TestHoodieDeltaStreamerWithMultiWriter
hudi-bot removed a comment on pull request #4317: URL: https://github.com/apache/hudi/pull/4317#issuecomment-994346369 ## CI report: * 5a0a7d71e8b51805197ec69441b8f783e4b3548b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4317: [WIP][Minor] Expand deltaStreamer timeout in TestHoodieDeltaStreamerWithMultiWriter
hudi-bot commented on pull request #4317: URL: https://github.com/apache/hudi/pull/4317#issuecomment-994346369 ## CI report: * 5a0a7d71e8b51805197ec69441b8f783e4b3548b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4315: [DO NOT MERGE][MINOR] Add first few lines of setupDemo() to ITHoodieSanity
hudi-bot removed a comment on pull request #4315: URL: https://github.com/apache/hudi/pull/4315#issuecomment-994286678 ## CI report: * 68112b8331f8daa1553ca2b811c3760053122678 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4301) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4315: [DO NOT MERGE][MINOR] Add first few lines of setupDemo() to ITHoodieSanity
hudi-bot commented on pull request #4315: URL: https://github.com/apache/hudi/pull/4315#issuecomment-994341781 ## CI report: * 68112b8331f8daa1553ca2b811c3760053122678 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4301) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] zhangyue19921010 opened a new pull request #4317: [WIP] Expand deltaStreamer timeout in TestHoodieDeltaStreamerWithMultiWriter
zhangyue19921010 opened a new pull request #4317:
URL: https://github.com/apache/hudi/pull/4317
## What is the purpose of the pull request
it looks like the UT test `testLatestCheckpointCarryOverWithMultipleWriters
` in `UT FT clients & cli & utilities & sync/hive-sync` is also a little bit
unstable recently.
```
[ERROR] HoodieTableType).[1]
COPY_ON_WRITE(testLatestCheckpointCarryOverWithMultipleWriters Time elapsed:
7.455 s <<< ERROR!
```
Such as
```
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4287=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4291=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4287=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4284=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4283=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4281=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4279=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4300=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
```
etc...
## Brief change log
*(for example:)*
- *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
## Verify this pull request
*(Please pick either of the following options)*
This pull request is a trivial rework / code cleanup without any test
coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please
describe tests)*.
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on pull request #3386: [HUDI-2270] Remove corrupted clean action
yuzhaojing commented on pull request #3386: URL: https://github.com/apache/hudi/pull/3386#issuecomment-994327630 > might be a duplicate of #4016. Or do you want to keep it separate from the other patch. I am ok either ways. Can we please write some UTs if we plan to go ahead with the patch. If #4016 can fix the exception, this patch is unnecessary. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] zhangyue19921010 edited a comment on pull request #4313: [DO NOT MERGE][MINOR] Disable ITTestHoodieSanity
zhangyue19921010 edited a comment on pull request #4313:
URL: https://github.com/apache/hudi/pull/4313#issuecomment-994321634
By the way, it looks like the UT test
`testLatestCheckpointCarryOverWithMultipleWriters ` in `UT FT clients & cli &
utilities & sync/hive-sync` is also a little bit unstable recently.
```
[ERROR] HoodieTableType).[1]
COPY_ON_WRITE(testLatestCheckpointCarryOverWithMultipleWriters Time elapsed:
7.455 s <<< ERROR!
```
Such as
```
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4287=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4291=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4287=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4284=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4283=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4281=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4279=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4300=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
```
etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hudi] zhangyue19921010 commented on pull request #4313: [DO NOT MERGE][MINOR] Disable ITTestHoodieSanity
zhangyue19921010 commented on pull request #4313:
URL: https://github.com/apache/hudi/pull/4313#issuecomment-994321634
By the way, it looks like the UT test
`testLatestCheckpointCarryOverWithMultipleWriters ` in ·UT FT clients & cli &
utilities & sync/hive-sync` is also a little bit unstable recently.
```
[ERROR] HoodieTableType).[1]
COPY_ON_WRITE(testLatestCheckpointCarryOverWithMultipleWriters Time elapsed:
7.455 s <<< ERROR!
```
Such as
```
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4287=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4291=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4287=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4284=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4283=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4281=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4279=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4300=logs=b1544eb9-7ff1-5db9-0187-3e05abf459bc=0ec7e803-cfc6-5180-f2a9-ea971f54ee54
```
etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4316: DONT MERGE - PR for testing
hudi-bot removed a comment on pull request #4316: URL: https://github.com/apache/hudi/pull/4316#issuecomment-994309620 ## CI report: * c5bfd8cd3e7185e751ed9bbef9408ed7cddb7424 UNKNOWN * a1af791bcb19f2773108fc127d9b239537306dcf UNKNOWN * Unknown: [CANCELED](TBD) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4316: DONT MERGE - PR for testing
hudi-bot commented on pull request #4316: URL: https://github.com/apache/hudi/pull/4316#issuecomment-994318808 ## CI report: * c5bfd8cd3e7185e751ed9bbef9408ed7cddb7424 UNKNOWN * Unknown: [CANCELED](TBD) * a1af791bcb19f2773108fc127d9b239537306dcf Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4305) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.
hudi-bot removed a comment on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-986575745 ## CI report: * 8f8ae385baf21dacd4b9fedd3670133160001dc0 UNKNOWN * 019e161bb908731244e13cdf36d12781956f0114 UNKNOWN * 20a7639dd92ac0bfae83733a1ed7e553af69cea1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4046) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.
hudi-bot commented on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-994313754 ## CI report: * 8f8ae385baf21dacd4b9fedd3670133160001dc0 UNKNOWN * 019e161bb908731244e13cdf36d12781956f0114 UNKNOWN * 20a7639dd92ac0bfae83733a1ed7e553af69cea1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4046) * 65f3ac5b054e953cf7e4eee48bc8b0e91f67be2e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4314: [DO NOT MERGE][MINOR] Remove HDFS safemode wait in ITTestHoodieDemo
hudi-bot removed a comment on pull request #4314: URL: https://github.com/apache/hudi/pull/4314#issuecomment-994277949 ## CI report: * d63f7a106533a5307056674fd77f0b839484d506 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4300) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4314: [DO NOT MERGE][MINOR] Remove HDFS safemode wait in ITTestHoodieDemo
hudi-bot commented on pull request #4314: URL: https://github.com/apache/hudi/pull/4314#issuecomment-994310650 ## CI report: * d63f7a106533a5307056674fd77f0b839484d506 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4300) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4316: DONT MERGE - PR for testing
hudi-bot removed a comment on pull request #4316: URL: https://github.com/apache/hudi/pull/4316#issuecomment-994306374 ## CI report: * c5bfd8cd3e7185e751ed9bbef9408ed7cddb7424 UNKNOWN * a1af791bcb19f2773108fc127d9b239537306dcf UNKNOWN * Unknown: [CANCELED](TBD) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4316: DONT MERGE - PR for testing
hudi-bot commented on pull request #4316: URL: https://github.com/apache/hudi/pull/4316#issuecomment-994309620 ## CI report: * c5bfd8cd3e7185e751ed9bbef9408ed7cddb7424 UNKNOWN * a1af791bcb19f2773108fc127d9b239537306dcf UNKNOWN * Unknown: [CANCELED](TBD) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] data-storyteller commented on pull request #4316: DONT MERGE - PR for testing
data-storyteller commented on pull request #4316: URL: https://github.com/apache/hudi/pull/4316#issuecomment-994309282 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4313: [DO NOT MERGE][MINOR] Disable ITTestHoodieSanity
hudi-bot removed a comment on pull request #4313: URL: https://github.com/apache/hudi/pull/4313#issuecomment-994276684 ## CI report: * 88759fe78f99e9aa6c50d1fb0116bfae5dd583f4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4299) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4313: [DO NOT MERGE][MINOR] Disable ITTestHoodieSanity
hudi-bot commented on pull request #4313: URL: https://github.com/apache/hudi/pull/4313#issuecomment-994308503 ## CI report: * 88759fe78f99e9aa6c50d1fb0116bfae5dd583f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4299) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (HUDI-3020) Create a utility to generate mainfest file
Vinoth Govindarajan created HUDI-3020: - Summary: Create a utility to generate mainfest file Key: HUDI-3020 URL: https://issues.apache.org/jira/browse/HUDI-3020 Project: Apache Hudi Issue Type: Sub-task Reporter: Vinoth Govindarajan Assignee: Vinoth Govindarajan Create a utility to generate manifest file which contains the latest snapshot files for each partition in a CSV format with only one column filename. This is the first step towards integrating hudi with snowflake. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[GitHub] [hudi] hudi-bot commented on pull request #4316: DONT MERGE - PR for testing
hudi-bot commented on pull request #4316: URL: https://github.com/apache/hudi/pull/4316#issuecomment-994306374 ## CI report: * c5bfd8cd3e7185e751ed9bbef9408ed7cddb7424 UNKNOWN * a1af791bcb19f2773108fc127d9b239537306dcf UNKNOWN * Unknown: [CANCELED](TBD) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4316: DONT MERGE - PR for testing
hudi-bot removed a comment on pull request #4316: URL: https://github.com/apache/hudi/pull/4316#issuecomment-994305305 ## CI report: * c5bfd8cd3e7185e751ed9bbef9408ed7cddb7424 UNKNOWN * Unknown: [CANCELED](TBD) * a1af791bcb19f2773108fc127d9b239537306dcf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4270: [HUDI-2811] Support Spark 3.2
hudi-bot removed a comment on pull request #4270: URL: https://github.com/apache/hudi/pull/4270#issuecomment-994267609 ## CI report: * 38fc71de42b6d4a73de6c5acef52b55d6a278f7d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4294) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4270: [HUDI-2811] Support Spark 3.2
hudi-bot commented on pull request #4270: URL: https://github.com/apache/hudi/pull/4270#issuecomment-994306259 ## CI report: * 38fc71de42b6d4a73de6c5acef52b55d6a278f7d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4294) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=4304) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] YannByron commented on pull request #4270: [HUDI-2811] Support Spark 3.2
YannByron commented on pull request #4270: URL: https://github.com/apache/hudi/pull/4270#issuecomment-994305713 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #4316: DONT MERGE - PR for testing
hudi-bot removed a comment on pull request #4316: URL: https://github.com/apache/hudi/pull/4316#issuecomment-994290541 ## CI report: * c5bfd8cd3e7185e751ed9bbef9408ed7cddb7424 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #4316: DONT MERGE - PR for testing
hudi-bot commented on pull request #4316: URL: https://github.com/apache/hudi/pull/4316#issuecomment-994305305 ## CI report: * c5bfd8cd3e7185e751ed9bbef9408ed7cddb7424 UNKNOWN * Unknown: [CANCELED](TBD) * a1af791bcb19f2773108fc127d9b239537306dcf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] data-storyteller commented on pull request #4316: DONT MERGE - PR for testing
data-storyteller commented on pull request #4316: URL: https://github.com/apache/hudi/pull/4316#issuecomment-994305063 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HUDI-2832) [Umbrella] [RFC-40] Implement SnowflakeSyncTool to support Hudi to Snowflake Integration
[ https://issues.apache.org/jira/browse/HUDI-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Govindarajan updated HUDI-2832: -- Status: In Progress (was: Open) > [Umbrella] [RFC-40] Implement SnowflakeSyncTool to support Hudi to Snowflake > Integration > > > Key: HUDI-2832 > URL: https://issues.apache.org/jira/browse/HUDI-2832 > Project: Apache Hudi > Issue Type: New Feature > Components: Common Core >Reporter: Vinoth Govindarajan >Assignee: Vinoth Govindarajan >Priority: Major > Labels: BigQuery, Integration, pull-request-available > Fix For: 0.11.0 > > > Snowflake is a fully managed service that’s simple to use but can power a > near-unlimited number of concurrent workloads. Snowflake is a solution for > data warehousing, data lakes, data engineering, data science, data > application development, and securely sharing and consuming shared data. > Snowflake [doesn’t > support|https://docs.snowflake.com/en/sql-reference/sql/alter-file-format.html] > Apache Hudi file format yet, but it has support for Parquet, ORC, and Delta > file format. This proposal is to implement a SnowflakeSync similar to > HiveSync to sync the Hudi table as the Snowflake External Parquet table so > that users can query the Hudi tables using Snowflake. Many users have > expressed interest in Hudi and other support channels asking to integrate > Hudi with Snowflake, this will unlock new use cases for Hudi. -- This message was sent by Atlassian Jira (v8.20.1#820001)
