[jira] [Commented] (HUDI-3676) Enhance tests for triggering clean every Nth commit

2022-03-23 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511617#comment-17511617 ] Pratyaksh Sharma commented on HUDI-3676: [~xushiyan] There is no PR right now, I w

[GitHub] [hudi] boneanxs edited a comment on issue #5107: [SUPPORT] High performance costs of AvroSerializer in Datasource writing

2022-03-23 Thread GitBox
boneanxs edited a comment on issue #5107: URL: https://github.com/apache/hudi/issues/5107#issuecomment-1077280474 Yes, I also notice `AvroSerializer` is a very time consuming method(clustering's poor performance also because of this, it needs to serialize to avro twice), I'm afraid it is n

[GitHub] [hudi] boneanxs commented on issue #5107: [SUPPORT] High performance costs of AvroSerializer in Datasource writing

2022-03-23 Thread GitBox
boneanxs commented on issue #5107: URL: https://github.com/apache/hudi/issues/5107#issuecomment-1077280474 Yes, I also notice `AvroSerializer` is a very time consuming method(clustering's poor performance also because of this, it needs to serialize to avro twice), I don't think it is easy

[GitHub] [hudi] danny0405 commented on issue #5116: [SUPPORT] Does bulk_insert Support BUCKET index ?

2022-03-23 Thread GitBox
danny0405 commented on issue #5116: URL: https://github.com/apache/hudi/issues/5116#issuecomment-1077279160 It is not supported yet, let me fire a JIRA issue to support it: https://issues.apache.org/jira/browse/HUDI-3701 -- This is an automated message from the Apache Git Service. To res

[GitHub] [hudi] danny0405 closed issue #5116: [SUPPORT] Does bulk_insert Support BUCKET index ?

2022-03-23 Thread GitBox
danny0405 closed issue #5116: URL: https://github.com/apache/hudi/issues/5116 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@

[jira] [Created] (HUDI-3701) Flink bulk_insert support bucket hash index

2022-03-23 Thread Danny Chen (Jira)
Danny Chen created HUDI-3701: Summary: Flink bulk_insert support bucket hash index Key: HUDI-3701 URL: https://issues.apache.org/jira/browse/HUDI-3701 Project: Apache Hudi Issue Type: Improvement

[GitHub] [hudi] hudi-bot removed a comment on pull request #5088: [HUDI-3678] Fix record rewrite of create handle when 'preserveMetadat…

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #5088: URL: https://github.com/apache/hudi/pull/5088#issuecomment-1077168542 ## CI report: * 1f4b599f08cc4fe7fccb7804eb91b6af41159695 UNKNOWN * ab52e9ff8bd58125727fbd1d5ddb0a89b6077d52 Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #5088: [HUDI-3678] Fix record rewrite of create handle when 'preserveMetadat…

2022-03-23 Thread GitBox
hudi-bot commented on pull request #5088: URL: https://github.com/apache/hudi/pull/5088#issuecomment-1077274253 ## CI report: * 1f4b599f08cc4fe7fccb7804eb91b6af41159695 UNKNOWN * 8d10979aaddaa7c3370d895cfb88a405e6000a15 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[hudi] branch master updated (52f0498 -> a1c42fc)

2022-03-23 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 52f0498 Fixing non partitioned all files record in MDT (#5108) add a1c42fc [minor] Checks the data block type

[GitHub] [hudi] danny0405 merged pull request #5106: [minor] Checks the data block type for archived timeline

2022-03-23 Thread GitBox
danny0405 merged pull request #5106: URL: https://github.com/apache/hudi/pull/5106 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [hudi] danny0405 commented on pull request #5106: [minor] Checks the data block type for archived timeline

2022-03-23 Thread GitBox
danny0405 commented on pull request #5106: URL: https://github.com/apache/hudi/pull/5106#issuecomment-1077267608 The CI failure has no relationship with this PR so i would just merge it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] Guanpx opened a new issue #5116: [SUPPORT] Does bulk_insert Support BUCKET index ?

2022-03-23 Thread GitBox
Guanpx opened a new issue #5116: URL: https://github.com/apache/hudi/issues/5116 **Describe the problem you faced** BUCKET index upsert and bulk_insert does not compatible or bulk_insert does not Support BUCKET index **To Reproduce** Steps to reproduce the behavior:

[GitHub] [hudi] hudi-bot removed a comment on pull request #5104: [WIP] Different CI fixes - for verification only

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077262040 ## CI report: * c3577736f121bf544f2f24e6f6af12cfbb4dbf72 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5104: [WIP] Different CI fixes - for verification only

2022-03-23 Thread GitBox
hudi-bot commented on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077263500 ## CI report: * c3577736f121bf544f2f24e6f6af12cfbb4dbf72 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #5104: [WIP] Different CI fixes - for verification only

2022-03-23 Thread GitBox
hudi-bot commented on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077262040 ## CI report: * c3577736f121bf544f2f24e6f6af12cfbb4dbf72 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] Guanpx closed issue #5061: [SUPPORT] [BUG] BUCKET Index with Flink 1.14 + Hudi 0.11 (master)

2022-03-23 Thread GitBox
Guanpx closed issue #5061: URL: https://github.com/apache/hudi/issues/5061 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hud

[GitHub] [hudi] hudi-bot removed a comment on pull request #5104: [WIP] Different CI fixes - for verification only

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077259139 ## CI report: * c3577736f121bf544f2f24e6f6af12cfbb4dbf72 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] Guanpx commented on issue #5081: [SUPPORT] flink hudi produce parquet file size more than 128M

2022-03-23 Thread GitBox
Guanpx commented on issue #5081: URL: https://github.com/apache/hudi/issues/5081#issuecomment-1077261639 set write.parquet.max.file.size = 100M, that is an approximate number -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [hudi] hudi-bot commented on pull request #5115: [HUDI-3693]error will be occured when writing data into hudi using flink job more than once in same flink session

2022-03-23 Thread GitBox
hudi-bot commented on pull request #5115: URL: https://github.com/apache/hudi/pull/5115#issuecomment-1077259357 ## CI report: * 73e20318935ea2f2d1a090051a03fc2d5c307376 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5104: [WIP] Different CI fixes - for verification only

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077049521 ## CI report: * 762e2e525c84b54852ef5c5940a225827f7bd208 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #5115: [HUDI-3693]error will be occured when writing data into hudi using flink job more than once in same flink session

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #5115: URL: https://github.com/apache/hudi/pull/5115#issuecomment-1077251558 ## CI report: * 73e20318935ea2f2d1a090051a03fc2d5c307376 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #5104: [WIP] Different CI fixes - for verification only

2022-03-23 Thread GitBox
hudi-bot commented on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077259139 ## CI report: * c3577736f121bf544f2f24e6f6af12cfbb4dbf72 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3698) Follow up on DeltaStreamer CI issues

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3698: - Epic Link: HUDI-1248 > Follow up on DeltaStreamer CI issues > > >

[jira] [Updated] (HUDI-664) Reduce noisy logs in all test cases

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-664: Description: {quote}  Our test logs are very noisy — there are a lot of NPEs, ConnectException, etc which d

[GitHub] [hudi] hudi-bot commented on pull request #5115: [HUDI-3693]error will be occured when writing data into hudi using flink job more than once in same flink session

2022-03-23 Thread GitBox
hudi-bot commented on pull request #5115: URL: https://github.com/apache/hudi/pull/5115#issuecomment-1077251558 ## CI report: * 73e20318935ea2f2d1a090051a03fc2d5c307376 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Updated] (HUDI-664) Reduce noisy logs in all test cases

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-664: Description: {quote}Our test logs are very noisy — there are a lot of NPEs, ConnectException, etc which don’

[jira] [Updated] (HUDI-664) Reduce noisy logs in all test cases

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-664: Summary: Reduce noisy logs in all test cases (was: Adjust Logging levels to reduce verbose log msgs in hudi-

[jira] [Updated] (HUDI-154) Enable Rollback case in HoodieRealtimeRecordReaderTest.testReader

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-154: Component/s: tests-ci Epic Link: HUDI-1248 > Enable Rollback case in HoodieRealtimeRecordReaderTest.tes

[jira] [Updated] (HUDI-3693) error will be occured when writing data into hudi using flink job more than once in same flink session

2022-03-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3693: - Labels: pull-request-available (was: ) > error will be occured when writing data into hudi using

[GitHub] [hudi] stgztsw opened a new pull request #5115: [HUDI-3693]error will be occured when writing data into hudi using flink job more than once in same flink session

2022-03-23 Thread GitBox
stgztsw opened a new pull request #5115: URL: https://github.com/apache/hudi/pull/5115 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose

[jira] [Updated] (HUDI-1245) Make debugging Integ tests easier

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1245: - Epic Link: HUDI-1248 > Make debugging Integ tests easier > - > >

[jira] [Updated] (HUDI-541) Replace variables/comments named "data files" to "base file"

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-541: Component/s: dev-experience Epic Link: HUDI-1248 > Replace variables/comments named "data files" to "ba

[jira] [Updated] (HUDI-1245) Make debugging Integ tests easier

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1245: - Component/s: tests-ci > Make debugging Integ tests easier > - > >

[jira] [Assigned] (HUDI-1248) [UMBRELLA] Tests cleanup and fixes

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1248: Assignee: Raymond Xu (was: Raymond Xu) > [UMBRELLA] Tests cleanup and fixes >

[jira] [Updated] (HUDI-1619) Add tests to Multitable delta streamer for more sources and mix of diff sources

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1619: - Labels: (was: newbie) > Add tests to Multitable delta streamer for more sources and mix of diff > sourc

[jira] [Updated] (HUDI-1619) Add tests to Multitable delta streamer for more sources and mix of diff sources

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1619: - Component/s: tests-ci Epic Link: HUDI-1248 > Add tests to Multitable delta streamer for more sources

[jira] [Updated] (HUDI-1619) Add tests to Multitable delta streamer for more sources and mix of diff sources

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1619: - Issue Type: Test (was: Improvement) > Add tests to Multitable delta streamer for more sources and mix of

[jira] [Updated] (HUDI-1574) Trim existing unit tests to finish in much shorter amount of time

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1574: - Fix Version/s: 0.12.0 (was: 0.11.0) > Trim existing unit tests to finish in much sh

[jira] [Updated] (HUDI-1574) Trim existing unit tests to finish in much shorter amount of time

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1574: - Component/s: tests-ci Epic Link: HUDI-1248 Description: spark-client-tests 278.165 s - in o

[jira] [Commented] (HUDI-3676) Enhance tests for triggering clean every Nth commit

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511598#comment-17511598 ] Raymond Xu commented on HUDI-3676: -- [~pratyakshsharma] are we able to make it in 0.11? is

[jira] [Updated] (HUDI-2554) Fix some flaky metadata tests

2022-03-23 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2554: Epic Link: HUDI-1292 > Fix some flaky metadata tests > - > > Key

[jira] [Updated] (HUDI-3676) Enhance tests for triggering clean every Nth commit

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3676: - Issue Type: Improvement (was: Task) > Enhance tests for triggering clean every Nth commit >

[jira] [Updated] (HUDI-3676) Enhance tests for triggering clean every Nth commit

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3676: - Component/s: tests-ci > Enhance tests for triggering clean every Nth commit > ---

[jira] [Updated] (HUDI-347) Fix TestHoodieClientOnCopyOnWriteStorage Tests with modular private methods

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-347: Component/s: tests-ci Epic Link: HUDI-1248 > Fix TestHoodieClientOnCopyOnWriteStorage Tests with modula

[jira] [Closed] (HUDI-998) Introduce a robot to build testing website automatically

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-998. --- Resolution: Won't Do > Introduce a robot to build testing website automatically > -

[jira] [Updated] (HUDI-347) Fix TestHoodieClientOnCopyOnWriteStorage Tests with modular private methods

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-347: Issue Type: Test (was: Improvement) > Fix TestHoodieClientOnCopyOnWriteStorage Tests with modular private me

[jira] [Updated] (HUDI-1669) Add tests for checking candidate instants to rollback

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1669: - Component/s: tests-ci > Add tests for checking candidate instants to rollback > -

[jira] [Updated] (HUDI-1669) Add tests for checking candidate instants to rollback

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1669: - Issue Type: Test (was: Improvement) > Add tests for checking candidate instants to rollback > --

[GitHub] [hudi] hudi-bot removed a comment on pull request #5097: [WIP] Fixing master

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #5097: URL: https://github.com/apache/hudi/pull/5097#issuecomment-1077045093 ## CI report: * 7f8a8b5f6987fa33df7444e232ac55c08fb1df9b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5097: [WIP] Fixing master

2022-03-23 Thread GitBox
hudi-bot commented on pull request #5097: URL: https://github.com/apache/hudi/pull/5097#issuecomment-1077228651 ## CI report: * 7a6145b920389362fafcd621db0f60ede1d5ec5c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-1686) Source Ordering field breaks Tests in TestHoodieTestSuiteJob

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1686: - Component/s: tests-ci Epic Link: HUDI-1248 > Source Ordering field breaks Tests in TestHoodieTestSui

[jira] [Updated] (HUDI-1610) Add more tests to TestCOWDataSource for TimestampbasedKeyGen

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1610: - Issue Type: Test (was: Task) > Add more tests to TestCOWDataSource for TimestampbasedKeyGen > ---

[jira] [Updated] (HUDI-1610) Add more tests to TestCOWDataSource for TimestampbasedKeyGen

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1610: - Epic Link: HUDI-1248 > Add more tests to TestCOWDataSource for TimestampbasedKeyGen >

[jira] [Updated] (HUDI-857) Overhaul unit-tests for Cleaner and ROllbacks

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-857: Component/s: tests-ci Epic Link: HUDI-1248 > Overhaul unit-tests for Cleaner and ROllbacks > --

[jira] [Updated] (HUDI-2393) Add yamls for large scale testing

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2393: - Component/s: tests-ci Epic Link: HUDI-1236 > Add yamls for large scale testing > ---

[jira] [Closed] (HUDI-487) Unit tests for hudi-cli

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-487. --- Resolution: Done > Unit tests for hudi-cli > --- > > Key: HUDI-487 >

[jira] [Updated] (HUDI-2554) Fix some flaky metadata tests

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2554: - Priority: Blocker (was: Major) > Fix some flaky metadata tests > - > >

[jira] [Updated] (HUDI-2554) Fix some flaky metadata tests

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2554: - Fix Version/s: 0.11.0 > Fix some flaky metadata tests > - > >

[jira] [Assigned] (HUDI-2554) Fix some flaky metadata tests

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2554: Assignee: Ethan Guo (was: sivabalan narayanan) > Fix some flaky metadata tests > -

[jira] [Updated] (HUDI-323) Docker demo/integ-test stdout/stderr output only available on process exit

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-323: Component/s: tests-ci Epic Link: HUDI-1248 > Docker demo/integ-test stdout/stderr output only available

[jira] [Updated] (HUDI-2897) Integ test suite with S3 having issues while reading

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2897: - Component/s: tests-ci Epic Link: HUDI-1248 > Integ test suite with S3 having issues while reading >

[jira] [Updated] (HUDI-2188) Improve test for the insert_overwrite and insert_overwrite_table in hoodieDeltaStreamer

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2188: - Component/s: tests-ci Epic Link: HUDI-1248 > Improve test for the insert_overwrite and insert_overwr

[jira] [Updated] (HUDI-3685) CI is failing consistently w/ 2 test failures

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3685: - Epic Link: HUDI-1248 > CI is failing consistently w/ 2 test failures > ---

[jira] [Updated] (HUDI-3604) Missing to apply rollback commits to Metadata table if rollback failed mid-way

2022-03-23 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3604: Status: Patch Available (was: In Progress) > Missing to apply rollback commits to Metadata table if rollbac

[jira] [Updated] (HUDI-3685) CI is failing consistently w/ 2 test failures

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3685: - Issue Type: Test (was: Task) > CI is failing consistently w/ 2 test failures > --

[jira] [Updated] (HUDI-1229) Enable Integration test with HFile base file format

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1229: - Component/s: tests-ci Epic Link: HUDI-1236 > Enable Integration test with HFile base file format > -

[jira] [Updated] (HUDI-1590) Support async clustering w/ test suite job

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1590: - Component/s: tests-ci Epic Link: HUDI-1236 > Support async clustering w/ test suite job > --

[jira] [Updated] (HUDI-562) Improve unit test coverage of HUDI

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-562: Component/s: tests-ci Epic Link: HUDI-1250 > Improve unit test coverage of HUDI > -

[jira] [Updated] (HUDI-1635) Improvements to Hudi Test Suite

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1635: - Epic Link: HUDI-1236 > Improvements to Hudi Test Suite > --- > >

[jira] [Updated] (HUDI-977) deal the test module hudi-integ-test

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-977: Epic Link: HUDI-1248 > deal the test module hudi-integ-test > > >

[jira] [Updated] (HUDI-1732) Support Spark3 integration test

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1732: - Component/s: tests-ci Epic Link: HUDI-1248 > Support Spark3 integration test > -

[jira] [Updated] (HUDI-1733) Support scala2.12 integration test

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1733: - Component/s: tests-ci Epic Link: HUDI-1248 > Support scala2.12 integration test > --

[jira] [Updated] (HUDI-2555) Fix flaky FlinkCompaction integration test

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2555: - Epic Link: HUDI-1248 > Fix flaky FlinkCompaction integration test > --

[GitHub] [hudi] zhedoubushishi commented on a change in pull request #5113: [HUDI-3625] [RFC-48] Optimized storage layout for Cloud Object Stores

2022-03-23 Thread GitBox
zhedoubushishi commented on a change in pull request #5113: URL: https://github.com/apache/hudi/pull/5113#discussion_r833918891 ## File path: rfc/rfc-48/rfc-48.md ## @@ -0,0 +1,171 @@ + + +# RFC-[48]: Optimized storage layout for Cloud Object Stores + +## Proposers +- @umehrot2

[jira] [Updated] (HUDI-1248) [UMBRELLA] Tests cleanup and fixes

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1248: - Component/s: tests-ci > [UMBRELLA] Tests cleanup and fixes > -- > >

[jira] [Updated] (HUDI-1243) Debug test-suite docker execution

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1243: - Component/s: tests-ci Epic Link: HUDI-1236 > Debug test-suite docker execution > ---

[jira] [Updated] (HUDI-3700) Revisit hudi-utilities-bundle build wrt Spark versions

2022-03-23 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3700: Description: When we build hudi-utilities-bundle, the Spark profile can affect the bundle jar.  This causes

[jira] [Updated] (HUDI-289) Implement a test suite to support long running test for Hudi writing and querying end-end

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-289: Epic Link: HUDI-1236 > Implement a test suite to support long running test for Hudi writing and > querying e

[jira] [Updated] (HUDI-3700) Revisit hudi-utilities-bundle build wrt Spark versions

2022-03-23 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3700: Summary: Revisit hudi-utilities-bundle build wrt Spark versions (was: Revisit hudi-utilities-bundle wrt Spa

[GitHub] [hudi] hudi-bot commented on pull request #5088: [HUDI-3678] Fix record rewrite of create handle when 'preserveMetadat…

2022-03-23 Thread GitBox
hudi-bot commented on pull request #5088: URL: https://github.com/apache/hudi/pull/5088#issuecomment-1077168542 ## CI report: * 1f4b599f08cc4fe7fccb7804eb91b6af41159695 UNKNOWN * ab52e9ff8bd58125727fbd1d5ddb0a89b6077d52 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #5088: [HUDI-3678] Fix record rewrite of create handle when 'preserveMetadat…

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #5088: URL: https://github.com/apache/hudi/pull/5088#issuecomment-107705 ## CI report: * 1f4b599f08cc4fe7fccb7804eb91b6af41159695 UNKNOWN * ab52e9ff8bd58125727fbd1d5ddb0a89b6077d52 Azure: [FAILURE](https://dev.azure.com/apache-hud

[jira] [Updated] (HUDI-289) Implement a test suite to support long running test for Hudi writing and querying end-end

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-289: Component/s: tests-ci > Implement a test suite to support long running test for Hudi writing and > querying

[jira] [Updated] (HUDI-3700) Revisit hudi-utilities-bundle wrt Spark versions

2022-03-23 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3700: Description: When we build hudi-utilities-bundle, the Spark profile can affect the bundle jar.  This causes

[jira] [Updated] (HUDI-289) Implement a test suite to support long running test for Hudi writing and querying end-end

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-289: Fix Version/s: 0.12.0 (was: 0.11.0) > Implement a test suite to support long running t

[jira] [Created] (HUDI-3700) Revisit hudi-utilities-bundle wrt Spark versions

2022-03-23 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-3700: --- Summary: Revisit hudi-utilities-bundle wrt Spark versions Key: HUDI-3700 URL: https://issues.apache.org/jira/browse/HUDI-3700 Project: Apache Hudi Issue Type: Task

[GitHub] [hudi] hudi-bot commented on pull request #5106: [minor] Checks the data block type for archived timeline

2022-03-23 Thread GitBox
hudi-bot commented on pull request #5106: URL: https://github.com/apache/hudi/pull/5106#issuecomment-1077101336 ## CI report: * 6ced2ef06612d67b7d06143e4f1383e722ce8727 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5106: [minor] Checks the data block type for archived timeline

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #5106: URL: https://github.com/apache/hudi/pull/5106#issuecomment-1077010049 ## CI report: * 7f5c63d29db483a30866c1586c2be7360ff8b307 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] maddy2u commented on issue #5021: [FEATURE REQUEST] Support for Presto/Athena to make updates to Hudi Tables

2022-03-23 Thread GitBox
maddy2u commented on issue #5021: URL: https://github.com/apache/hudi/issues/5021#issuecomment-1077093180 Hi @umehrot2 - Do you have any update on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HUDI-289) Implement a test suite to support long running test for Hudi writing and querying end-end

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-289: Fix Version/s: 0.11.0 > Implement a test suite to support long running test for Hudi writing and > querying

[jira] [Updated] (HUDI-664) Adjust Logging levels to reduce verbose log msgs in hudi-client

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-664: Issue Type: Improvement (was: Bug) > Adjust Logging levels to reduce verbose log msgs in hudi-client > -

[jira] [Updated] (HUDI-664) Adjust Logging levels to reduce verbose log msgs in hudi-client

2022-03-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-664: Component/s: tests-ci > Adjust Logging levels to reduce verbose log msgs in hudi-client > ---

[GitHub] [hudi] hudi-bot removed a comment on pull request #5088: [HUDI-3678] Fix record rewrite of create handle when 'preserveMetadat…

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #5088: URL: https://github.com/apache/hudi/pull/5088#issuecomment-1075939184 ## CI report: * 1f4b599f08cc4fe7fccb7804eb91b6af41159695 UNKNOWN * ab52e9ff8bd58125727fbd1d5ddb0a89b6077d52 Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #5088: [HUDI-3678] Fix record rewrite of create handle when 'preserveMetadat…

2022-03-23 Thread GitBox
hudi-bot commented on pull request #5088: URL: https://github.com/apache/hudi/pull/5088#issuecomment-107705 ## CI report: * 1f4b599f08cc4fe7fccb7804eb91b6af41159695 UNKNOWN * ab52e9ff8bd58125727fbd1d5ddb0a89b6077d52 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot commented on pull request #5104: [WIP] Different CI fixes - for verification only

2022-03-23 Thread GitBox
hudi-bot commented on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077049521 ## CI report: * 762e2e525c84b54852ef5c5940a225827f7bd208 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5104: [WIP] Different CI fixes - for verification only

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077047961 ## CI report: * 762e2e525c84b54852ef5c5940a225827f7bd208 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5104: [WIP] Different CI fixes - for verification only

2022-03-23 Thread GitBox
hudi-bot commented on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1077047961 ## CI report: * 762e2e525c84b54852ef5c5940a225827f7bd208 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5104: [WIP] Different CI fixes - for verification only

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #5104: URL: https://github.com/apache/hudi/pull/5104#issuecomment-1076709689 ## CI report: * 762e2e525c84b54852ef5c5940a225827f7bd208 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4962: [HUDI-3355] Issue with out of order commits in the timeline when ingestion writers using SparkAllowUpdateStrategy

2022-03-23 Thread GitBox
hudi-bot commented on pull request #4962: URL: https://github.com/apache/hudi/pull/4962#issuecomment-1077046450 ## CI report: * 7d940e9f2e60c6c0c890b983d0dd63dc3c9873ec Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4962: [HUDI-3355] Issue with out of order commits in the timeline when ingestion writers using SparkAllowUpdateStrategy

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #4962: URL: https://github.com/apache/hudi/pull/4962#issuecomment-1077022188 ## CI report: * a64a3e93211d5dd316492de94c81b2e230afe04f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #5097: [WIP] Fixing master

2022-03-23 Thread GitBox
hudi-bot removed a comment on pull request #5097: URL: https://github.com/apache/hudi/pull/5097#issuecomment-1077043615 ## CI report: * 7f8a8b5f6987fa33df7444e232ac55c08fb1df9b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

  1   2   3   4   5   >