[GitHub] [hudi] xushiyan merged pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
xushiyan merged pull request #4986: URL: https://github.com/apache/hudi/pull/4986 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[jira] [Commented] (HUDI-3441) Clean up markers of completed commits in .hoodie/.temp folder

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502989#comment-17502989 ] sivabalan narayanan commented on HUDI-3441: --- its a pain for release manager. Thi

[jira] [Commented] (HUDI-3445) Support clustering command based on Call Produce Command

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502986#comment-17502986 ] sivabalan narayanan commented on HUDI-3445: --- thanks! > Support clustering comma

[jira] [Commented] (HUDI-3441) Clean up markers of completed commits in .hoodie/.temp folder

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502983#comment-17502983 ] Raymond Xu commented on HUDI-3441: -- [~shivnarayan] we can always find all tickets via sea

[jira] [Updated] (HUDI-3538) Support compaction command based on Call Produce Command

2022-03-08 Thread shibei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shibei updated HUDI-3538: - Status: In Progress (was: Open) > Support compaction command based on Call Produce Command >

[jira] [Commented] (HUDI-3445) Support clustering command based on Call Produce Command

2022-03-08 Thread shibei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502981#comment-17502981 ] shibei commented on HUDI-3445: -- [~shivnarayan] I have closed this issue. > Support clusterin

[GitHub] [hudi] hudi-bot commented on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061826738 ## CI report: * c64b1e4bb6add5ebeb98e66559a81224eb749db3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061766580 ## CI report: * c64b1e4bb6add5ebeb98e66559a81224eb749db3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Closed] (HUDI-3445) Support clustering command based on Call Produce Command

2022-03-08 Thread shibei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shibei closed HUDI-3445. Resolution: Fixed > Support clustering command based on Call Produce Command > -

[jira] [Closed] (HUDI-3418) Save timeout option for remote RemoteFileSystemView

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3418. - Resolution: Fixed > Save timeout option for remote RemoteFileSystemView >

[jira] [Commented] (HUDI-3441) Clean up markers of completed commits in .hoodie/.temp folder

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502979#comment-17502979 ] sivabalan narayanan commented on HUDI-3441: --- Alternatively, you can also just li

[jira] [Commented] (HUDI-3441) Clean up markers of completed commits in .hoodie/.temp folder

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502978#comment-17502978 ] sivabalan narayanan commented on HUDI-3441: --- [~guoyihua] [~xushiyan] : we should

[GitHub] [hudi] nsivabalan commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

2022-03-08 Thread GitBox
nsivabalan commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1061819612 this is a good find and a nice optimization 👍 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Closed] (HUDI-3516) Optimize the memory of HoodieDataBlock for Flink

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3516. - Resolution: Fixed > Optimize the memory of HoodieDataBlock for Flink > ---

[jira] [Reopened] (HUDI-3516) Optimize the memory of HoodieDataBlock for Flink

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-3516: --- > Optimize the memory of HoodieDataBlock for Flink > -

[jira] [Reopened] (HUDI-2631) In CompactFunction, set up the write schema each time with the latest schema

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-2631: --- > In CompactFunction, set up the write schema each time with the latest schema > -

[jira] [Closed] (HUDI-2631) In CompactFunction, set up the write schema each time with the latest schema

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-2631. - Resolution: Fixed > In CompactFunction, set up the write schema each time with the latest

[jira] [Closed] (HUDI-3264) Make schema registry configs more flexible with MultiTableDeltaStreamer

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3264. - Resolution: Fixed > Make schema registry configs more flexible with MultiTableDeltaStreame

[jira] [Updated] (HUDI-3548) Fix if user specify key "hoodie.datasource.clustering.async.enable" directly, async clustering not work

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3548: -- Priority: Critical (was: Major) > Fix if user specify key "hoodie.datasource.clustering

[jira] [Closed] (HUDI-3548) Fix if user specify key "hoodie.datasource.clustering.async.enable" directly, async clustering not work

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3548. - Resolution: Fixed > Fix if user specify key "hoodie.datasource.clustering.async.enable" di

[jira] [Updated] (HUDI-3548) Fix if user specify key "hoodie.datasource.clustering.async.enable" directly, async clustering not work

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3548: -- Fix Version/s: 0.11.0 > Fix if user specify key "hoodie.datasource.clustering.async.enab

[jira] [Commented] (HUDI-3445) Support clustering command based on Call Produce Command

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17502974#comment-17502974 ] sivabalan narayanan commented on HUDI-3445: --- [~shibei] : Is there anything pendi

[jira] [Closed] (HUDI-3460) Flink TM Memory Optimization

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3460. - Resolution: Fixed > Flink TM Memory Optimization > > >

[jira] [Reopened] (HUDI-3460) Flink TM Memory Optimization

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-3460: --- > Flink TM Memory Optimization > > > Key: HUD

[jira] [Closed] (HUDI-3069) Improve HoodieMergedLogRecordScanner avoid putting unnecessary hoodie records

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3069. - Resolution: Fixed > Improve HoodieMergedLogRecordScanner avoid putting unnecessary hoodie

[jira] [Reopened] (HUDI-3069) Improve HoodieMergedLogRecordScanner avoid putting unnecessary hoodie records

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-3069: --- > Improve HoodieMergedLogRecordScanner avoid putting unnecessary hoodie records >

[jira] [Resolved] (HUDI-3069) Improve HoodieMergedLogRecordScanner avoid putting unnecessary hoodie records

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-3069. --- > Improve HoodieMergedLogRecordScanner avoid putting unnecessary hoodie records >

[jira] [Reopened] (HUDI-3069) Improve HoodieMergedLogRecordScanner avoid putting unnecessary hoodie records

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-3069: --- > Improve HoodieMergedLogRecordScanner avoid putting unnecessary hoodie records >

[jira] [Reopened] (HUDI-3573) flink cleanFuntion execute clean on initialization

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-3573: --- > flink cleanFuntion execute clean on initialization > --

[jira] [Closed] (HUDI-3573) flink cleanFuntion execute clean on initialization

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3573. - Resolution: Fixed > flink cleanFuntion execute clean on initialization >

[jira] [Closed] (HUDI-3552) Strength the NetworkUtils#getHostname by checking network interfaces first

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3552. - Resolution: Fixed > Strength the NetworkUtils#getHostname by checking network interfaces f

[jira] [Assigned] (HUDI-3552) Strength the NetworkUtils#getHostname by checking network interfaces first

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-3552: - Assignee: Danny Chen > Strength the NetworkUtils#getHostname by checking network

[GitHub] [hudi] nsivabalan commented on pull request #4942: [HUDI-3552] Strength the NetworkUtils#getHostname by checking network…

2022-03-08 Thread GitBox
nsivabalan commented on pull request #4942: URL: https://github.com/apache/hudi/pull/4942#issuecomment-1061806198 @xushiyan : can you review this patch. sometime back, we had some perf issues wrt way we fetch or print hostname and we had to fix it. -- This is an automated messag

[jira] [Closed] (HUDI-2677) Add DFS based message queue for flink writer

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-2677. - Fix Version/s: (was: 0.10.0) Resolution: Fixed > Add DFS based message queue fo

[jira] [Reopened] (HUDI-2677) Add DFS based message queue for flink writer

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-2677: --- > Add DFS based message queue for flink writer > -

[jira] [Closed] (HUDI-3576) Master is flaky after landing https://github.com/apache/hudi/pull/4812

2022-03-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3576. - Resolution: Fixed > Master is flaky after landing https://github.com/apache/hudi/pull/4812

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061787731 ## CI report: * 3cc3b11a9533b1c388bb257c09a9344e1b062185 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061790085 ## CI report: * 3cc3b11a9533b1c388bb257c09a9344e1b062185 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061787731 ## CI report: * 3cc3b11a9533b1c388bb257c09a9344e1b062185 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061785231 ## CI report: * 3cc3b11a9533b1c388bb257c09a9344e1b062185 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061782998 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061785592 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061785231 ## CI report: * 3cc3b11a9533b1c388bb257c09a9344e1b062185 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061720767 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * b989ca6df7345d60930ede5628de28b3caae5147 UNKNOWN * 8b62dd5cad44ab2cd81f12206da683cf139c5

[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061756084 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061782998 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3214) Optimize auto partition in spark

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3214: - Priority: Major (was: Critical) > Optimize auto partition in spark > > >

[jira] [Updated] (HUDI-3584) Skip integration test modules by default

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3584: - Remaining Estimate: 2h Original Estimate: 2h > Skip integration test modules by default > ---

[jira] [Closed] (HUDI-3574) Improve maven module configs for different spark profiles

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3574. Resolution: Done > Improve maven module configs for different spark profiles > -

[jira] [Updated] (HUDI-3574) Improve maven module configs for different spark profiles

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3574: - Remaining Estimate: 2h Original Estimate: 2h > Improve maven module configs for different spark profi

[jira] [Updated] (HUDI-3581) Reorganize some clazz for hudi flink

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3581: - Sprint: Cont' improve - 2022/03/01 > Reorganize some clazz for hudi flink > --

[jira] [Updated] (HUDI-3584) Skip integration test modules by default

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3584: - Sprint: Cont' improve - 2022/03/01 > Skip integration test modules by default > --

[jira] [Updated] (HUDI-3574) Improve maven module configs for different spark profiles

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3574: - Sprint: Cont' improve - 2022/03/01 > Improve maven module configs for different spark profiles > -

[jira] [Updated] (HUDI-3584) Skip integration test modules by default

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3584: - Status: In Progress (was: Open) > Skip integration test modules by default >

[GitHub] [hudi] hudi-bot commented on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061766580 ## CI report: * c64b1e4bb6add5ebeb98e66559a81224eb749db3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061763972 ## CI report: * c64b1e4bb6add5ebeb98e66559a81224eb749db3 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot removed a comment on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061758979 ## CI report: * c64b1e4bb6add5ebeb98e66559a81224eb749db3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061763972 ## CI report: * c64b1e4bb6add5ebeb98e66559a81224eb749db3 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061758979 ## CI report: * c64b1e4bb6add5ebeb98e66559a81224eb749db3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061709619 ## CI report: * c64b1e4bb6add5ebeb98e66559a81224eb749db3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061693133 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061756084 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3577) NPE in HoodieTimelineArchiver

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3577: - Component/s: archiving > NPE in HoodieTimelineArchiver > - > >

[GitHub] [hudi] huberylee commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
huberylee commented on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061755250 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (HUDI-3577) NPE in HoodieTimelineArchiver

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3577: - Sprint: Cont' improve - 2022/03/01 > NPE in HoodieTimelineArchiver > - > >

[jira] [Updated] (HUDI-3577) NPE in HoodieTimelineArchiver

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3577: - Reviewers: sivabalan narayanan > NPE in HoodieTimelineArchiver > - > >

[jira] [Updated] (HUDI-3454) Fix partition name in all code paths for LogRecordScanner

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3454: - Remaining Estimate: (was: 2h) Original Estimate: (was: 2h) > Fix partition name in all code p

[jira] [Updated] (HUDI-3454) Fix partition name in all code paths for LogRecordScanner

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3454: - Priority: Blocker (was: Critical) > Fix partition name in all code paths for LogRecordScanner > -

[jira] [Updated] (HUDI-3577) NPE in HoodieTimelineArchiver

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3577: - Story Points: (was: 2) > NPE in HoodieTimelineArchiver > - > >

[jira] [Updated] (HUDI-3577) NPE in HoodieTimelineArchiver

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3577: - Sprint: (was: Hudi-Sprint-Mar-07) > NPE in HoodieTimelineArchiver > - > >

[jira] [Updated] (HUDI-3577) NPE in HoodieTimelineArchiver

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3577: - Priority: Critical (was: Blocker) > NPE in HoodieTimelineArchiver > - > >

[jira] [Updated] (HUDI-3454) Fix partition name in all code paths for LogRecordScanner

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3454: - Sprint: (was: Cont' improve - 2022/03/01) > Fix partition name in all code paths for LogRecordScanner >

[jira] [Updated] (HUDI-3578) Archival intermittantly fails with NPE with 0.10.1 with multi-writer

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3578: - Sprint: Cont' improve - 2022/03/01 > Archival intermittantly fails with NPE with 0.10.1 with multi-writer

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061632285 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * b989ca6df7345d60930ede5628de28b3caae5147 UNKNOWN * 8b62dd5cad44ab2cd81f12206da683cf139c5

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061720767 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * b989ca6df7345d60930ede5628de28b3caae5147 UNKNOWN * 8b62dd5cad44ab2cd81f12206da683cf139c574c UNKN

[GitHub] [hudi] XuQianJin-Stars edited a comment on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
XuQianJin-Stars edited a comment on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061713534 +1 when CI is pass -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [hudi] XuQianJin-Stars removed a comment on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
XuQianJin-Stars removed a comment on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061714617 when CI is pass -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
XuQianJin-Stars commented on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061714617 when CI is pass -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
XuQianJin-Stars commented on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061713534 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [hudi] hudi-bot commented on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061709619 ## CI report: * c64b1e4bb6add5ebeb98e66559a81224eb749db3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061707269 ## CI report: * c64b1e4bb6add5ebeb98e66559a81224eb749db3 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4986: URL: https://github.com/apache/hudi/pull/4986#issuecomment-1061707269 ## CI report: * c64b1e4bb6add5ebeb98e66559a81224eb749db3 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] xushiyan opened a new pull request #4986: [HUDI-3584] Skip integ test modules by default

2022-03-08 Thread GitBox
xushiyan opened a new pull request #4986: URL: https://github.com/apache/hudi/pull/4986 By default we don't need to build ``` docker/hoodie/hadoop hudi-integ-test packaging/hudi-integ-test-bundle ``` We should skip installing them during CI jobs and most dev work. W

[jira] [Updated] (HUDI-3584) Skip integration test modules by default

2022-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3584: - Labels: hudi-on-call pull-request-available (was: hudi-on-call) > Skip integration test modules b

[jira] [Updated] (HUDI-3584) Skip integration test modules by default

2022-03-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3584: - Summary: Skip integration test modules by default (was: Skip integration modules by default) > Skip inte

[jira] [Created] (HUDI-3584) Skip integration modules by default

2022-03-08 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-3584: Summary: Skip integration modules by default Key: HUDI-3584 URL: https://issues.apache.org/jira/browse/HUDI-3584 Project: Apache Hudi Issue Type: Improvement

[GitHub] [hudi] hudi-bot commented on pull request #4984: [HUDI-3583] Fix MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4984: URL: https://github.com/apache/hudi/pull/4984#issuecomment-1061697101 ## CI report: * 015f7f0e07d3f0efbd8d3a728f802fc5572a8f52 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4984: [HUDI-3583] Fix MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4984: URL: https://github.com/apache/hudi/pull/4984#issuecomment-1061616431 ## CI report: * 015f7f0e07d3f0efbd8d3a728f802fc5572a8f52 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061693133 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4982: [HUDI-3567] Refactor HoodieCommonUtils to make code more reasonable

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4982: URL: https://github.com/apache/hudi/pull/4982#issuecomment-1061610766 ## CI report: * b93d81349a970391fe8baff27130a322a0af8516 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] yanghua commented on issue #4985: [SUPPORT]The current Docker demo only for x86 system ,arm64 system can't run success

2022-03-08 Thread GitBox
yanghua commented on issue #4985: URL: https://github.com/apache/hudi/issues/4985#issuecomment-1061675112 @nbalajee @n3nash Can you help to support this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hudi] Aalron opened a new issue #4985: [SUPPORT]The current Docker demo only for x86 system ,arm64 system can't run success

2022-03-08 Thread GitBox
Aalron opened a new issue #4985: URL: https://github.com/apache/hudi/issues/4985 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at dev-subscr...

[GitHub] [hudi] liujinhui1994 commented on pull request #4984: [HUDI-3583] Fix MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread GitBox
liujinhui1994 commented on pull request #4984: URL: https://github.com/apache/hudi/pull/4984#issuecomment-1061654990 @yihua Can you help me when I have time? I don’t know if I will have other problems with this change. -- This is an automated message from the Apache Git Service. To resp

[GitHub] [hudi] parisni edited a comment on issue #4904: [SUPPORT] Hudi 0.10.1 raises exception if hoodie.write.lock.dynamodb.endpoint_url not provided

2022-03-08 Thread GitBox
parisni edited a comment on issue #4904: URL: https://github.com/apache/hudi/issues/4904#issuecomment-1061644456 They can copy that file in their project to overwrite it until merged https://github.com/apache/hudi/blob/21b218f9569a60c94aa2155b2093205382da40d3/hudi-aws/src/main/java/org/apac

[GitHub] [hudi] parisni commented on issue #4904: [SUPPORT] Hudi 0.10.1 raises exception if hoodie.write.lock.dynamodb.endpoint_url not provided

2022-03-08 Thread GitBox
parisni commented on issue #4904: URL: https://github.com/apache/hudi/issues/4904#issuecomment-1061644456 They can copy that file in their project to overwrite it https://github.com/apache/hudi/blob/21b218f9569a60c94aa2155b2093205382da40d3/hudi-aws/src/main/java/org/apache/hudi/config/Dynam

[GitHub] [hudi] scxwhite commented on issue #4980: unable reprocess the data with old schema through Apache hudi ,Caused by: HoodieUpsertException: Error upserting bucketType UPDATE for partition :34

2022-03-08 Thread GitBox
scxwhite commented on issue #4980: URL: https://github.com/apache/hudi/issues/4980#issuecomment-1061643403 The schema evolutino needs to follow https://hudi.apache.org/docs/schema_evolution. For these old schema data, it is recommended that you manually convert to the new schema data be

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061629300 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * 59e0270ef6aba60d4a80f2482ec3fa605cd01e1f Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1061632285 ## CI report: * 869a752768dabc9e9cdb7df6b725fba50dd502af UNKNOWN * b989ca6df7345d60930ede5628de28b3caae5147 UNKNOWN * 8b62dd5cad44ab2cd81f12206da683cf139c574c UNKN

[GitHub] [hudi] hudi-bot commented on pull request #4983: [HUDI-3581] Reorganize some clazz for hudi flink

2022-03-08 Thread GitBox
hudi-bot commented on pull request #4983: URL: https://github.com/apache/hudi/pull/4983#issuecomment-1061629725 ## CI report: * 8cfd58b8f1608326997ad5c07667837c39cbb9f2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4983: [HUDI-3581] Reorganize some clazz for hudi flink

2022-03-08 Thread GitBox
hudi-bot removed a comment on pull request #4983: URL: https://github.com/apache/hudi/pull/4983#issuecomment-1061536791 ## CI report: * 8cfd58b8f1608326997ad5c07667837c39cbb9f2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

<    1   2   3   4   5   >