[jira] [Closed] (HUDI-3100) Hive Conditional sync cannot be set from deltastreamer

2022-01-06 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3100. Fix Version/s: (was: 0.11.0) Reviewers: sivabalan narayanan Resolution: Fixed > Hive

[hudi] branch master updated (b2b23f5 -> 2467c13)

2022-01-06 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from b2b23f5 [HUDI-3183] Wrong result of HoodieArchivedTimeline loadInstants with TimeRangeFilter (#4521) add

[GitHub] [hudi] xushiyan merged pull request #4440: [HUDI-3100] Add config for hive conditional sync

2022-01-06 Thread GitBox
xushiyan merged pull request #4440: URL: https://github.com/apache/hudi/pull/4440 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] xushiyan commented on issue #4474: [SUPPORT] Should we shade all aws dependencies to avoid class conflicts?

2022-01-06 Thread GitBox
xushiyan commented on issue #4474: URL: https://github.com/apache/hudi/issues/4474#issuecomment-1007188747 After some discussions, we think that we should keep cloud provider's jars out of open source bundle jars. Any cloud provider can create its own specific hudi module and hudi bundle

[GitHub] [hudi] dongkelun commented on pull request #4533: [HUDI-3192] Spark metastore schema evolution broken

2022-01-06 Thread GitBox
dongkelun commented on pull request #4533: URL: https://github.com/apache/hudi/pull/4533#issuecomment-1007187752 @xushiyan @nsivabalan Hello,can you please take a review? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] hudi-bot removed a comment on pull request #4533: [HUDI-3192] Spark metastore schema evolution broken

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4533: URL: https://github.com/apache/hudi/pull/4533#issuecomment-1007166026 ## CI report: * 63cee6177c62cf267849d4f9379eaad88fd5f584 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4533: [HUDI-3192] Spark metastore schema evolution broken

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4533: URL: https://github.com/apache/hudi/pull/4533#issuecomment-1007186261 ## CI report: * 63cee6177c62cf267849d4f9379eaad88fd5f584 Azure:

[GitHub] [hudi] vinothchandar edited a comment on pull request #4514: [HUDI-3172] Refactor hudi existing modules to make more code reuse in V2 Implementation

2022-01-06 Thread GitBox
vinothchandar edited a comment on pull request #4514: URL: https://github.com/apache/hudi/pull/4514#issuecomment-1007172166 @leesf few questions. 1. What do the hudi-spark2-extensions/hudi-spark3-extensions do? What code would these have in the future? 2. Users may have

[GitHub] [hudi] vinothchandar commented on pull request #4514: [HUDI-3172] Refactor hudi existing modules to make more code reuse in V2 Implementation

2022-01-06 Thread GitBox
vinothchandar commented on pull request #4514: URL: https://github.com/apache/hudi/pull/4514#issuecomment-1007172166 @leesf few questions. 1. What do the hudi-spark2-extensions/hudi-spark3-extensions do? What code would these have in the future? 2. Users may have spark jobs

[GitHub] [hudi] hudi-bot removed a comment on pull request #4532: [Minor]Fix some code style based on check-sytle plugin

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4532: URL: https://github.com/apache/hudi/pull/4532#issuecomment-1007152604 ## CI report: * 59e48916ff71ca86523e40558a2e15418a3fffcb Azure:

[jira] [Created] (HUDI-3193) Move hudi-aws dependency out of hudi-client-common

2022-01-06 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-3193: Summary: Move hudi-aws dependency out of hudi-client-common Key: HUDI-3193 URL: https://issues.apache.org/jira/browse/HUDI-3193 Project: Apache Hudi Issue Type:

[GitHub] [hudi] hudi-bot commented on pull request #4532: [Minor]Fix some code style based on check-sytle plugin

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4532: URL: https://github.com/apache/hudi/pull/4532#issuecomment-1007171945 ## CI report: * 59e48916ff71ca86523e40558a2e15418a3fffcb Azure:

[jira] [Updated] (HUDI-3157) Remove aws jars from hudi bundles

2022-01-06 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3157: - Summary: Remove aws jars from hudi bundles (was: Shade aws-dependencies to avoid class conflicts) >

[jira] [Assigned] (HUDI-3157) Shade aws-dependencies to avoid class conflicts

2022-01-06 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3157: Assignee: Raymond Xu (was: Wenning Ding) > Shade aws-dependencies to avoid class conflicts >

[GitHub] [hudi] hudi-bot commented on pull request #4533: [HUDI-3192] Spark metastore schema evolution broken

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4533: URL: https://github.com/apache/hudi/pull/4533#issuecomment-1007166026 ## CI report: * 63cee6177c62cf267849d4f9379eaad88fd5f584 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4530: [HUDI-3178] Fixing metadata table compaction so as to not include uncommitted data

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4530: URL: https://github.com/apache/hudi/pull/4530#issuecomment-1007166010 ## CI report: * f67f3a7d1a3de2bd170fed67031a37ad1da5115a Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4533: [HUDI-3192] Spark metastore schema evolution broken

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4533: URL: https://github.com/apache/hudi/pull/4533#issuecomment-1007164625 ## CI report: * 63cee6177c62cf267849d4f9379eaad88fd5f584 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot

[GitHub] [hudi] hudi-bot removed a comment on pull request #4530: [HUDI-3178] Fixing metadata table compaction so as to not include uncommitted data

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4530: URL: https://github.com/apache/hudi/pull/4530#issuecomment-1007136180 ## CI report: * 33af796c394961a4d9b16dcba8950e68ee018ea5 Azure:

[GitHub] [hudi] leesf commented on a change in pull request #4514: [HUDI-3172] Refactor hudi existing modules to make more code reuse in V2 Implementation

2022-01-06 Thread GitBox
leesf commented on a change in pull request #4514: URL: https://github.com/apache/hudi/pull/4514#discussion_r780047010 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala ## @@ -177,7 +177,7 @@ class DefaultSource extends

[GitHub] [hudi] leesf commented on a change in pull request #4514: [HUDI-3172] Refactor hudi existing modules to make more code reuse in V2 Implementation

2022-01-06 Thread GitBox
leesf commented on a change in pull request #4514: URL: https://github.com/apache/hudi/pull/4514#discussion_r780047010 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala ## @@ -177,7 +177,7 @@ class DefaultSource extends

[GitHub] [hudi] hudi-bot commented on pull request #4533: [HUDI-3192] Spark metastore schema evolution broken

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4533: URL: https://github.com/apache/hudi/pull/4533#issuecomment-1007164625 ## CI report: * 63cee6177c62cf267849d4f9379eaad88fd5f584 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] dongkelun commented on pull request #4533: [HUDI-3192] Spark metastore schema evolution broken

2022-01-06 Thread GitBox
dongkelun commented on pull request #4533: URL: https://github.com/apache/hudi/pull/4533#issuecomment-1007164107 This PR is to solve this [issue](https://github.com/apache/hudi/issues/4525) -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Updated] (HUDI-3192) Spark metastore schema evolution broken

2022-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3192: - Labels: pull-request-available (was: ) > Spark metastore schema evolution broken >

[GitHub] [hudi] dongkelun opened a new pull request #4533: [HUDI-3192] Spark metastore schema evolution broken

2022-01-06 Thread GitBox
dongkelun opened a new pull request #4533: URL: https://github.com/apache/hudi/pull/4533 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] vinothchandar commented on pull request #4514: [HUDI-3172] Refactor hudi existing modules to make more code reuse in V2 Implementation

2022-01-06 Thread GitBox
vinothchandar commented on pull request #4514: URL: https://github.com/apache/hudi/pull/4514#issuecomment-1007160076 2 more days should be okay? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Created] (HUDI-3192) Spark metastore schema evolution broken

2022-01-06 Thread Jira
董可伦 created HUDI-3192: - Summary: Spark metastore schema evolution broken Key: HUDI-3192 URL: https://issues.apache.org/jira/browse/HUDI-3192 Project: Apache Hudi Issue Type: Improvement

[GitHub] [hudi] zhangyue19921010 commented on pull request #4078: [HUDI-2833] Clean up unused archive files instead of expanding indefinitely.

2022-01-06 Thread GitBox
zhangyue19921010 commented on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-1007158124 @nsivabalan and @yihua Thanks a lot for your help :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] vinothchandar commented on a change in pull request #4514: [HUDI-3172] Refactor hudi existing modules to make more code reuse in V2 Implementation

2022-01-06 Thread GitBox
vinothchandar commented on a change in pull request #4514: URL: https://github.com/apache/hudi/pull/4514#discussion_r780041223 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala ## @@ -177,7 +177,7 @@ class DefaultSource

[GitHub] [hudi] codope closed pull request #3877: [HUDI-2590][WIP] Test different keygen with and without glob path

2022-01-06 Thread GitBox
codope closed pull request #3877: URL: https://github.com/apache/hudi/pull/3877 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #4520: [HUDI-3179][Stacked on 4417] Extracted common `AbstractHoodieTableFileIndex` to be shared across engines

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4520: URL: https://github.com/apache/hudi/pull/4520#issuecomment-1007154511 ## CI report: * 26a7987a7b002b5596ba627ee6d7dc15dfc6c922 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4520: [HUDI-3179][Stacked on 4417] Extracted common `AbstractHoodieTableFileIndex` to be shared across engines

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4520: URL: https://github.com/apache/hudi/pull/4520#issuecomment-1007136167 ## CI report: * 6917597395b1f70c4953833554d9b584d4645297 Azure:

[GitHub] [hudi] xushiyan commented on pull request #4514: [HUDI-3172] Refactor hudi existing modules to make more code reuse in V2 Implementation

2022-01-06 Thread GitBox
xushiyan commented on pull request #4514: URL: https://github.com/apache/hudi/pull/4514#issuecomment-1007153782 > @xushiyan given we are almost winding down for 0.10.1, I suggest we land this sooner than later. That way we can focus on stabilizing master for 0.11.0 - that's not too far

[GitHub] [hudi] hudi-bot commented on pull request #4532: [Minor]Fix some code style based on check-sytle plugin

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4532: URL: https://github.com/apache/hudi/pull/4532#issuecomment-1007152604 ## CI report: * 59e48916ff71ca86523e40558a2e15418a3fffcb Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4532: [Minor]Fix some code style based on check-sytle plugin

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4532: URL: https://github.com/apache/hudi/pull/4532#issuecomment-1007151644 ## CI report: * 59e48916ff71ca86523e40558a2e15418a3fffcb UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot

[GitHub] [hudi] hudi-bot commented on pull request #4532: [Minor]Fix some code style based on check-sytle plugin

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4532: URL: https://github.com/apache/hudi/pull/4532#issuecomment-1007151644 ## CI report: * 59e48916ff71ca86523e40558a2e15418a3fffcb UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] zhangyue19921010 commented on pull request #4521: [HUDI-3183] Wrong result of HoodieArchivedTimeline loadInstants with TimeRangeFilter

2022-01-06 Thread GitBox
zhangyue19921010 commented on pull request #4521: URL: https://github.com/apache/hudi/pull/4521#issuecomment-1007151532 Hi @nsivabalan Thanks a lot for your help! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] zhangyue19921010 opened a new pull request #4532: [Minor]Fix some code style based on check-sytle plugin

2022-01-06 Thread GitBox
zhangyue19921010 opened a new pull request #4532: URL: https://github.com/apache/hudi/pull/4532 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is

[GitHub] [hudi] hudi-bot commented on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007148515 ## CI report: * fde98bb87aca9963a377d036f458d83f23a90ad6 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007135175 ## CI report: * cb2d16ca92d7867d43c405f2babc9a85aaeca64e Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4531: [WIP][HUDI-3191][Stacked on 4520] Rebasing Hive's FileInputFormat onto `AbstractHoodieTableFileIndex`

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4531: URL: https://github.com/apache/hudi/pull/4531#issuecomment-1007136190 ## CI report: * 16c7ef660e054e35bda2c981c3a5dd9d9c60e975 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4531: [WIP][HUDI-3191][Stacked on 4520] Rebasing Hive's FileInputFormat onto `AbstractHoodieTableFileIndex`

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4531: URL: https://github.com/apache/hudi/pull/4531#issuecomment-1007147660 ## CI report: * 16c7ef660e054e35bda2c981c3a5dd9d9c60e975 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4531: [WIP][HUDI-3191][Stacked on 4520] Rebasing Hive's FileInputFormat onto `AbstractHoodieTableFileIndex`

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4531: URL: https://github.com/apache/hudi/pull/4531#issuecomment-1007135339 ## CI report: * 16c7ef660e054e35bda2c981c3a5dd9d9c60e975 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot

[GitHub] [hudi] hudi-bot commented on pull request #4531: [WIP][HUDI-3191][Stacked on 4520] Rebasing Hive's FileInputFormat onto `AbstractHoodieTableFileIndex`

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4531: URL: https://github.com/apache/hudi/pull/4531#issuecomment-1007136190 ## CI report: * 16c7ef660e054e35bda2c981c3a5dd9d9c60e975 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4530: [HUDI-3178] Fixing metadata table compaction so as to not include uncommitted data

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4530: URL: https://github.com/apache/hudi/pull/4530#issuecomment-1007135331 ## CI report: * 33af796c394961a4d9b16dcba8950e68ee018ea5 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4520: [HUDI-3179][Stacked on 4417] Extracted common `AbstractHoodieTableFileIndex` to be shared across engines

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4520: URL: https://github.com/apache/hudi/pull/4520#issuecomment-1007135310 ## CI report: * 6917597395b1f70c4953833554d9b584d4645297 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4530: [HUDI-3178] Fixing metadata table compaction so as to not include uncommitted data

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4530: URL: https://github.com/apache/hudi/pull/4530#issuecomment-1007136180 ## CI report: * 33af796c394961a4d9b16dcba8950e68ee018ea5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4520: [HUDI-3179][Stacked on 4417] Extracted common `AbstractHoodieTableFileIndex` to be shared across engines

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4520: URL: https://github.com/apache/hudi/pull/4520#issuecomment-1007136167 ## CI report: * 6917597395b1f70c4953833554d9b584d4645297 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4530: [HUDI-3178] Fixing metadata table compaction so as to not include uncommitted data

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4530: URL: https://github.com/apache/hudi/pull/4530#issuecomment-1007135331 ## CI report: * 33af796c394961a4d9b16dcba8950e68ee018ea5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4531: [WIP][HUDI-3191][Stacked on 4520] Rebasing Hive's FileInputFormat onto `AbstractHoodieTableFileIndex`

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4531: URL: https://github.com/apache/hudi/pull/4531#issuecomment-1007135339 ## CI report: * 16c7ef660e054e35bda2c981c3a5dd9d9c60e975 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot removed a comment on pull request #4520: [HUDI-3179][Stacked on 4417] Extracted common `AbstractHoodieTableFileIndex` to be shared across engines

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4520: URL: https://github.com/apache/hudi/pull/4520#issuecomment-1007055013 ## CI report: * 6917597395b1f70c4953833554d9b584d4645297 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4520: [HUDI-3179][Stacked on 4417] Extracted common `AbstractHoodieTableFileIndex` to be shared across engines

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4520: URL: https://github.com/apache/hudi/pull/4520#issuecomment-1007135310 ## CI report: * 6917597395b1f70c4953833554d9b584d4645297 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4530: [HUDI-3178] Fixing metadata table compaction so as to not include uncommitted data

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4530: URL: https://github.com/apache/hudi/pull/4530#issuecomment-1007099737 ## CI report: * 33af796c394961a4d9b16dcba8950e68ee018ea5 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007134338 ## CI report: * cb2d16ca92d7867d43c405f2babc9a85aaeca64e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007135175 ## CI report: * cb2d16ca92d7867d43c405f2babc9a85aaeca64e Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007129547 ## CI report: * cb2d16ca92d7867d43c405f2babc9a85aaeca64e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007134338 ## CI report: * cb2d16ca92d7867d43c405f2babc9a85aaeca64e Azure:

[jira] [Updated] (HUDI-3191) Rebase Hive's FileInputFormat onto AbstractHoodieTableFileIndex

2022-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3191: - Labels: pull-request-available (was: ) > Rebase Hive's FileInputFormat onto

[GitHub] [hudi] alexeykudinkin opened a new pull request #4531: [WIP][HUDI-3191] Rebasing Hive's FileInputFormat onto `AbstractHoodieTableFileIndex`

2022-01-06 Thread GitBox
alexeykudinkin opened a new pull request #4531: URL: https://github.com/apache/hudi/pull/4531 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Updated] (HUDI-3191) Rebase Hive's FileInputFormat onto AbstractHoodieTableFileIndex

2022-01-06 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3191: -- Status: In Progress (was: Open) > Rebase Hive's FileInputFormat onto

[jira] [Created] (HUDI-3191) Rebase Hive's FileInputFormat onto AbstractHoodieTableFileIndex

2022-01-06 Thread Alexey Kudinkin (Jira)
Alexey Kudinkin created HUDI-3191: - Summary: Rebase Hive's FileInputFormat onto AbstractHoodieTableFileIndex Key: HUDI-3191 URL: https://issues.apache.org/jira/browse/HUDI-3191 Project: Apache Hudi

[jira] [Assigned] (HUDI-3179) Extract common Hudi Table File Index implementation

2022-01-06 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin reassigned HUDI-3179: - Assignee: Alexey Kudinkin > Extract common Hudi Table File Index implementation >

[jira] [Updated] (HUDI-3179) Extract common Hudi Table File Index implementation

2022-01-06 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3179: -- Status: Patch Available (was: In Progress) > Extract common Hudi Table File Index

[jira] [Updated] (HUDI-3179) Extract common Hudi Table File Index implementation

2022-01-06 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3179: -- Status: In Progress (was: Open) > Extract common Hudi Table File Index implementation >

[GitHub] [hudi] hudi-bot removed a comment on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007107627 ## CI report: * fb90b5e4b8b1311eb029595d9d7133a8da593bec Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007129547 ## CI report: * cb2d16ca92d7867d43c405f2babc9a85aaeca64e Azure:

[jira] [Updated] (HUDI-3082) [Phase 1] Unify MOR table access across Spark, Hive

2022-01-06 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3082: - Status: Patch Available (was: In Progress) > [Phase 1] Unify MOR table access across Spark, Hive

[GitHub] [hudi] vinothchandar commented on pull request #4514: [HUDI-3172] Refactor hudi existing modules to make more code reuse in V2 Implementation

2022-01-06 Thread GitBox
vinothchandar commented on pull request #4514: URL: https://github.com/apache/hudi/pull/4514#issuecomment-1007120240 @xushiyan given we are almost winding down for 0.10.1, I suggest we land this sooner than later. That way we can focus on stabilizing master for 0.11.0 - that's not too far

[GitHub] [hudi] hudi-bot removed a comment on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007106330 ## CI report: * fb90b5e4b8b1311eb029595d9d7133a8da593bec Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007107627 ## CI report: * fb90b5e4b8b1311eb029595d9d7133a8da593bec Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007100483 ## CI report: * fb90b5e4b8b1311eb029595d9d7133a8da593bec Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007106330 ## CI report: * fb90b5e4b8b1311eb029595d9d7133a8da593bec Azure:

[jira] [Updated] (HUDI-1896) [UMBRELLA] Implement DeltaStreamer Source for cloud object stores

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-1896: -- Epic Name: Implement DeltaStreamer Source for cloud object stores >

[jira] [Updated] (HUDI-1628) [Umbrella] Improve data locality during ingestion

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-1628: -- Epic Name: Improve data locality during ingestion Description:

[jira] [Updated] (HUDI-1387) [UMBRELLA] Support Apache Calcite for writing/querying Hudi datasets

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-1387: -- Epic Name: Support Apache Calcite for writing/querying Hudi datasets >

[jira] [Updated] (HUDI-1390) [UMBRELLA] Support schema inference for unstructured data

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-1390: -- Epic Name: Support schema inference for unstructured data > [UMBRELLA]

[jira] [Updated] (HUDI-1385) [UMBRELLA] Improve source ingestion support in DeltaStreamer

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-1385: -- Epic Name: Improve source ingestion support in DeltaStreamer >

[jira] [Updated] (HUDI-1250) [UMBRELLA] Test coverage

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-1250: -- Epic Name: Test coverage > [UMBRELLA] Test coverage >

[jira] [Updated] (HUDI-1249) [UMBRELLA] refactor tests for ease of development

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-1249: -- Epic Name: refactor tests for ease of development > [UMBRELLA] refactor

[jira] [Updated] (HUDI-1248) [UMBRELLA] Tests cleanup and fixes

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-1248: -- Epic Name: Tests cleanup and fixes > [UMBRELLA] Tests cleanup and fixes

[jira] [Updated] (HUDI-1237) [UMBRELLA] Checkstyle, formatting, warnings, spotless

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-1237: -- Epic Name: Checkstyle, formatting, warnings, spotless > [UMBRELLA]

[jira] [Updated] (HUDI-1239) [UMBRELLA] Config clean up

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-1239: -- Epic Name: Config clean up > [UMBRELLA] Config clean up >

[jira] [Updated] (HUDI-1238) [UMBRELLA] Perf test env

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-1238: -- Epic Name: Perf test env > [UMBRELLA] Perf test env >

[jira] [Updated] (HUDI-1236) [UMBRELLA] Integ Test suite infra

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-1236: -- Epic Name: Integ Test suite infra > [UMBRELLA] Integ Test suite infra

[jira] [Updated] (HUDI-868) [UMBRELLA] Insert Overwrite API

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-868: - Epic Name: Insert Overwrite API > [UMBRELLA] Insert Overwrite API >

[jira] [Updated] (HUDI-538) [UMBRELLA] Restructuring hudi client module for multi engine support

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-538: - Epic Name: Restructuring hudi client module for multi engine support >

[jira] [Updated] (HUDI-270) [UMBRELLA] Improve Hudi website UI and documentation

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-270: - Epic Name: Improve Hudi website UI and documentation > [UMBRELLA] Improve

[jira] [Updated] (HUDI-466) [Umbrella] Record level, global low-latency index implementation

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-466: - Epic Name: Record level, global low-latency index implementation >

[jira] [Updated] (HUDI-60) [UMBRELLA] Support Apache Beam for incremental tailing

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-60?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-60: Epic Name: Support Apache Beam for incremental tailing > [UMBRELLA] Support

[jira] [Updated] (HUDI-57) [UMBRELLA] Support ORC Storage

2022-01-06 Thread Bhavani Sudha Saktheeswaran (Jira)
[ https://issues.apache.org/jira/browse/HUDI-57?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-57: Epic Name: Support ORC Storage > [UMBRELLA] Support ORC Storage >

[GitHub] [hudi] hudi-bot commented on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007100483 ## CI report: * fb90b5e4b8b1311eb029595d9d7133a8da593bec Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007081241 ## CI report: * eecd338f6aa8c22150cc3a3abc28eb5c2535ef1e Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4530: [HUDI-3178] Fixing metadata table compaction so as to not include uncommitted data

2022-01-06 Thread GitBox
hudi-bot removed a comment on pull request #4530: URL: https://github.com/apache/hudi/pull/4530#issuecomment-1007080163 ## CI report: * 33af796c394961a4d9b16dcba8950e68ee018ea5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4530: [HUDI-3178] Fixing metadata table compaction so as to not include uncommitted data

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4530: URL: https://github.com/apache/hudi/pull/4530#issuecomment-1007099737 ## CI report: * 33af796c394961a4d9b16dcba8950e68ee018ea5 Azure:

[jira] [Assigned] (HUDI-3183) Fix wrong result of HoodieArchivedTimeline loadInstants with TimeRangeFilter

2022-01-06 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-3183: - Assignee: Yue Zhang > Fix wrong result of HoodieArchivedTimeline loadInstants

[jira] [Updated] (HUDI-3183) Fix wrong result of HoodieArchivedTimeline loadInstants with TimeRangeFilter

2022-01-06 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3183: -- Fix Version/s: 0.11.0 > Fix wrong result of HoodieArchivedTimeline loadInstants with

[jira] [Resolved] (HUDI-3183) Fix wrong result of HoodieArchivedTimeline loadInstants with TimeRangeFilter

2022-01-06 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-3183. --- > Fix wrong result of HoodieArchivedTimeline loadInstants with TimeRangeFilter >

[GitHub] [hudi] nsivabalan merged pull request #4521: [HUDI-3183] Wrong result of HoodieArchivedTimeline loadInstants with TimeRangeFilter

2022-01-06 Thread GitBox
nsivabalan merged pull request #4521: URL: https://github.com/apache/hudi/pull/4521 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HUDI-3183) Fix wrong result of HoodieArchivedTimeline loadInstants with TimeRangeFilter

2022-01-06 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3183: -- Fix Version/s: 0.10.1 > Fix wrong result of HoodieArchivedTimeline loadInstants with

[hudi] branch master updated (d7afc58 -> b2b23f5)

2022-01-06 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from d7afc58 [HUDI-3118] Add default HUDI_DIR in setupKafka.sh (#4460) add b2b23f5 [HUDI-3183] Wrong result of

[GitHub] [hudi] hudi-bot commented on pull request #4203: [HUDI-2909] Handle logical type in TimestampBasedKeyGenerator

2022-01-06 Thread GitBox
hudi-bot commented on pull request #4203: URL: https://github.com/apache/hudi/pull/4203#issuecomment-1007081241 ## CI report: * eecd338f6aa8c22150cc3a3abc28eb5c2535ef1e Azure:

  1   2   3   4   >