[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * ab0bf2d7ea7dae58a4c78bc4f4fdec7ec5c2be84 Azure:

[jira] [Commented] (HUDI-2029) Implement compression for DiskBasedMap in Spillable Map

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380342#comment-17380342 ] ASF GitHub Bot commented on HUDI-2029: -- codecov-commenter edited a comment on pull request #3128:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3128: [HUDI-2029] Implement compression for DiskBasedMap in Spillable Map

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3128: URL: https://github.com/apache/hudi/pull/3128#issuecomment-865384115 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3271: [Minor] Correct the logs of enable/not-enable async cleaner service.

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3271: URL: https://github.com/apache/hudi/pull/3271#issuecomment-879603223 #

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380336#comment-17380336 ] Vinoth Chandar commented on HUDI-2151: -- Row writing   {code:java} val ENABLE_ROW_WRITER_OPT_KEY:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380331#comment-17380331 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380332#comment-17380332 ] Vinoth Chandar commented on HUDI-2151: -- Should have hive style partitioning by default. but is it

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * ab0bf2d7ea7dae58a4c78bc4f4fdec7ec5c2be84 Azure:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380329#comment-17380329 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #3233: URL:

[jira] [Commented] (HUDI-2029) Implement compression for DiskBasedMap in Spillable Map

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380330#comment-17380330 ] ASF GitHub Bot commented on HUDI-2029: -- codecov-commenter edited a comment on pull request #3128:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3128: [HUDI-2029] Implement compression for DiskBasedMap in Spillable Map

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3128: URL: https://github.com/apache/hudi/pull/3128#issuecomment-865384115 #

[GitHub] [hudi] yihua commented on a change in pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-13 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r669295889 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java ## @@ -210,6 +212,21 @@ .defaultValue("1500")

[jira] [Commented] (HUDI-2029) Implement compression for DiskBasedMap in Spillable Map

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380328#comment-17380328 ] ASF GitHub Bot commented on HUDI-2029: -- hudi-bot edited a comment on pull request #3128: URL:

[GitHub] [hudi] codecov-commenter commented on pull request #3271: [Minor] Correct the logs of enable/not-enable async cleaner service.

2021-07-13 Thread GitBox
codecov-commenter commented on pull request #3271: URL: https://github.com/apache/hudi/pull/3271#issuecomment-879603223 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3271?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] hudi-bot edited a comment on pull request #3128: [HUDI-2029] Implement compression for DiskBasedMap in Spillable Map

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3128: URL: https://github.com/apache/hudi/pull/3128#issuecomment-865345707 ## CI report: * 2f8c0835c87a73417c3c0c05f1d515b61acba352 Azure:

[jira] [Commented] (HUDI-2029) Implement compression for DiskBasedMap in Spillable Map

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380327#comment-17380327 ] ASF GitHub Bot commented on HUDI-2029: -- hudi-bot edited a comment on pull request #3128: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3271: [Minor] Correct the logs of enable/not-enable async cleaner service.

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3271: URL: https://github.com/apache/hudi/pull/3271#issuecomment-879601366 ## CI report: * e64b9c4b2e0a89804b63f9069aa91766c778dee1 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3128: [HUDI-2029] Implement compression for DiskBasedMap in Spillable Map

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3128: URL: https://github.com/apache/hudi/pull/3128#issuecomment-865345707 ## CI report: * 2f8c0835c87a73417c3c0c05f1d515b61acba352 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3271: [Minor] Correct the logs of enable/not-enable async cleaner service.

2021-07-13 Thread GitBox
hudi-bot commented on pull request #3271: URL: https://github.com/apache/hudi/pull/3271#issuecomment-879601366 ## CI report: * e64b9c4b2e0a89804b63f9069aa91766c778dee1 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] zhangyue19921010 opened a new pull request #3271: [Minor] Correct the logs of enable/not-enable async cleaner service.

2021-07-13 Thread GitBox
zhangyue19921010 opened a new pull request #3271: URL: https://github.com/apache/hudi/pull/3271 ## What is the purpose of the pull request According to

[jira] [Commented] (HUDI-2029) Implement compression for DiskBasedMap in Spillable Map

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380325#comment-17380325 ] ASF GitHub Bot commented on HUDI-2029: -- rmahindra123 commented on a change in pull request #3128:

[GitHub] [hudi] rmahindra123 commented on a change in pull request #3128: [HUDI-2029] Implement compression for DiskBasedMap in Spillable Map

2021-07-13 Thread GitBox
rmahindra123 commented on a change in pull request #3128: URL: https://github.com/apache/hudi/pull/3128#discussion_r669296999 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/collection/ExternalSpillableMap.java ## @@ -108,7 +116,7 @@ public

[jira] [Commented] (HUDI-2029) Implement compression for DiskBasedMap in Spillable Map

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380324#comment-17380324 ] ASF GitHub Bot commented on HUDI-2029: -- rmahindra123 commented on a change in pull request #3128:

[GitHub] [hudi] rmahindra123 commented on a change in pull request #3128: [HUDI-2029] Implement compression for DiskBasedMap in Spillable Map

2021-07-13 Thread GitBox
rmahindra123 commented on a change in pull request #3128: URL: https://github.com/apache/hudi/pull/3128#discussion_r669296725 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/collection/BitCaskDiskMap.java ## @@ -399,4 +419,47 @@ public int

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380321#comment-17380321 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * ab0bf2d7ea7dae58a4c78bc4f4fdec7ec5c2be84 Azure:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380319#comment-17380319 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * de5c236d0567aefb871a79ad189de64979c09e3c Azure:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380317#comment-17380317 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * de5c236d0567aefb871a79ad189de64979c09e3c Azure:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380316#comment-17380316 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [WIP][HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * de5c236d0567aefb871a79ad189de64979c09e3c Azure:

[jira] [Commented] (HUDI-2165) Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380312#comment-17380312 ] ASF GitHub Bot commented on HUDI-2165: -- codecov-commenter edited a comment on pull request #3270:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3270: [HUDI-2165] Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3270: URL: https://github.com/apache/hudi/pull/3270#issuecomment-879564503 #

[jira] [Commented] (HUDI-2165) Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380311#comment-17380311 ] ASF GitHub Bot commented on HUDI-2165: -- codecov-commenter edited a comment on pull request #3270:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3270: [HUDI-2165] Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3270: URL: https://github.com/apache/hudi/pull/3270#issuecomment-879564503 #

[jira] [Commented] (HUDI-2169) Remove keyby when write.operation is Insert

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380310#comment-17380310 ] ASF GitHub Bot commented on HUDI-2169: -- codecov-commenter edited a comment on pull request #3265:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3265: [HUDI-2169] Remove keyby when write.operation is Insert

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3265: URL: https://github.com/apache/hudi/pull/3265#issuecomment-879092298 #

[jira] [Commented] (HUDI-2169) Remove keyby when write.operation is Insert

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380308#comment-17380308 ] ASF GitHub Bot commented on HUDI-2169: -- codecov-commenter edited a comment on pull request #3265:

[jira] [Commented] (HUDI-2169) Remove keyby when write.operation is Insert

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380309#comment-17380309 ] ASF GitHub Bot commented on HUDI-2169: -- codecov-commenter edited a comment on pull request #3265:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3265: [HUDI-2169] Remove keyby when write.operation is Insert

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3265: URL: https://github.com/apache/hudi/pull/3265#issuecomment-879092298 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3265: [HUDI-2169] Remove keyby when write.operation is Insert

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3265: URL: https://github.com/apache/hudi/pull/3265#issuecomment-879092298 #

[jira] [Commented] (HUDI-2165) Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380305#comment-17380305 ] ASF GitHub Bot commented on HUDI-2165: -- hudi-bot edited a comment on pull request #3270: URL:

[jira] [Commented] (HUDI-2169) Remove keyby when write.operation is Insert

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380304#comment-17380304 ] ASF GitHub Bot commented on HUDI-2169: -- hudi-bot edited a comment on pull request #3265: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3270: [HUDI-2165] Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3270: URL: https://github.com/apache/hudi/pull/3270#issuecomment-879562426 ## CI report: * 6024de614086b733b02ac1c90df69272fe805a09 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3265: [HUDI-2169] Remove keyby when write.operation is Insert

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3265: URL: https://github.com/apache/hudi/pull/3265#issuecomment-878849489 ## CI report: * 51dfe371633d9b7336d8d083a0c71ca9d15ebb9a Azure:

[jira] [Commented] (HUDI-2165) Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380302#comment-17380302 ] ASF GitHub Bot commented on HUDI-2165: -- codecov-commenter edited a comment on pull request #3270:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3270: [HUDI-2165] Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3270: URL: https://github.com/apache/hudi/pull/3270#issuecomment-879564503 #

[jira] [Commented] (HUDI-2169) Remove keyby when write.operation is Insert

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380301#comment-17380301 ] ASF GitHub Bot commented on HUDI-2169: -- codecov-commenter edited a comment on pull request #3265:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3265: [HUDI-2169] Remove keyby when write.operation is Insert

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3265: URL: https://github.com/apache/hudi/pull/3265#issuecomment-879092298 #

[jira] [Commented] (HUDI-2165) Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380297#comment-17380297 ] ASF GitHub Bot commented on HUDI-2165: -- codecov-commenter edited a comment on pull request #3270:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3270: [HUDI-2165] Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3270: URL: https://github.com/apache/hudi/pull/3270#issuecomment-879564503 #

[jira] [Commented] (HUDI-2169) Remove keyby when write.operation is Insert

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380296#comment-17380296 ] ASF GitHub Bot commented on HUDI-2169: -- codecov-commenter edited a comment on pull request #3265:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3265: [HUDI-2169] Remove keyby when write.operation is Insert

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3265: URL: https://github.com/apache/hudi/pull/3265#issuecomment-879092298 #

[jira] [Updated] (HUDI-2178) Virtual keys support for Clustering

2021-07-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2178: -- Fix Version/s: 0.9.0 > Virtual keys support for Clustering >

[jira] [Updated] (HUDI-2179) Virtual keys support for Metadata table

2021-07-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2179: -- Fix Version/s: 0.9.0 > Virtual keys support for Metadata table >

[jira] [Updated] (HUDI-2177) Virtual keys support for Compaction

2021-07-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2177: -- Fix Version/s: 0.9.0 > Virtual keys support for Compaction >

[jira] [Created] (HUDI-2179) Virtual keys support for Metadata table

2021-07-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2179: - Summary: Virtual keys support for Metadata table Key: HUDI-2179 URL: https://issues.apache.org/jira/browse/HUDI-2179 Project: Apache Hudi Issue

[jira] [Created] (HUDI-2177) Virtual keys support for Compaction

2021-07-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2177: - Summary: Virtual keys support for Compaction Key: HUDI-2177 URL: https://issues.apache.org/jira/browse/HUDI-2177 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-2178) Virtual keys support for Clustering

2021-07-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2178: - Summary: Virtual keys support for Clustering Key: HUDI-2178 URL: https://issues.apache.org/jira/browse/HUDI-2178 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-2176) Virutal keys support for COW all operations

2021-07-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2176: -- Fix Version/s: 0.9.0 > Virutal keys support for COW all operations >

[jira] [Created] (HUDI-2176) Virutal keys support for COW all operations

2021-07-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2176: - Summary: Virutal keys support for COW all operations Key: HUDI-2176 URL: https://issues.apache.org/jira/browse/HUDI-2176 Project: Apache Hudi

[jira] [Commented] (HUDI-2165) Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380288#comment-17380288 ] ASF GitHub Bot commented on HUDI-2165: -- codecov-commenter commented on pull request #3270: URL:

[GitHub] [hudi] codecov-commenter commented on pull request #3270: [HUDI-2165] Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread GitBox
codecov-commenter commented on pull request #3270: URL: https://github.com/apache/hudi/pull/3270#issuecomment-879564503 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3270?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[jira] [Commented] (HUDI-2165) Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380285#comment-17380285 ] ASF GitHub Bot commented on HUDI-2165: -- hudi-bot edited a comment on pull request #3270: URL:

[jira] [Commented] (HUDI-2169) Remove keyby when write.operation is Insert

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380286#comment-17380286 ] ASF GitHub Bot commented on HUDI-2169: -- codecov-commenter edited a comment on pull request #3265:

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3265: [HUDI-2169] Remove keyby when write.operation is Insert

2021-07-13 Thread GitBox
codecov-commenter edited a comment on pull request #3265: URL: https://github.com/apache/hudi/pull/3265#issuecomment-879092298 #

[GitHub] [hudi] hudi-bot edited a comment on pull request #3270: [HUDI-2165] Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3270: URL: https://github.com/apache/hudi/pull/3270#issuecomment-879562426 ## CI report: * 6024de614086b733b02ac1c90df69272fe805a09 Azure:

[jira] [Commented] (HUDI-2165) Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380283#comment-17380283 ] ASF GitHub Bot commented on HUDI-2165: -- hudi-bot commented on pull request #3270: URL:

[GitHub] [hudi] hudi-bot commented on pull request #3270: [HUDI-2165] Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread GitBox
hudi-bot commented on pull request #3270: URL: https://github.com/apache/hudi/pull/3270#issuecomment-879562426 ## CI report: * 6024de614086b733b02ac1c90df69272fe805a09 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Updated] (HUDI-2165) Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2165: - Labels: pull-request-available (was: ) > Support Transformer for HoodieFlinkStreamer >

[jira] [Commented] (HUDI-2169) Remove keyby when write.operation is Insert

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380280#comment-17380280 ] ASF GitHub Bot commented on HUDI-2169: -- hudi-bot edited a comment on pull request #3265: URL:

[jira] [Commented] (HUDI-2165) Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380281#comment-17380281 ] ASF GitHub Bot commented on HUDI-2165: -- yanghua opened a new pull request #3270: URL:

[jira] [Commented] (HUDI-1860) Add INSERT_OVERWRITE support to DeltaStreamer

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380279#comment-17380279 ] ASF GitHub Bot commented on HUDI-1860: -- Samrat002 commented on a change in pull request #3184: URL:

[GitHub] [hudi] yanghua opened a new pull request #3270: [HUDI-2165] Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread GitBox
yanghua opened a new pull request #3270: URL: https://github.com/apache/hudi/pull/3270 ## What is the purpose of the pull request *This pull request supports transformer feature for HoodieFlinkStreamer* ## Brief change log - *Support Transformer for

[GitHub] [hudi] hudi-bot edited a comment on pull request #3265: [HUDI-2169] Remove keyby when write.operation is Insert

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3265: URL: https://github.com/apache/hudi/pull/3265#issuecomment-878849489 ## CI report: * af7d3b2179747b4bd5261503fba446cc2aa57f23 Azure:

[GitHub] [hudi] Samrat002 commented on a change in pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer

2021-07-13 Thread GitBox
Samrat002 commented on a change in pull request #3184: URL: https://github.com/apache/hudi/pull/3184#discussion_r669257559 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkInsertOverwriteCommitActionExecutor.java ## @@ -66,11

[jira] [Commented] (HUDI-2169) Remove keyby when write.operation is Insert

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380278#comment-17380278 ] ASF GitHub Bot commented on HUDI-2169: -- hudi-bot edited a comment on pull request #3265: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3265: [HUDI-2169] Remove keyby when write.operation is Insert

2021-07-13 Thread GitBox
hudi-bot edited a comment on pull request #3265: URL: https://github.com/apache/hudi/pull/3265#issuecomment-878849489 ## CI report: * af7d3b2179747b4bd5261503fba446cc2aa57f23 Azure:

[jira] [Commented] (HUDI-1860) Add INSERT_OVERWRITE support to DeltaStreamer

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380276#comment-17380276 ] ASF GitHub Bot commented on HUDI-1860: -- Samrat002 edited a comment on pull request #3184: URL:

[jira] [Assigned] (HUDI-2165) Support Transformer for HoodieFlinkStreamer

2021-07-13 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-2165: -- Assignee: vinoyang > Support Transformer for HoodieFlinkStreamer >

[GitHub] [hudi] Samrat002 edited a comment on pull request #3184: [HUDI-1860] Add INSERT_OVERWRITE and INSERT_OVERWRITE_TABLE support to DeltaStreamer

2021-07-13 Thread GitBox
Samrat002 edited a comment on pull request #3184: URL: https://github.com/apache/hudi/pull/3184#issuecomment-879154991 @hudi-bot run travis -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (HUDI-2164) Build cluster plan and execute this plan at once for HoodieClusteringJob

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380271#comment-17380271 ] ASF GitHub Bot commented on HUDI-2164: -- zhangyue19921010 commented on pull request #3259: URL:

[GitHub] [hudi] zhangyue19921010 commented on pull request #3259: [HUDI-2164] Let users build cluster plan and execute this plan at once using HoodieClusteringJob for async clustering

2021-07-13 Thread GitBox
zhangyue19921010 commented on pull request #3259: URL: https://github.com/apache/hudi/pull/3259#issuecomment-879554232 Hi @satishkotha and @lw309637554 , sorry to bother you. Could you please take a look at this patch at your convince? I believe it is worth a little attention here.

[jira] [Updated] (HUDI-2175) Support dynamic schemas with hudi

2021-07-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2175: -- Component/s: Common Core > Support dynamic schemas with hudi >

[jira] [Created] (HUDI-2175) Support dynamic schemas with hudi

2021-07-13 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2175: - Summary: Support dynamic schemas with hudi Key: HUDI-2175 URL: https://issues.apache.org/jira/browse/HUDI-2175 Project: Apache Hudi Issue Type:

[jira] [Commented] (HUDI-1548) Fix documentation around schema evolution

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380218#comment-17380218 ] ASF GitHub Bot commented on HUDI-1548: -- nsivabalan commented on a change in pull request #3257: URL:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3257: [HUDI-1548] Add documentation for schema evolution

2021-07-13 Thread GitBox
nsivabalan commented on a change in pull request #3257: URL: https://github.com/apache/hudi/pull/3257#discussion_r669171486 ## File path: docs/_docs/2_2_writing_data.md ## @@ -424,3 +424,192 @@ Here are some ways to efficiently manage the storage of your Hudi tables. -

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380210#comment-17380210 ] Vinoth Chandar commented on HUDI-2151: -- Should this be smaller than the target file size? Would n't

[jira] [Comment Edited] (HUDI-2150) Rename/Restructure configs for better modularity

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380201#comment-17380201 ] Vinoth Chandar edited comment on HUDI-2150 at 7/13/21, 10:12 PM: -

[jira] [Commented] (HUDI-2150) Rename/Restructure configs for better modularity

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380201#comment-17380201 ] Vinoth Chandar commented on HUDI-2150: -- Generalize for other base file formats?   {code:java} public

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380198#comment-17380198 ] Vinoth Chandar commented on HUDI-2151: -- marker based rollback should be on   {code:java} public

[jira] [Assigned] (HUDI-2174) Simplify the amount of configs that need to be passed in for Spark Datasource writer

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-2174: Assignee: Vinoth Chandar > Simplify the amount of configs that need to be passed in for

[jira] [Updated] (HUDI-2174) Simplify the amount of configs that need to be passed in for Spark Datasource writer

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2174: - Fix Version/s: 0.9.0 > Simplify the amount of configs that need to be passed in for Spark

[jira] [Created] (HUDI-2174) Simplify the amount of configs that need to be passed in for Spark Datasource writer

2021-07-13 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-2174: Summary: Simplify the amount of configs that need to be passed in for Spark Datasource writer Key: HUDI-2174 URL: https://issues.apache.org/jira/browse/HUDI-2174

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380196#comment-17380196 ] Vinoth Chandar commented on HUDI-2151: -- Should these be true?   {code:java} public static final

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380195#comment-17380195 ] Vinoth Chandar commented on HUDI-2151: -- These parallelisms seem low   {code:java} public static

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380194#comment-17380194 ] Vinoth Chandar commented on HUDI-2151: -- Dynamic bloom filters.   {code:java} public static final

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380190#comment-17380190 ] Vinoth Chandar commented on HUDI-2151: -- Should this be higher? If typical record sizes are large? (or

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-07-13 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380181#comment-17380181 ] Vinoth Chandar commented on HUDI-2151: -- Should n't we have a default index type?   {code:java}

  1   2   3   4   >