[GitHub] [incubator-hudi] yihua commented on issue #1165: [HUDI-76] Add CSV Source support for Hudi Delta Streamer

2020-03-10 Thread GitBox
yihua commented on issue #1165: [HUDI-76] Add CSV Source support for Hudi Delta Streamer URL: https://github.com/apache/incubator-hudi/pull/1165#issuecomment-597457998 > One question about using nested schema. Can you remind me what happens if someone passes in a nested schema for

[GitHub] [incubator-hudi] bvaradar commented on issue #1392: [HUDI-689] Change CLI command names to not have overlap

2020-03-10 Thread GitBox
bvaradar commented on issue #1392: [HUDI-689] Change CLI command names to not have overlap URL: https://github.com/apache/incubator-hudi/pull/1392#issuecomment-597434910 @nsivabalan : Please review this PR This is an

[GitHub] [incubator-hudi] bvaradar commented on issue #1395: [HUDI-667] Fixing delete tests for DeltaStreamer

2020-03-10 Thread GitBox
bvaradar commented on issue #1395: [HUDI-667] Fixing delete tests for DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1395#issuecomment-597434678 @lamber-ken : Can you review this PR. This is an automated

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly

2020-03-10 Thread GitBox
lamber-ken edited a comment on issue #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly URL: https://github.com/apache/incubator-hudi/pull/1377#issuecomment-597431353 Sorry, I revert it, hudi already handled the empty checkpoint by

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly

2020-03-10 Thread GitBox
lamber-ken edited a comment on issue #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly URL: https://github.com/apache/incubator-hudi/pull/1377#issuecomment-597431353 Sorry, I revert it, hudi already handled the empty checkpoint by

[GitHub] [incubator-hudi] lamber-ken commented on issue #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly

2020-03-10 Thread GitBox
lamber-ken commented on issue #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly URL: https://github.com/apache/incubator-hudi/pull/1377#issuecomment-597431353 Sorry, I revert it, already handled the empty checkpoint by `KafkaOffsetGen.KafkaResetOffsetStrategies`

[GitHub] [incubator-hudi] codecov-io commented on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction

2020-03-10 Thread GitBox
codecov-io commented on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction URL: https://github.com/apache/incubator-hudi/pull/1396#issuecomment-597430876 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1396?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] lamber-ken commented on issue #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly

2020-03-10 Thread GitBox
lamber-ken commented on issue #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly URL: https://github.com/apache/incubator-hudi/pull/1377#issuecomment-597428982 Thanks for reviewing @garyli1019 @vinothchandar. Had updated the pr by double check empty checkpoint in

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #213

2020-03-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.33 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[GitHub] [incubator-hudi] codecov-io commented on issue #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly

2020-03-10 Thread GitBox
codecov-io commented on issue #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly URL: https://github.com/apache/incubator-hudi/pull/1377#issuecomment-597426610 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1377?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] satishkotha commented on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction

2020-03-10 Thread GitBox
satishkotha commented on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction URL: https://github.com/apache/incubator-hudi/pull/1396#issuecomment-597421941 @bvaradar sorry, I messed up rebase on https://github.com/apache/incubator-hudi/pull/1389, Please

[GitHub] [incubator-hudi] satishkotha opened a new pull request #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction

2020-03-10 Thread GitBox
satishkotha opened a new pull request #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction URL: https://github.com/apache/incubator-hudi/pull/1396 ## What is the purpose of the pull request example timeline: t0 -> create bucket1.parquet t1 ->

[GitHub] [incubator-hudi] satishkotha closed pull request #1389: [HUDI-687] Stop incremental reader when there is a pending compaction…

2020-03-10 Thread GitBox
satishkotha closed pull request #1389: [HUDI-687] Stop incremental reader when there is a pending compaction… URL: https://github.com/apache/incubator-hudi/pull/1389 This is an automated message from the Apache Git Service.

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1389: [HUDI-687] Stop incremental reader when there is a pending compaction…

2020-03-10 Thread GitBox
codecov-io edited a comment on issue #1389: [HUDI-687] Stop incremental reader when there is a pending compaction… URL: https://github.com/apache/incubator-hudi/pull/1389#issuecomment-596951199 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1389?src=pr=h1) Report >

[GitHub] [incubator-hudi] codecov-io commented on issue #1394: [HUDI-656][Performance] Return a dummy Spark relation after writing the DataFrame

2020-03-10 Thread GitBox
codecov-io commented on issue #1394: [HUDI-656][Performance] Return a dummy Spark relation after writing the DataFrame URL: https://github.com/apache/incubator-hudi/pull/1394#issuecomment-597393691 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1394?src=pr=h1) Report >

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly

2020-03-10 Thread GitBox
lamber-ken commented on a change in pull request #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly URL: https://github.com/apache/incubator-hudi/pull/1377#discussion_r390695516 ## File path:

[GitHub] [incubator-hudi] satishkotha commented on issue #1389: [HUDI-687] Stop incremental reader when there is a pending compaction…

2020-03-10 Thread GitBox
satishkotha commented on issue #1389: [HUDI-687] Stop incremental reader when there is a pending compaction… URL: https://github.com/apache/incubator-hudi/pull/1389#issuecomment-597385302 looks like i messed up merging. i'm going to close this one and open a new PR. sorry about noise

[GitHub] [incubator-hudi] nsivabalan closed pull request #1393: [WIP] Fixing delta streamer tests.

2020-03-10 Thread GitBox
nsivabalan closed pull request #1393: [WIP] Fixing delta streamer tests. URL: https://github.com/apache/incubator-hudi/pull/1393 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [incubator-hudi] nsivabalan opened a new pull request #1395: [HUDI-667] Fixing delete tests for DeltaStreamer

2020-03-10 Thread GitBox
nsivabalan opened a new pull request #1395: [HUDI-667] Fixing delete tests for DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1395 PR fixes a bug in delete record generation for tests in hoodie delta streamer. ## Brief change log - Fixing a bug in delete

[jira] [Updated] (HUDI-667) HoodieTestDataGenerator does not delete keys correctly

2020-03-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-667: Labels: pull-request-available (was: ) > HoodieTestDataGenerator does not delete keys correctly >

[jira] [Updated] (HUDI-656) Write Performance - Driver spends too much time creating Parquet DataSource after writes

2020-03-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-656: Labels: pull-request-available (was: ) > Write Performance - Driver spends too much time creating

[GitHub] [incubator-hudi] umehrot2 opened a new pull request #1394: [HUDI-656][Performance] Return a dummy Spark relation after writing the DataFrame

2020-03-10 Thread GitBox
umehrot2 opened a new pull request #1394: [HUDI-656][Performance] Return a dummy Spark relation after writing the DataFrame URL: https://github.com/apache/incubator-hudi/pull/1394 ## What is the purpose of the pull request This PR fixes the performance issue mentioned in

[GitHub] [incubator-hudi] bhasudha closed issue #910: hoodie.*.consume.* should be set whitelist in hive-site.xml

2020-03-10 Thread GitBox
bhasudha closed issue #910: hoodie.*.consume.* should be set whitelist in hive-site.xml URL: https://github.com/apache/incubator-hudi/issues/910 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] bhasudha commented on issue #910: hoodie.*.consume.* should be set whitelist in hive-site.xml

2020-03-10 Thread GitBox
bhasudha commented on issue #910: hoodie.*.consume.* should be set whitelist in hive-site.xml URL: https://github.com/apache/incubator-hudi/issues/910#issuecomment-597340894 > @bhasudha : Can you kindly let me know if this is documented so that we can close this ticket. This is not

[jira] [Created] (HUDI-691) hoodie.*.consume.* should be set whitelist in hive-site.xml

2020-03-10 Thread Bhavani Sudha (Jira)
Bhavani Sudha created HUDI-691: -- Summary: hoodie.*.consume.* should be set whitelist in hive-site.xml Key: HUDI-691 URL: https://issues.apache.org/jira/browse/HUDI-691 Project: Apache Hudi (incubating)

[jira] [Comment Edited] (HUDI-690) filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables

2020-03-10 Thread Jasmine Omeke (Jira)
[ https://issues.apache.org/jira/browse/HUDI-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056437#comment-17056437 ] Jasmine Omeke edited comment on HUDI-690 at 3/10/20, 9:42 PM: -- pinging to

[jira] [Commented] (HUDI-690) filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables

2020-03-10 Thread Jasmine Omeke (Jira)
[ https://issues.apache.org/jira/browse/HUDI-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056437#comment-17056437 ] Jasmine Omeke commented on HUDI-690:   [~vbalaji] > filtercompletedInstants in HudiSnapshotCopier not

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390527605 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,31 @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390471157 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,31 @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390505002 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,31 @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390622214 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,31 @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390622859 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,31 @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390621530 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,31 @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390528487 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,31 @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390527272 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,31 @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390527950 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,31 @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
bvaradar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390623457 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,31 @@

[GitHub] [incubator-hudi] yihua commented on issue #1165: [HUDI-76] Add CSV Source support for Hudi Delta Streamer

2020-03-10 Thread GitBox
yihua commented on issue #1165: [HUDI-76] Add CSV Source support for Hudi Delta Streamer URL: https://github.com/apache/incubator-hudi/pull/1165#issuecomment-597292426 Sorry for the delay. I'll get to this PR this week.

[GitHub] [incubator-hudi] nsivabalan opened a new pull request #1393: [WIP] Fixing delta streamer tests.

2020-03-10 Thread GitBox
nsivabalan opened a new pull request #1393: [WIP] Fixing delta streamer tests. URL: https://github.com/apache/incubator-hudi/pull/1393 WIP. Draft PR. ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2020-03-10 Thread GitBox
prashantwason commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r390562273 ## File path:

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2020-03-10 Thread GitBox
nsivabalan commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r390557620 ## File path:

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2020-03-10 Thread GitBox
nsivabalan commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r390557169 ## File path: hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.java

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2020-03-10 Thread GitBox
prashantwason commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r390555211 ## File path:

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2020-03-10 Thread GitBox
prashantwason commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r390553417 ## File path: hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.java

[jira] [Created] (HUDI-690) filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables

2020-03-10 Thread Jasmine Omeke (Jira)
Jasmine Omeke created HUDI-690: -- Summary: filtercompletedInstants in HudiSnapshotCopier not working as expected for MOR tables Key: HUDI-690 URL: https://issues.apache.org/jira/browse/HUDI-690 Project:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
vinothchandar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390530073 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,31

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
vinothchandar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390531386 ## File path: docs/_pages/releases.md ## @@ -6,6 +6,31 @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
vinothchandar commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390529875 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,31

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1392: [HUDI-689] Change CLI command names to not have overlap

2020-03-10 Thread GitBox
codecov-io edited a comment on issue #1392: [HUDI-689] Change CLI command names to not have overlap URL: https://github.com/apache/incubator-hudi/pull/1392#issuecomment-597241101 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1392?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io commented on issue #1392: [HUDI-689] Change CLI command names to not have overlap

2020-03-10 Thread GitBox
codecov-io commented on issue #1392: [HUDI-689] Change CLI command names to not have overlap URL: https://github.com/apache/incubator-hudi/pull/1392#issuecomment-597241101 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1392?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] satishkotha commented on issue #1389: [HUDI-687] Stop incremental reader when there is a pending compaction…

2020-03-10 Thread GitBox
satishkotha commented on issue #1389: [HUDI-687] Stop incremental reader when there is a pending compaction… URL: https://github.com/apache/incubator-hudi/pull/1389#issuecomment-597231598 > @satishkotha : I did a quick look. Will do a more comprehensive review later. > > One quick

[jira] [Updated] (HUDI-687) incremental reads on MOR tables using RO view can lead to missing updates

2020-03-10 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan updated HUDI-687: Summary: incremental reads on MOR tables using RO view can lead to missing updates (was:

[GitHub] [incubator-hudi] bvaradar commented on issue #1389: [HUDI-687] Stop incremental reader when there is a pending compaction…

2020-03-10 Thread GitBox
bvaradar commented on issue #1389: [HUDI-687] Stop incremental reader when there is a pending compaction… URL: https://github.com/apache/incubator-hudi/pull/1389#issuecomment-597229288 @satishkotha : Also, Spark DataSource for Incremental reads needs to employ similar mechanism

[jira] [Updated] (HUDI-687) incremental reads on MOR RO tables can lead to data loss

2020-03-10 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish updated HUDI-687: Summary: incremental reads on MOR RO tables can lead to data loss (was: incremental reads on MOR tables can lead to

[jira] [Commented] (HUDI-687) incremental reads on MOR tables can lead to data loss

2020-03-10 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056186#comment-17056186 ] Balaji Varadarajan commented on HUDI-687: - cc [~vinothchandar]  Just to be really clear, the

[GitHub] [incubator-hudi] satishkotha opened a new pull request #1392: [HUDI-689] Change CLI command names to not have overlap

2020-03-10 Thread GitBox
satishkotha opened a new pull request #1392: [HUDI-689] Change CLI command names to not have overlap URL: https://github.com/apache/incubator-hudi/pull/1392 ## What is the purpose of the pull request I broke CLI when i added compactions show archived command. I still dont understand

[jira] [Updated] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-689: Labels: pull-request-available (was: ) > Fix hudi cli commands with overlapping words >

[jira] [Commented] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056166#comment-17056166 ] Balaji Varadarajan commented on HUDI-689: - [~satishkotha] : Can you add more context for this

[jira] [Updated] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan updated HUDI-689: Status: Open (was: New) > Fix hudi cli commands with overlapping words >

[jira] [Updated] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish updated HUDI-689: Description: CLI 'commits show archived' fails with {code} ->commits show archived Option '' is not available for

[jira] [Updated] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish updated HUDI-689: Labels: (was: pull-request-available) > Fix hudi cli commands with overlapping words >

[jira] [Created] (HUDI-689) Fix hudi cli commands with overlap

2020-03-10 Thread satish (Jira)
satish created HUDI-689: --- Summary: Fix hudi cli commands with overlap Key: HUDI-689 URL: https://issues.apache.org/jira/browse/HUDI-689 Project: Apache Hudi (incubating) Issue Type: Improvement

[jira] [Updated] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish updated HUDI-689: Summary: Fix hudi cli commands with overlapping words (was: Fix hudi cli commands with overlap) > Fix hudi cli

[jira] [Updated] (HUDI-689) Fix hudi cli commands with overlapping words

2020-03-10 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish updated HUDI-689: Description: was: example timeline: t0 -> create bucket1.parquet t1 -> create and append updates bucket1.log

[jira] [Resolved] (HUDI-669) HoodieDeltaStreamer offset not handled correctly when using LATEST offset reset strategy

2020-03-10 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan resolved HUDI-669. - Resolution: Duplicate > HoodieDeltaStreamer offset not handled correctly when using LATEST

[jira] [Commented] (HUDI-669) HoodieDeltaStreamer offset not handled correctly when using LATEST offset reset strategy

2020-03-10 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056140#comment-17056140 ] Balaji Varadarajan commented on HUDI-669: - THanks [~lamber-ken]. Closing this as duplicate >

[GitHub] [incubator-hudi] codecov-io commented on issue #1391: [HUDI-688] Paring down the NOTICE file to minimum required notices

2020-03-10 Thread GitBox
codecov-io commented on issue #1391: [HUDI-688] Paring down the NOTICE file to minimum required notices URL: https://github.com/apache/incubator-hudi/pull/1391#issuecomment-597203280 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1391?src=pr=h1) Report > Merging

[jira] [Updated] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-662: Fix Version/s: (was: 0.5.2) > Attribute binary dependencies that are included in the bundle jars

[jira] [Commented] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056136#comment-17056136 ] Vinoth Chandar commented on HUDI-662: - We can again revisit this if needed.. untagging fix version >

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly

2020-03-10 Thread GitBox
bvaradar commented on a change in pull request #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly URL: https://github.com/apache/incubator-hudi/pull/1377#discussion_r390466238 ## File path:

[GitHub] [incubator-hudi] bvaradar closed issue #1359: [SUPPORT] handle partition value containing colon ?

2020-03-10 Thread GitBox
bvaradar closed issue #1359: [SUPPORT] handle partition value containing colon ? URL: https://github.com/apache/incubator-hudi/issues/1359 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] bvaradar commented on issue #1359: [SUPPORT] handle partition value containing colon ?

2020-03-10 Thread GitBox
bvaradar commented on issue #1359: [SUPPORT] handle partition value containing colon ? URL: https://github.com/apache/incubator-hudi/issues/1359#issuecomment-597184490 Closing this ticket due to inactivity. This is an

[jira] [Updated] (HUDI-688) Ensure NOTICE contains all notices for the dependencies called out in LICENSE

2020-03-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-688: Labels: pull-request-available (was: ) > Ensure NOTICE contains all notices for the dependencies

[GitHub] [incubator-hudi] vinothchandar opened a new pull request #1391: [HUDI-688] Paring down the NOTICE file to minimum required notices

2020-03-10 Thread GitBox
vinothchandar opened a new pull request #1391: [HUDI-688] Paring down the NOTICE file to minimum required notices URL: https://github.com/apache/incubator-hudi/pull/1391 - Based on analysis, we don't need to call out anything - We only do source releases at this time - Fix typo in

[jira] [Updated] (HUDI-680) Update Jackson databind to 2.6.7.3

2020-03-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-680: -- Fix Version/s: (was: 0.5.2) 0.6.0 > Update Jackson databind to 2.6.7.3 >

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
smarthi commented on a change in pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#discussion_r390284780 ## File path: docs/_pages/releases.cn.md ## @@ -7,6 +7,33 @@

[GitHub] [incubator-hudi] yanghua edited a comment on issue #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
yanghua edited a comment on issue #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#issuecomment-597037052 Please temporarily ignore those links.

[GitHub] [incubator-hudi] yanghua commented on issue #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
yanghua commented on issue #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390#issuecomment-597037052 Please temporarily ignore the those links.

[jira] [Updated] (HUDI-634) Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-634: Labels: pull-request-available (was: ) > Write release blog and document breaking changes for 0.5.2

[GitHub] [incubator-hudi] yanghua opened a new pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread GitBox
yanghua opened a new pull request #1390: [HUDI-634] Write release blog and document breaking changes for 0.5.2 release URL: https://github.com/apache/incubator-hudi/pull/1390 ## What is the purpose of the pull request *This pull request writes release blog and document

[jira] [Updated] (HUDI-634) Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-634: -- Summary: Write release blog and document breaking changes for 0.5.2 release (was: Document breaking changes for

[jira] [Commented] (HUDI-688) Ensure NOTICE contains all notices for the dependencies called out in LICENSE

2020-03-10 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055810#comment-17055810 ] Suneel Marthi commented on HUDI-688: We are back to what [~lresende] had suggested what the NOTICE file

[GitHub] [incubator-hudi] codecov-io commented on issue #1389: [HUDI-687] Stop incremental reader when there is a pending compaction…

2020-03-10 Thread GitBox
codecov-io commented on issue #1389: [HUDI-687] Stop incremental reader when there is a pending compaction… URL: https://github.com/apache/incubator-hudi/pull/1389#issuecomment-596951199 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1389?src=pr=h1) Report > Merging

[jira] [Commented] (HUDI-688) Ensure NOTICE contains all notices for the dependencies called out in LICENSE

2020-03-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055639#comment-17055639 ] vinoyang commented on HUDI-688: --- [~vinoth] IMO, we can follow druid's solution, since it's graduate date is

[jira] [Commented] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055637#comment-17055637 ] Vinoth Chandar commented on HUDI-662: - yes. Spark/Flink all provide binary distros... we only do source

[jira] [Commented] (HUDI-688) Ensure NOTICE contains all notices for the dependencies called out in LICENSE

2020-03-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055635#comment-17055635 ] Vinoth Chandar commented on HUDI-688: - https://github.com/apache/druid/blob/master/NOTICE simply

[jira] [Commented] (HUDI-634) Document breaking changes for 0.5.2 release

2020-03-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055636#comment-17055636 ] Vinoth Chandar commented on HUDI-634: - Yes.. we will flag it in the release highlights.. on the release

[GitHub] [incubator-hudi] vinothchandar commented on issue #1354: [HUDI-581] NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

2020-03-10 Thread GitBox
vinothchandar commented on issue #1354: [HUDI-581] NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files URL: https://github.com/apache/incubator-hudi/pull/1354#issuecomment-596925151 > Also, there shouldn't be a difference between the source and

[GitHub] [incubator-hudi] vinothchandar commented on issue #1354: [HUDI-581] NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

2020-03-10 Thread GitBox
vinothchandar commented on issue #1354: [HUDI-581] NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files URL: https://github.com/apache/incubator-hudi/pull/1354#issuecomment-596924478 @smarthi @yanghua I think we did this due to the following

[jira] [Commented] (HUDI-688) Ensure NOTICE contains all notices for the dependencies called out in LICENSE

2020-03-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055628#comment-17055628 ] vinoyang commented on HUDI-688: --- If we can make sure the recently graduated project also can verify our

[jira] [Commented] (HUDI-634) Document breaking changes for 0.5.2 release

2020-03-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055623#comment-17055623 ] vinoyang commented on HUDI-634: --- [~vinoth] I am browsing the commit history and jira issues that involved in

[jira] [Commented] (HUDI-688) Ensure NOTICE contains all notices for the dependencies called out in LICENSE

2020-03-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055621#comment-17055621 ] Vinoth Chandar commented on HUDI-688: - [~vinoyang] [~smarthi] based on this, dont think we need to add

[jira] [Commented] (HUDI-688) Ensure NOTICE contains all notices for the dependencies called out in LICENSE

2020-03-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055620#comment-17055620 ] Vinoth Chandar commented on HUDI-688: - Apache Hive NOTICE is clean :

[jira] [Commented] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055615#comment-17055615 ] vinoyang commented on HUDI-662: --- {quote}Apache Singa [https://github.com/apache/singa] follows same model,