Re: [DISCUSS] Apache Gobblin 0.15.0 release

2020-06-11 Thread Tamás Németh
+1 Tamas On Fri, 12 Jun 2020 at 07:45, Hung Tran wrote: > +1. > > Hung. > > From: Abhishek Tiwari > Sent: Thursday, June 11, 2020 10:36 PM > To: dev@gobblin.incubator.apache.org > Subject: [DISCUSS] Apache Gobblin 0.15.0 release > > Hi all, > > We have seen si

Re: [DISCUSS] Apache Gobblin 0.15.0 release

2020-06-11 Thread Hung Tran
+1. Hung. From: Abhishek Tiwari Sent: Thursday, June 11, 2020 10:36 PM To: dev@gobblin.incubator.apache.org Subject: [DISCUSS] Apache Gobblin 0.15.0 release Hi all, We have seen significant development in Gobblin since last release, so I propose that we do a ne

[DISCUSS] Apache Gobblin 0.15.0 release

2020-06-11 Thread Abhishek Tiwari
Hi all, We have seen significant development in Gobblin since last release, so I propose that we do a new release. I volunteer to be the release manager for it. What do folks think? The full list of changes (236 resolved Jiras for features, bug fix and improvements) since last release are here:

[jira] [Work logged] (GOBBLIN-1192) Container commit suicide if Helix task creation failed after retry

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1192?focusedWorklogId=444697&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444697 ] ASF GitHub Bot logged work on GOBBLIN-1192: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] sv2000 commented on a change in pull request #3040: [GOBBLIN-1192] Commit suicide if Helix Task creation failed after retry

2020-06-11 Thread GitBox
sv2000 commented on a change in pull request #3040: URL: https://github.com/apache/incubator-gobblin/pull/3040#discussion_r439181661 ## File path: gobblin-cluster/src/main/java/org/apache/gobblin/cluster/GobblinHelixTask.java ## @@ -194,6 +195,7 @@ private ContainerHealthCheck

[jira] [Work logged] (GOBBLIN-1187) cancel a gaas flow when the dag manager is disabled

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1187?focusedWorklogId=444690&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444690 ] ASF GitHub Bot logged work on GOBBLIN-1187: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] codecov-commenter edited a comment on pull request #3027: [GOBBLIN-1187] cancel flow execution when dag manager is disabled

2020-06-11 Thread GitBox
codecov-commenter edited a comment on pull request #3027: URL: https://github.com/apache/incubator-gobblin/pull/3027#issuecomment-641729270 # [Codecov](https://codecov.io/gh/apache/incubator-gobblin/pull/3027?src=pr&el=h1) Report > Merging [#3027](https://codecov.io/gh/apache/incubato

[jira] [Work logged] (GOBBLIN-1187) cancel a gaas flow when the dag manager is disabled

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1187?focusedWorklogId=444689&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444689 ] ASF GitHub Bot logged work on GOBBLIN-1187: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] codecov-commenter edited a comment on pull request #3027: [GOBBLIN-1187] cancel flow execution when dag manager is disabled

2020-06-11 Thread GitBox
codecov-commenter edited a comment on pull request #3027: URL: https://github.com/apache/incubator-gobblin/pull/3027#issuecomment-641729270 # [Codecov](https://codecov.io/gh/apache/incubator-gobblin/pull/3027?src=pr&el=h1) Report > Merging [#3027](https://codecov.io/gh/apache/incubato

[jira] [Work logged] (GOBBLIN-1187) cancel a gaas flow when the dag manager is disabled

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1187?focusedWorklogId=444674&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444674 ] ASF GitHub Bot logged work on GOBBLIN-1187: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] arjun4084346 commented on a change in pull request #3027: [GOBBLIN-1187] cancel flow execution when dag manager is disabled

2020-06-11 Thread GitBox
arjun4084346 commented on a change in pull request #3027: URL: https://github.com/apache/incubator-gobblin/pull/3027#discussion_r439162340 ## File path: gobblin-runtime/src/main/java/org/apache/gobblin/runtime/job_monitor/AvroJobSpecKafkaJobMonitor.java ## @@ -108,10 +102,10 @

[jira] [Work logged] (GOBBLIN-1192) Container commit suicide if Helix task creation failed after retry

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1192?focusedWorklogId=444667&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444667 ] ASF GitHub Bot logged work on GOBBLIN-1192: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] autumnust opened a new pull request #3040: [GOBBLIN-1192] Commit suicide if Helix Task creation failed after retry

2020-06-11 Thread GitBox
autumnust opened a new pull request #3040: URL: https://github.com/apache/incubator-gobblin/pull/3040 Dear Gobblin maintainers, Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below! ### JIRA - https://issues.apach

[jira] [Created] (GOBBLIN-1192) Container commit suicide if Helix task creation failed after retry

2020-06-11 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1192: Summary: Container commit suicide if Helix task creation failed after retry Key: GOBBLIN-1192 URL: https://issues.apache.org/jira/browse/GOBBLIN-1192 Project: Apache Gobblin

[GitHub] [incubator-gobblin] arjun4084346 commented on a change in pull request #3027: [GOBBLIN-1187] cancel flow execution when dag manager is disabled

2020-06-11 Thread GitBox
arjun4084346 commented on a change in pull request #3027: URL: https://github.com/apache/incubator-gobblin/pull/3027#discussion_r43919 ## File path: gobblin-runtime/src/main/java/org/apache/gobblin/runtime/job_catalog/NonObservingFSJobCatalog.java ## @@ -121,5 +125,11 @@ p

[jira] [Work logged] (GOBBLIN-1187) cancel a gaas flow when the dag manager is disabled

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1187?focusedWorklogId=444666&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444666 ] ASF GitHub Bot logged work on GOBBLIN-1187: --- Author: ASF GitHub B

[jira] [Work logged] (GOBBLIN-1185) Enable dataset cleaner to emit kafka events

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1185?focusedWorklogId=444661&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444661 ] ASF GitHub Bot logged work on GOBBLIN-1185: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] asfgit closed pull request #3033: [GOBBLIN-1185]Enable datasetCleaner to emit kafka event and add config field in Ver…

2020-06-11 Thread GitBox
asfgit closed pull request #3033: URL: https://github.com/apache/incubator-gobblin/pull/3033 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Work logged] (GOBBLIN-1187) cancel a gaas flow when the dag manager is disabled

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1187?focusedWorklogId=444660&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444660 ] ASF GitHub Bot logged work on GOBBLIN-1187: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] autumnust commented on a change in pull request #3027: [GOBBLIN-1187] cancel flow execution when dag manager is disabled

2020-06-11 Thread GitBox
autumnust commented on a change in pull request #3027: URL: https://github.com/apache/incubator-gobblin/pull/3027#discussion_r439150290 ## File path: gobblin-runtime/src/main/java/org/apache/gobblin/runtime/job_monitor/AvroJobSpecKafkaJobMonitor.java ## @@ -108,10 +102,10 @@ p

[GitHub] [incubator-gobblin] autumnust commented on a change in pull request #3039: GOBBLIN-1191: Reuse Helix instance names when containers are released…

2020-06-11 Thread GitBox
autumnust commented on a change in pull request #3039: URL: https://github.com/apache/incubator-gobblin/pull/3039#discussion_r439142383 ## File path: gobblin-yarn/src/main/java/org/apache/gobblin/yarn/YarnService.java ## @@ -192,7 +190,7 @@ // A queue of unused Helix instanc

[jira] [Work logged] (GOBBLIN-1191) Reuse Helix instance names when containers are released by Gobblin Application Master

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1191?focusedWorklogId=444654&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444654 ] ASF GitHub Bot logged work on GOBBLIN-1191: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] sv2000 opened a new pull request #3039: GOBBLIN-1191: Reuse Helix instance names when containers are released…

2020-06-11 Thread GitBox
sv2000 opened a new pull request #3039: URL: https://github.com/apache/incubator-gobblin/pull/3039 … by Gobblin Application Master Dear Gobblin maintainers, Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below!

[jira] [Work logged] (GOBBLIN-1191) Reuse Helix instance names when containers are released by Gobblin Application Master

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1191?focusedWorklogId=444643&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444643 ] ASF GitHub Bot logged work on GOBBLIN-1191: --- Author: ASF GitHub B

[jira] [Created] (GOBBLIN-1191) Reuse Helix instance names when containers are released by Gobblin Application Master

2020-06-11 Thread Sudarshan Vasudevan (Jira)
Sudarshan Vasudevan created GOBBLIN-1191: Summary: Reuse Helix instance names when containers are released by Gobblin Application Master Key: GOBBLIN-1191 URL: https://issues.apache.org/jira/browse/GOBBLIN

[jira] [Work logged] (GOBBLIN-1185) Enable dataset cleaner to emit kafka events

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1185?focusedWorklogId=444640&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444640 ] ASF GitHub Bot logged work on GOBBLIN-1185: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] codecov-commenter edited a comment on pull request #3033: [GOBBLIN-1185]Enable datasetCleaner to emit kafka event and add config field in Ver…

2020-06-11 Thread GitBox
codecov-commenter edited a comment on pull request #3033: URL: https://github.com/apache/incubator-gobblin/pull/3033#issuecomment-641647812 # [Codecov](https://codecov.io/gh/apache/incubator-gobblin/pull/3033?src=pr&el=h1) Report > Merging [#3033](https://codecov.io/gh/apache/incubato

[GitHub] [incubator-gobblin] autumnust commented on a change in pull request #3033: [GOBBLIN-1185]Enable datasetCleaner to emit kafka event and add config field in Ver…

2020-06-11 Thread GitBox
autumnust commented on a change in pull request #3033: URL: https://github.com/apache/incubator-gobblin/pull/3033#discussion_r439125481 ## File path: gobblin-data-management/src/main/java/org/apache/gobblin/data/management/retention/dataset/CleanableDatasetBase.java ## @@ -122

[jira] [Work logged] (GOBBLIN-1185) Enable dataset cleaner to emit kafka events

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1185?focusedWorklogId=444622&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444622 ] ASF GitHub Bot logged work on GOBBLIN-1185: --- Author: ASF GitHub B

[jira] [Work logged] (GOBBLIN-1185) Enable dataset cleaner to emit kafka events

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1185?focusedWorklogId=444590&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444590 ] ASF GitHub Bot logged work on GOBBLIN-1185: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] codecov-commenter edited a comment on pull request #3033: [GOBBLIN-1185]Enable datasetCleaner to emit kafka event and add config field in Ver…

2020-06-11 Thread GitBox
codecov-commenter edited a comment on pull request #3033: URL: https://github.com/apache/incubator-gobblin/pull/3033#issuecomment-641647812 # [Codecov](https://codecov.io/gh/apache/incubator-gobblin/pull/3033?src=pr&el=h1) Report > Merging [#3033](https://codecov.io/gh/apache/incubato

[jira] [Work logged] (GOBBLIN-1185) Enable dataset cleaner to emit kafka events

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1185?focusedWorklogId=444576&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444576 ] ASF GitHub Bot logged work on GOBBLIN-1185: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] ZihanLi58 commented on a change in pull request #3033: [GOBBLIN-1185]Enable datasetCleaner to emit kafka event and add config field in Ver…

2020-06-11 Thread GitBox
ZihanLi58 commented on a change in pull request #3033: URL: https://github.com/apache/incubator-gobblin/pull/3033#discussion_r439080847 ## File path: gobblin-data-management/src/main/java/org/apache/gobblin/data/management/retention/DatasetCleaner.java ## @@ -88,33 +94,43 @@

[jira] [Work logged] (GOBBLIN-1185) Enable dataset cleaner to emit kafka events

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1185?focusedWorklogId=444550&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444550 ] ASF GitHub Bot logged work on GOBBLIN-1185: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] ZihanLi58 commented on a change in pull request #3033: [GOBBLIN-1185]Enable datasetCleaner to emit kafka event and add config field in Ver…

2020-06-11 Thread GitBox
ZihanLi58 commented on a change in pull request #3033: URL: https://github.com/apache/incubator-gobblin/pull/3033#discussion_r439065562 ## File path: gobblin-modules/gobblin-kafka-09/src/test/java/org/apache/gobblin/kafka/writer/Kafka09DataWriterTest.java ## @@ -84,7 +84,7 @@

[jira] [Work logged] (GOBBLIN-1185) Enable dataset cleaner to emit kafka events

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1185?focusedWorklogId=444546&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444546 ] ASF GitHub Bot logged work on GOBBLIN-1185: --- Author: ASF GitHub B

[GitHub] [incubator-gobblin] autumnust commented on a change in pull request #3033: [GOBBLIN-1185]Enable datasetCleaner to emit kafka event and add config field in Ver…

2020-06-11 Thread GitBox
autumnust commented on a change in pull request #3033: URL: https://github.com/apache/incubator-gobblin/pull/3033#discussion_r439057712 ## File path: gobblin-data-management/src/main/java/org/apache/gobblin/data/management/retention/DatasetCleaner.java ## @@ -88,33 +94,43 @@

[GitHub] [incubator-gobblin] autumnust opened a new pull request #3038: [GOBBLIN-1190] Fallback to full schema if configured shuffle schema is not available

2020-06-11 Thread GitBox
autumnust opened a new pull request #3038: URL: https://github.com/apache/incubator-gobblin/pull/3038 Dear Gobblin maintainers, Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below! ### JIRA - https://issues.apach

[jira] [Work logged] (GOBBLIN-1190) Fallback to full schema as shuffle key is configured one is not available in ORC compaction

2020-06-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/GOBBLIN-1190?focusedWorklogId=444537&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-444537 ] ASF GitHub Bot logged work on GOBBLIN-1190: --- Author: ASF GitHub B

[jira] [Created] (GOBBLIN-1190) Fallback to full schema as shuffle key is configured one is not available in ORC compaction

2020-06-11 Thread Lei Sun (Jira)
Lei Sun created GOBBLIN-1190: Summary: Fallback to full schema as shuffle key is configured one is not available in ORC compaction Key: GOBBLIN-1190 URL: https://issues.apache.org/jira/browse/GOBBLIN-1190

[GitHub] [incubator-gobblin] asfgit closed pull request #2990: Gobblin 1148 improve hive test coverage

2020-06-11 Thread GitBox
asfgit closed pull request #2990: URL: https://github.com/apache/incubator-gobblin/pull/2990 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above