[jira] [Work logged] (GOBBLIN-677) Allow for early termination of Gobblin jobs based on a predicate on job progress

2019-02-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-677?focusedWorklogId=206244=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-206244 ] ASF GitHub Bot logged work on GOBBLIN-677: -- Author: ASF GitHub Bot

[GitHub] sv2000 commented on issue #2548: [GOBBLIN-677] - Allow early termination of Gobblin jobs based on a predicate on the job progress

2019-02-28 Thread GitBox
sv2000 commented on issue #2548: [GOBBLIN-677] - Allow early termination of Gobblin jobs based on a predicate on the job progress URL: https://github.com/apache/incubator-gobblin/pull/2548#issuecomment-468547996 @ibuenros can you ensure that the travis build is successful before @htran1

[jira] [Work logged] (GOBBLIN-691) Make compaction implementation format-insensitive

2019-02-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-691?focusedWorklogId=206174=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-206174 ] ASF GitHub Bot logged work on GOBBLIN-691: -- Author: ASF GitHub Bot

[GitHub] yukuai518 commented on issue #2563: [GOBBLIN-691] Make format-specific component pluggable in compaction

2019-02-28 Thread GitBox
yukuai518 commented on issue #2563: [GOBBLIN-691] Make format-specific component pluggable in compaction URL: https://github.com/apache/incubator-gobblin/pull/2563#issuecomment-468507094 +1 LGTM. This is an automated

[jira] [Work logged] (GOBBLIN-691) Make compaction implementation format-insensitive

2019-02-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-691?focusedWorklogId=206092=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-206092 ] ASF GitHub Bot logged work on GOBBLIN-691: -- Author: ASF GitHub Bot

[GitHub] ibuenros commented on a change in pull request #2563: [GOBBLIN-691] Make format-specific component pluggable in compaction

2019-02-28 Thread GitBox
ibuenros commented on a change in pull request #2563: [GOBBLIN-691] Make format-specific component pluggable in compaction URL: https://github.com/apache/incubator-gobblin/pull/2563#discussion_r261408097 ## File path:

[jira] [Work logged] (GOBBLIN-691) Make compaction implementation format-insensitive

2019-02-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-691?focusedWorklogId=205981=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-205981 ] ASF GitHub Bot logged work on GOBBLIN-691: -- Author: ASF GitHub Bot

[GitHub] ibuenros commented on a change in pull request #2563: [GOBBLIN-691] Make format-specific component pluggable in compaction

2019-02-28 Thread GitBox
ibuenros commented on a change in pull request #2563: [GOBBLIN-691] Make format-specific component pluggable in compaction URL: https://github.com/apache/incubator-gobblin/pull/2563#discussion_r261352026 ## File path:

Re: JobConfigurationManager ?

2019-02-28 Thread Hung Tran
Hi Jay, You can use Gobblin-as-a-Service with Gobblin-cluster. Jobs can be created in GaaS through a REST call or through a git monitor. GaaS will then send the job spec to the cluster through kafka. On the cluster side the jobs received through kafka are put into a JobCatalog. If you

JobConfigurationManager ?

2019-02-28 Thread Jay Sen
Hi Dev Team, just wanted to confirm that there is no scheduled local job file configuration manager that will periodically check the job conf path for file updates/addition. I only see scheduled and streaming job config manager for kafka only. does LinkedIn store the job config in kafka from