[jira] [Work logged] (GOBBLIN-895) Gobblin Standalone Script does not run properly

2019-10-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-895?focusedWorklogId=326695&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-326695
 ]

ASF GitHub Bot logged work on GOBBLIN-895:
--

Author: ASF GitHub Bot
Created on: 11/Oct/19 03:55
Start Date: 11/Oct/19 03:55
Worklog Time Spent: 10m 
  Work Description: asfgit commented on pull request #2751: [GOBBLIN-895] 
Fixes Gobblin Standalone configs and scripts so that user guide is accurate
URL: https://github.com/apache/incubator-gobblin/pull/2751
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 326695)
Time Spent: 50m  (was: 40m)

> Gobblin Standalone Script does not run properly
> ---
>
> Key: GOBBLIN-895
> URL: https://issues.apache.org/jira/browse/GOBBLIN-895
> Project: Apache Gobblin
>  Issue Type: Bug
>Affects Versions: 0.15.0
>Reporter: William Lo
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> Gobblin.sh's changes do not support Gobblin standalone properly as specified 
> in the getting started docs. This is due to a regression in the 
> configurations of the app and the logger.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (GOBBLIN-905) Gobblin standalone crashes when adding a new job to its tracked folder

2019-10-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-905?focusedWorklogId=326698&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-326698
 ]

ASF GitHub Bot logged work on GOBBLIN-905:
--

Author: ASF GitHub Bot
Created on: 11/Oct/19 03:58
Start Date: 11/Oct/19 03:58
Worklog Time Spent: 10m 
  Work Description: asfgit commented on pull request #2759: [GOBBLIN-905] 
Fixes issue where newly added jobs would crash in gobbl…
URL: https://github.com/apache/incubator-gobblin/pull/2759
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 326698)
Time Spent: 50m  (was: 40m)

> Gobblin standalone crashes when adding a new job to its tracked folder
> --
>
> Key: GOBBLIN-905
> URL: https://issues.apache.org/jira/browse/GOBBLIN-905
> Project: Apache Gobblin
>  Issue Type: Bug
>Reporter: William Lo
>Priority: Major
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> Gobblin standalone crashes with a null pointer exception when adding a new 
> `.job` file to its tracked directory.
> To reproduce, add a `.job` file in `GOBBLIN_JOB_CONF_DIR`
> Produced output is below
> {quote}2019-10-08 22:38:29 GMT ERROR [newDaemonThreadFactory] 
> org.apache.gobblin.util.filesystem.ExceptionCatchingPathAlterationListenerDecorator
>   57 - onFileCreate failure:
> java.lang.NullPointerException
>   at 
> org.apache.gobblin.util.SchedulerUtils.resolveTemplate(SchedulerUtils.java:182)
>   at 
> org.apache.gobblin.util.SchedulerUtils.loadGenericJobConfig(SchedulerUtils.java:139)
>   at 
> org.apache.gobblin.scheduler.PathAlterationListenerAdaptorForMonitor.loadNewJobConfigAndHandleNewJob(PathAlterationListenerAdaptorForMonitor.java:79)
>   at 
> org.apache.gobblin.scheduler.PathAlterationListenerAdaptorForMonitor.onFileCreate(PathAlterationListenerAdaptorForMonitor.java:165)
>   at 
> org.apache.gobblin.util.filesystem.ExceptionCatchingPathAlterationListenerDecorator.onFileCreate(ExceptionCatchingPathAlterationListenerDecorator.java:55)
>   at 
> org.apache.gobblin.util.filesystem.PathAlterationObserver.doCreate({quote}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [incubator-gobblin] asfgit closed pull request #2759: [GOBBLIN-905] Fixes issue where newly added jobs would crash in gobbl…

2019-10-10 Thread GitBox
asfgit closed pull request #2759: [GOBBLIN-905] Fixes issue where newly added 
jobs would crash in gobbl…
URL: https://github.com/apache/incubator-gobblin/pull/2759
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Work logged] (GOBBLIN-903) Add Docker for Gobblin Standalone

2019-10-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-903?focusedWorklogId=326696&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-326696
 ]

ASF GitHub Bot logged work on GOBBLIN-903:
--

Author: ASF GitHub Bot
Created on: 11/Oct/19 03:56
Start Date: 11/Oct/19 03:56
Worklog Time Spent: 10m 
  Work Description: asfgit commented on pull request #2756: [GOBBLIN-903] 
Initialize docker file for gobblin-standalone and docker compose
URL: https://github.com/apache/incubator-gobblin/pull/2756
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 326696)
Time Spent: 0.5h  (was: 20m)

> Add Docker for Gobblin Standalone
> -
>
> Key: GOBBLIN-903
> URL: https://issues.apache.org/jira/browse/GOBBLIN-903
> Project: Apache Gobblin
>  Issue Type: Improvement
>Affects Versions: 0.15.0
>Reporter: William Lo
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [incubator-gobblin] asfgit closed pull request #2756: [GOBBLIN-903] Initialize docker file for gobblin-standalone and docker compose

2019-10-10 Thread GitBox
asfgit closed pull request #2756: [GOBBLIN-903] Initialize docker file for 
gobblin-standalone and docker compose
URL: https://github.com/apache/incubator-gobblin/pull/2756
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] [incubator-gobblin] asfgit closed pull request #2751: [GOBBLIN-895] Fixes Gobblin Standalone configs and scripts so that user guide is accurate

2019-10-10 Thread GitBox
asfgit closed pull request #2751: [GOBBLIN-895] Fixes Gobblin Standalone 
configs and scripts so that user guide is accurate
URL: https://github.com/apache/incubator-gobblin/pull/2751
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Work logged] (GOBBLIN-894) Add option to combine datasets into a single flow

2019-10-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-894?focusedWorklogId=326694&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-326694
 ]

ASF GitHub Bot logged work on GOBBLIN-894:
--

Author: ASF GitHub Bot
Created on: 11/Oct/19 03:52
Start Date: 11/Oct/19 03:52
Worklog Time Spent: 10m 
  Work Description: asfgit commented on pull request #2749: [GOBBLIN-894] 
Add option to combine datasets into a single flow
URL: https://github.com/apache/incubator-gobblin/pull/2749
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 326694)
Time Spent: 50m  (was: 40m)

> Add option to combine datasets into a single flow
> -
>
> Key: GOBBLIN-894
> URL: https://issues.apache.org/jira/browse/GOBBLIN-894
> Project: Apache Gobblin
>  Issue Type: Bug
>Reporter: Jack Moseley
>Priority: Major
>  Time Spent: 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [incubator-gobblin] asfgit closed pull request #2749: [GOBBLIN-894] Add option to combine datasets into a single flow

2019-10-10 Thread GitBox
asfgit closed pull request #2749: [GOBBLIN-894] Add option to combine datasets 
into a single flow
URL: https://github.com/apache/incubator-gobblin/pull/2749
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Work logged] (GOBBLIN-906) Define Kubernetes Cluster for GaaS and Gobblin Standalone

2019-10-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-906?focusedWorklogId=326635&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-326635
 ]

ASF GitHub Bot logged work on GOBBLIN-906:
--

Author: ASF GitHub Bot
Created on: 10/Oct/19 23:39
Start Date: 10/Oct/19 23:39
Worklog Time Spent: 10m 
  Work Description: codecov-io commented on issue #2760: [GOBBLIN-906] 
Initializes kubernetes cluster for GaaS and Gobblin Standalone
URL: 
https://github.com/apache/incubator-gobblin/pull/2760#issuecomment-540841640
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=h1)
 Report
   > Merging 
[#2760](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=desc)
 into 
[master](https://codecov.io/gh/apache/incubator-gobblin/commit/928e0180c471fc4b7a6caee041b001b5b34e1cc6?src=pr&el=desc)
 will **increase** coverage by `0.01%`.
   > The diff coverage is `n/a`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-gobblin/pull/2760/graphs/tree.svg?width=650&token=4MgURJ0bGc&height=150&src=pr)](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master#2760  +/-   ##
   
   + Coverage 45.27%   45.29%   +0.01% 
   - Complexity 8830 8834   +4 
   
 Files  1889 1889  
 Lines 7064270642  
 Branches   7759 7759  
   
   + Hits  3198531994   +9 
   + Misses3570335698   -5 
   + Partials   2954 2950   -4
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=tree) 
| Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[.../org/apache/gobblin/metrics/RootMetricContext.java](https://codecov.io/gh/apache/incubator-gobblin/pull/2760/diff?src=pr&el=tree#diff-Z29iYmxpbi1tZXRyaWNzLWxpYnMvZ29iYmxpbi1tZXRyaWNzLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2dvYmJsaW4vbWV0cmljcy9Sb290TWV0cmljQ29udGV4dC5qYXZh)
 | `78.12% <0%> (-1.57%)` | `15% <0%> (-1%)` | |
   | 
[...main/java/org/apache/gobblin/util/HadoopUtils.java](https://codecov.io/gh/apache/incubator-gobblin/pull/2760/diff?src=pr&el=tree#diff-Z29iYmxpbi11dGlsaXR5L3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9nb2JibGluL3V0aWwvSGFkb29wVXRpbHMuamF2YQ==)
 | `30.87% <0%> (+0.67%)` | `25% <0%> (+1%)` | :arrow_up: |
   | 
[...e/gobblin/runtime/locks/ZookeeperBasedJobLock.java](https://codecov.io/gh/apache/incubator-gobblin/pull/2760/diff?src=pr&el=tree#diff-Z29iYmxpbi1ydW50aW1lL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9nb2JibGluL3J1bnRpbWUvbG9ja3MvWm9va2VlcGVyQmFzZWRKb2JMb2NrLmphdmE=)
 | `64.44% <0%> (+1.11%)` | `16% <0%> (+1%)` | :arrow_up: |
   | 
[.../org/apache/gobblin/cluster/GobblinTaskRunner.java](https://codecov.io/gh/apache/incubator-gobblin/pull/2760/diff?src=pr&el=tree#diff-Z29iYmxpbi1jbHVzdGVyL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9nb2JibGluL2NsdXN0ZXIvR29iYmxpblRhc2tSdW5uZXIuamF2YQ==)
 | `65.27% <0%> (+1.38%)` | `28% <0%> (ø)` | :arrow_down: |
   | 
[...ava/org/apache/gobblin/fsm/FiniteStateMachine.java](https://codecov.io/gh/apache/incubator-gobblin/pull/2760/diff?src=pr&el=tree#diff-Z29iYmxpbi11dGlsaXR5L3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9nb2JibGluL2ZzbS9GaW5pdGVTdGF0ZU1hY2hpbmUuamF2YQ==)
 | `76.51% <0%> (+3.03%)` | `21% <0%> (+3%)` | :arrow_up: |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
   > `Δ = absolute  (impact)`, `ø = not affected`, `? = missing data`
   > Powered by 
[Codecov](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=footer).
 Last update 
[928e018...dbf201b](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=lastupdated).
 Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 326635)
Time Spent: 20m  (was: 10m)

> Define Kubernetes Cluster for GaaS and Gobblin Standalone
> -
>
> Key: GOBBLIN-906
> URL: https://issues.apache.org/jira/browse/GOBBLIN-906
> Project: Apache Gobblin
>  Issue Type: New Feature
>Affects Versions:

[GitHub] [incubator-gobblin] codecov-io commented on issue #2760: [GOBBLIN-906] Initializes kubernetes cluster for GaaS and Gobblin Standalone

2019-10-10 Thread GitBox
codecov-io commented on issue #2760: [GOBBLIN-906] Initializes kubernetes 
cluster for GaaS and Gobblin Standalone
URL: 
https://github.com/apache/incubator-gobblin/pull/2760#issuecomment-540841640
 
 
   # 
[Codecov](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=h1)
 Report
   > Merging 
[#2760](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=desc)
 into 
[master](https://codecov.io/gh/apache/incubator-gobblin/commit/928e0180c471fc4b7a6caee041b001b5b34e1cc6?src=pr&el=desc)
 will **increase** coverage by `0.01%`.
   > The diff coverage is `n/a`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/incubator-gobblin/pull/2760/graphs/tree.svg?width=650&token=4MgURJ0bGc&height=150&src=pr)](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master#2760  +/-   ##
   
   + Coverage 45.27%   45.29%   +0.01% 
   - Complexity 8830 8834   +4 
   
 Files  1889 1889  
 Lines 7064270642  
 Branches   7759 7759  
   
   + Hits  3198531994   +9 
   + Misses3570335698   -5 
   + Partials   2954 2950   -4
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=tree) 
| Coverage Δ | Complexity Δ | |
   |---|---|---|---|
   | 
[.../org/apache/gobblin/metrics/RootMetricContext.java](https://codecov.io/gh/apache/incubator-gobblin/pull/2760/diff?src=pr&el=tree#diff-Z29iYmxpbi1tZXRyaWNzLWxpYnMvZ29iYmxpbi1tZXRyaWNzLWJhc2Uvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2dvYmJsaW4vbWV0cmljcy9Sb290TWV0cmljQ29udGV4dC5qYXZh)
 | `78.12% <0%> (-1.57%)` | `15% <0%> (-1%)` | |
   | 
[...main/java/org/apache/gobblin/util/HadoopUtils.java](https://codecov.io/gh/apache/incubator-gobblin/pull/2760/diff?src=pr&el=tree#diff-Z29iYmxpbi11dGlsaXR5L3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9nb2JibGluL3V0aWwvSGFkb29wVXRpbHMuamF2YQ==)
 | `30.87% <0%> (+0.67%)` | `25% <0%> (+1%)` | :arrow_up: |
   | 
[...e/gobblin/runtime/locks/ZookeeperBasedJobLock.java](https://codecov.io/gh/apache/incubator-gobblin/pull/2760/diff?src=pr&el=tree#diff-Z29iYmxpbi1ydW50aW1lL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9nb2JibGluL3J1bnRpbWUvbG9ja3MvWm9va2VlcGVyQmFzZWRKb2JMb2NrLmphdmE=)
 | `64.44% <0%> (+1.11%)` | `16% <0%> (+1%)` | :arrow_up: |
   | 
[.../org/apache/gobblin/cluster/GobblinTaskRunner.java](https://codecov.io/gh/apache/incubator-gobblin/pull/2760/diff?src=pr&el=tree#diff-Z29iYmxpbi1jbHVzdGVyL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9nb2JibGluL2NsdXN0ZXIvR29iYmxpblRhc2tSdW5uZXIuamF2YQ==)
 | `65.27% <0%> (+1.38%)` | `28% <0%> (ø)` | :arrow_down: |
   | 
[...ava/org/apache/gobblin/fsm/FiniteStateMachine.java](https://codecov.io/gh/apache/incubator-gobblin/pull/2760/diff?src=pr&el=tree#diff-Z29iYmxpbi11dGlsaXR5L3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9nb2JibGluL2ZzbS9GaW5pdGVTdGF0ZU1hY2hpbmUuamF2YQ==)
 | `76.51% <0%> (+3.03%)` | `21% <0%> (+3%)` | :arrow_up: |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
   > `Δ = absolute  (impact)`, `ø = not affected`, `? = missing data`
   > Powered by 
[Codecov](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=footer).
 Last update 
[928e018...dbf201b](https://codecov.io/gh/apache/incubator-gobblin/pull/2760?src=pr&el=lastupdated).
 Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Work logged] (GOBBLIN-894) Add option to combine datasets into a single flow

2019-10-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-894?focusedWorklogId=326600&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-326600
 ]

ASF GitHub Bot logged work on GOBBLIN-894:
--

Author: ASF GitHub Bot
Created on: 10/Oct/19 22:05
Start Date: 10/Oct/19 22:05
Worklog Time Spent: 10m 
  Work Description: jack-moseley commented on issue #2749: [GOBBLIN-894] 
Add option to combine datasets into a single flow
URL: 
https://github.com/apache/incubator-gobblin/pull/2749#issuecomment-540819212
 
 
   @sv2000 please merge
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 326600)
Time Spent: 40m  (was: 0.5h)

> Add option to combine datasets into a single flow
> -
>
> Key: GOBBLIN-894
> URL: https://issues.apache.org/jira/browse/GOBBLIN-894
> Project: Apache Gobblin
>  Issue Type: Bug
>Reporter: Jack Moseley
>Priority: Major
>  Time Spent: 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [incubator-gobblin] Will-Lo opened a new pull request #2760: [GOBBLIN-906] Initializes kubernetes cluster for GaaS and Gobblin Standalone

2019-10-10 Thread GitBox
Will-Lo opened a new pull request #2760: [GOBBLIN-906] Initializes kubernetes 
cluster for GaaS and Gobblin Standalone
URL: https://github.com/apache/incubator-gobblin/pull/2760
 
 
   Dear Gobblin maintainers,
   
   Please accept this PR. I understand that it will not be reviewed until I 
have checked off all the steps below!
   
   
   ### JIRA
   - [ ] My PR addresses the following [Gobblin 
JIRA](https://issues.apache.org/jira/browse/GOBBLIN/) issues and references 
them in the PR title. For example, "[GOBBLIN-XXX] My Gobblin PR"
   - https://issues.apache.org/jira/browse/GOBBLIN-906
   
   
   ### Description
   - [x] Here are some details about my PR, including screenshots (if 
applicable):
   Adds yaml files to define kubernetes deployment for GaaS and Gobblin 
Standalone
   Utilizes the node's local filesystem as the communication mechanism between 
GaaS and Gobblin Standalone. 
   
   ### Tests
   - [x] My PR adds the following unit tests __OR__ does not need testing for 
this extremely good reason:
   Testing the application on Kubernetes
   
   ### Commits
   - [ ] My commits all reference JIRA issues in their subject lines, and I 
have squashed multiple commits if they address the same issue. In addition, my 
commits follow the guidelines from "[How to write a good git commit 
message](http://chris.beams.io/posts/git-commit/)":
   1. Subject is separated from body by a blank line
   2. Subject is limited to 50 characters
   3. Subject does not end with a period
   4. Subject uses the imperative mood ("add", not "adding")
   5. Body wraps at 72 characters
   6. Body explains "what" and "why", not "how"
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Work logged] (GOBBLIN-906) Define Kubernetes Cluster for GaaS and Gobblin Standalone

2019-10-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-906?focusedWorklogId=326604&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-326604
 ]

ASF GitHub Bot logged work on GOBBLIN-906:
--

Author: ASF GitHub Bot
Created on: 10/Oct/19 22:12
Start Date: 10/Oct/19 22:12
Worklog Time Spent: 10m 
  Work Description: Will-Lo commented on pull request #2760: [GOBBLIN-906] 
Initializes kubernetes cluster for GaaS and Gobblin Standalone
URL: https://github.com/apache/incubator-gobblin/pull/2760
 
 
   Dear Gobblin maintainers,
   
   Please accept this PR. I understand that it will not be reviewed until I 
have checked off all the steps below!
   
   
   ### JIRA
   - [ ] My PR addresses the following [Gobblin 
JIRA](https://issues.apache.org/jira/browse/GOBBLIN/) issues and references 
them in the PR title. For example, "[GOBBLIN-XXX] My Gobblin PR"
   - https://issues.apache.org/jira/browse/GOBBLIN-906
   
   
   ### Description
   - [x] Here are some details about my PR, including screenshots (if 
applicable):
   Adds yaml files to define kubernetes deployment for GaaS and Gobblin 
Standalone
   Utilizes the node's local filesystem as the communication mechanism between 
GaaS and Gobblin Standalone. 
   
   ### Tests
   - [x] My PR adds the following unit tests __OR__ does not need testing for 
this extremely good reason:
   Testing the application on Kubernetes
   
   ### Commits
   - [ ] My commits all reference JIRA issues in their subject lines, and I 
have squashed multiple commits if they address the same issue. In addition, my 
commits follow the guidelines from "[How to write a good git commit 
message](http://chris.beams.io/posts/git-commit/)":
   1. Subject is separated from body by a blank line
   2. Subject is limited to 50 characters
   3. Subject does not end with a period
   4. Subject uses the imperative mood ("add", not "adding")
   5. Body wraps at 72 characters
   6. Body explains "what" and "why", not "how"
   
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 326604)
Remaining Estimate: 0h
Time Spent: 10m

> Define Kubernetes Cluster for GaaS and Gobblin Standalone
> -
>
> Key: GOBBLIN-906
> URL: https://issues.apache.org/jira/browse/GOBBLIN-906
> Project: Apache Gobblin
>  Issue Type: New Feature
>Affects Versions: 0.15.0
>Reporter: William Lo
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Defines a kubernetes cluster to demonstrate a workflow between GaaS and 
> Gobblin Standalone, all living in a K8s environment



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (GOBBLIN-906) Define Kubernetes Cluster for GaaS and Gobblin Standalone

2019-10-10 Thread William Lo (Jira)
William Lo created GOBBLIN-906:
--

 Summary: Define Kubernetes Cluster for GaaS and Gobblin Standalone
 Key: GOBBLIN-906
 URL: https://issues.apache.org/jira/browse/GOBBLIN-906
 Project: Apache Gobblin
  Issue Type: New Feature
Affects Versions: 0.15.0
Reporter: William Lo
 Fix For: 0.15.0


Defines a kubernetes cluster to demonstrate a workflow between GaaS and Gobblin 
Standalone, all living in a K8s environment



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [incubator-gobblin] jack-moseley commented on issue #2749: [GOBBLIN-894] Add option to combine datasets into a single flow

2019-10-10 Thread GitBox
jack-moseley commented on issue #2749: [GOBBLIN-894] Add option to combine 
datasets into a single flow
URL: 
https://github.com/apache/incubator-gobblin/pull/2749#issuecomment-540819212
 
 
   @sv2000 please merge


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Resolved] (GOBBLIN-896) Clone schema or field props in AvroFieldRemover

2019-10-10 Thread Hung Tran (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hung Tran resolved GOBBLIN-896.
---
Fix Version/s: 0.15.0
   Resolution: Fixed

Issue resolved by pull request #2750
[https://github.com/apache/incubator-gobblin/pull/2750]

> Clone schema or field props in AvroFieldRemover
> ---
>
> Key: GOBBLIN-896
> URL: https://issues.apache.org/jira/browse/GOBBLIN-896
> Project: Apache Gobblin
>  Issue Type: Task
>Reporter: Zhixiong Chen
>Priority: Major
> Fix For: 0.15.0
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> Currently, `AvroFieldRemover` ignores schema and field level properties while 
> cloning the schema and its fields. The change is to fix it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Work logged] (GOBBLIN-896) Clone schema or field props in AvroFieldRemover

2019-10-10 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/GOBBLIN-896?focusedWorklogId=326592&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-326592
 ]

ASF GitHub Bot logged work on GOBBLIN-896:
--

Author: ASF GitHub Bot
Created on: 10/Oct/19 21:45
Start Date: 10/Oct/19 21:45
Worklog Time Spent: 10m 
  Work Description: asfgit commented on pull request #2750: [GOBBLIN-896] 
Clone schema and field props in AvroSchemaFieldRemover
URL: https://github.com/apache/incubator-gobblin/pull/2750
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 326592)
Time Spent: 40m  (was: 0.5h)

> Clone schema or field props in AvroFieldRemover
> ---
>
> Key: GOBBLIN-896
> URL: https://issues.apache.org/jira/browse/GOBBLIN-896
> Project: Apache Gobblin
>  Issue Type: Task
>Reporter: Zhixiong Chen
>Priority: Major
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> Currently, `AvroFieldRemover` ignores schema and field level properties while 
> cloning the schema and its fields. The change is to fix it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[GitHub] [incubator-gobblin] asfgit closed pull request #2750: [GOBBLIN-896] Clone schema and field props in AvroSchemaFieldRemover

2019-10-10 Thread GitBox
asfgit closed pull request #2750: [GOBBLIN-896] Clone schema and field props in 
AvroSchemaFieldRemover
URL: https://github.com/apache/incubator-gobblin/pull/2750
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services