[jira] [Work logged] (SDAP-214) Simplify EDGE directory structure

2019-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SDAP-214?focusedWorklogId=352307&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-352307 ] ASF GitHub Bot logged work on SDAP-214: --- Author: ASF GitHub Bot

[jira] [Updated] (SDAP-214) Simplify EDGE directory structure

2019-12-02 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/SDAP-214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated SDAP-214: -- Status: To Do (was: In Progress) > Simplify EDGE directory structure >

[jira] [Updated] (SDAP-214) Simplify EDGE directory structure

2019-12-02 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/SDAP-214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated SDAP-214: -- Resolution: Fixed Status: Done (was: To Do) > Simplify EDGE directory structure

[GitHub] [incubator-sdap-edge] lewismc merged pull request #10: SDAP-214 Simplify EDGE directory structure

2019-12-02 Thread GitBox
lewismc merged pull request #10: SDAP-214 Simplify EDGE directory structure URL: https://github.com/apache/incubator-sdap-edge/pull/10 This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [incubator-sdap-nexus] fgreg commented on a change in pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart

2019-12-02 Thread GitBox
fgreg commented on a change in pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88#discussion_r352887919 ## File path: helm/templates/solr.yml ## @@ -0,0 +1,59 @@ +apiVersion: v1 +kind: Se

[GitHub] [incubator-sdap-nexus] fgreg commented on a change in pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart

2019-12-02 Thread GitBox
fgreg commented on a change in pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88#discussion_r352896947 ## File path: helm/templates/webapp.yaml ## @@ -0,0 +1,65 @@ +apiVersion: v1 +kind:

[GitHub] [incubator-sdap-nexus] fgreg commented on a change in pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart

2019-12-02 Thread GitBox
fgreg commented on a change in pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88#discussion_r352895731 ## File path: helm/templates/ingress.yaml ## @@ -0,0 +1,26 @@ +apiVersion: extensio

[GitHub] [incubator-sdap-nexus] fgreg commented on a change in pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart

2019-12-02 Thread GitBox
fgreg commented on a change in pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88#discussion_r352893936 ## File path: analysis/webservice/algorithms/doms/domsconfig.ini ## @@ -1,5 +1,5 @@

[GitHub] [incubator-sdap-nexus] fgreg commented on a change in pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart

2019-12-02 Thread GitBox
fgreg commented on a change in pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88#discussion_r352889616 ## File path: Dockerfile ## @@ -0,0 +1,120 @@ +# Licensed to the Apache Software Fo

[GitHub] [incubator-sdap-nexus] eamonford commented on issue #88: SDAP-215 Use k8s as Spark scheduler and create helm chart

2019-12-02 Thread GitBox
eamonford commented on issue #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88#issuecomment-560709261 @jjacob7734 Good catch, thanks. Fixed. This is an

[GitHub] [incubator-sdap-nexus] jjacob7734 commented on issue #88: SDAP-215 Use k8s as Spark scheduler and create helm chart

2019-12-02 Thread GitBox
jjacob7734 commented on issue #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88#issuecomment-560700354 You probably didn't mean to refer to your personal repo in your Dockerfile... please check on that before we merg

[GitHub] [incubator-sdap-nexus] eamonford commented on issue #88: SDAP-215 Use k8s as Spark scheduler and create helm chart

2019-12-02 Thread GitBox
eamonford commented on issue #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88#issuecomment-560643769 > I'm not sure if it is even possible here, but just want to point out, that it is usually advisable to break up l

[GitHub] [incubator-sdap-edge] rawkintrevo commented on issue #10: SDAP-214 Simplify EDGE directory structure

2019-12-02 Thread GitBox
rawkintrevo commented on issue #10: SDAP-214 Simplify EDGE directory structure URL: https://github.com/apache/incubator-sdap-edge/pull/10#issuecomment-560651171 @lewismc Ahh my bad, I was looking at the lines, not the context (e.g. the file that was being edited). ---

[GitHub] [incubator-sdap-edge] lewismc commented on issue #10: SDAP-214 Simplify EDGE directory structure

2019-12-02 Thread GitBox
lewismc commented on issue #10: SDAP-214 Simplify EDGE directory structure URL: https://github.com/apache/incubator-sdap-edge/pull/10#issuecomment-560630525 @fgreg > Were you able to successfully start it locally using the instructions from the Readme? Yes ``` lmcgibbn

[GitHub] [incubator-sdap-edge] lewismc commented on issue #10: SDAP-214 Simplify EDGE directory structure

2019-12-02 Thread GitBox
lewismc commented on issue #10: SDAP-214 Simplify EDGE directory structure URL: https://github.com/apache/incubator-sdap-edge/pull/10#issuecomment-560626011 @rawkintrevo thanks for reviewinbg > It appears you also upgraded a couple of things to python3 Negative, that work

[GitHub] [incubator-sdap-nexus] rawkintrevo commented on issue #88: SDAP-215 Use k8s as Spark scheduler and create helm chart

2019-12-02 Thread GitBox
rawkintrevo commented on issue #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88#issuecomment-560617578 Also- thanks for the contribution @eamonford !!

[GitHub] [incubator-sdap-nexus] rawkintrevo commented on issue #88: SDAP-215 Use k8s as Spark scheduler and create helm chart

2019-12-02 Thread GitBox
rawkintrevo commented on issue #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88#issuecomment-560616555 I'm not sure if it is even possible here, but just want to point out, that it is usually advisable to break up l

[GitHub] [incubator-sdap-edge] fgreg commented on issue #10: SDAP-214 Simplify EDGE directory structure

2019-12-02 Thread GitBox
fgreg commented on issue #10: SDAP-214 Simplify EDGE directory structure URL: https://github.com/apache/incubator-sdap-edge/pull/10#issuecomment-560612908 Seems reasonable to me. @lewismc Were you able to successfully start it locally using the instructions from the Readme? --

[GitHub] [incubator-sdap-edge] rawkintrevo commented on issue #10: SDAP-214 Simplify EDGE directory structure

2019-12-02 Thread GitBox
rawkintrevo commented on issue #10: SDAP-214 Simplify EDGE directory structure URL: https://github.com/apache/incubator-sdap-edge/pull/10#issuecomment-560609065 It appears you also upgraded a couple of things to python3. That's OK, but in general its better to make another PR for s

[GitHub] [incubator-sdap-edge] lewismc commented on issue #10: SDAP-214 Simplify EDGE directory structure

2019-12-02 Thread GitBox
lewismc commented on issue #10: SDAP-214 Simplify EDGE directory structure URL: https://github.com/apache/incubator-sdap-edge/pull/10#issuecomment-560599500 Any comments? This is an automated message from the Apache Git S

[jira] [Work logged] (SDAP-215) Fix performance issues with Spark on Kubernetes

2019-12-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SDAP-215?focusedWorklogId=352230&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-352230 ] ASF GitHub Bot logged work on SDAP-215: --- Author: ASF GitHub Bot

[GitHub] [incubator-sdap-nexus] eamonford opened a new pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart

2019-12-02 Thread GitBox
eamonford opened a new pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88 This branch updates Spark to v2.4.4 to be natively compatible with Kubernetes, so Spark now uses Kubernetes as a scheduler. This br

[jira] [Created] (SDAP-215) Fix performance issues with Spark on Kubernetes

2019-12-02 Thread Eamon Ford (Jira)
Eamon Ford created SDAP-215: --- Summary: Fix performance issues with Spark on Kubernetes Key: SDAP-215 URL: https://issues.apache.org/jira/browse/SDAP-215 Project: Apache Science Data Analytics Platform

Re: Podling Sdap Report Reminder - November 2019

2019-12-02 Thread Trevor Grant
No, the other way- Python doesn't exactly compile into binaries, but there was misunderstanding about what you just said among people on the project. (e.g. source is important part of release). On Mon, Dec 2, 2019 at 2:31 PM Justin Mclean wrote: > HI, > > > I think in large part the reason for

Re: Podling Sdap Report Reminder - November 2019

2019-12-02 Thread Justin Mclean
HI, > I think in large part the reason for no release for the first at least 18 > months was confusion about how to do a binary release on Python code. Apache projects release source code not binaries, so I'm not sure why this is a big concern. They may optionally provide a convenience binary bu

Re: Podling Sdap Report Reminder - November 2019

2019-12-02 Thread Trevor Grant
Hey Justin, I think in large part the reason for no release for the first at least 18 months was confusion about how to do a binary release on Python code. The confusion around that was cleared up at Apache Con NA this year. Sorry for delayed reply, we just had a major holiday here in the US. t