Re: Regarding incubator systemml/breast_cancer project

2017-04-24 Thread Mike Dusenberry
ecutors > > so that the Python processes have enough memory as well. PySpark has JVM > > and Python components, and the Spark memory settings only pertain to the > > JVM side, thus the need to save about half the executor memory for the > > Python side. > > > > T

Re: Maven build failing

2017-01-06 Thread Mike Dusenberry
Hi Sandeep, Thanks for reaching out! The error message looks like a local Maven issue. In addition to the suggestion from Felix, another possibility is to remove (or rename) your Maven cache, typically located at `~/.m2`, and then try building again with a fresh start. - Mike -- Michael W.

Re: GSoc 2017

2017-01-06 Thread Mike Dusenberry
Hi Krishna! Welcome, and thanks for your interest! We would definitely be excited to collaborate with you on a GSOC project. We've started another thread to discuss possible new proposals, and we would also be quite interested in any particular proposal that you might like to generate tailored

Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Mike Dusenberry
Hi to the SystemML community! As you may know, SystemML currently only supports Spark 1.6, and does not yet support Spark 2.x. However, there is an open PR ( https://github.com/apache/incubator-systemml/pull/202) that replaces Spark 1.6 support with Spark 2.x support. Spark 2.0.0 was released

Re: Release artifacts

2016-11-10 Thread Mike Dusenberry
This LGTM. For the next release, let's plan on reducing this down to the bare minimum. -- Michael W. Dusenberry GitHub: github.com/dusenberrymw LinkedIn: linkedin.com/in/mikedusenberry On Mon, Nov 7, 2016 at 10:41 AM, Deron Eriksson wrote: > Hi Luciano, > > Here is

Remove "Scratch Space" In Favor Of Temp Folder

2016-03-31 Thread Mike Dusenberry
Hi all, Currently, SystemML makes use of a "scratch space" folder for temporary files during execution. This is currently set to a relative "scratch_space" directory that will be placed relative to the execution path (local mode) or in the user's directory on HDFS. This works okay in some

Nightly Experimental Builds

2016-03-25 Thread Mike Dusenberry
-- Mike Dusenberry GitHub: github.com/dusenberrymw LinkedIn: linkedin.com/in/mikedusenberry

Re: [VOTE] Release SystemML 0.9.0-incubating (RC3)

2016-01-29 Thread Mike Dusenberry
+1 Unarchived and executed basic scripts with all distributions on a local machine (OS X 10.10.5, JDK 1.8.0_66, Spark 1.6), and a cluster (CentOS 7, 1 + 10 nodes, 256 GB RAM each, Hadoop + YARN + HDFS, Spark 1.4, Spark 1.6). - Mike -- Michael W. Dusenberry GitHub: github.com/dusenberrymw

Re: [VOTE] Release SystemML 0.9-incubating (RC1)

2016-01-20 Thread Mike Dusenberry
r...@gmail.com > To: dev@systemml.incubator.apache.org > Date: 01/20/2016 05:30 AM > Subject: Re: [VOTE] Release SystemML 0.9-incubating (RC1) > +1 > -- > Mike Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberry > Sent from my

Re: Starting a SystemML 0.9 release

2016-01-14 Thread Mike Dusenberry
s of prs coming very > >> quick, I would recommend to create the branch as needed for minor > releases. > >> > >> > >> > >> -- > >> Luciano Resende > >> http://people.apache.org/~lresende > >> http://twitter.com/lresende1975

Re: SystemML JIRA Site Is Live!

2016-01-14 Thread Mike Dusenberry
;> > > >>>> > >> > > >>>> > >> [image: Inactive hide details for Deron Eriksson ---01/08/2016 > > >>>> 01:31:48 > > >>>> > >> PM---Apparently it is being handled by > https://issues.apache.or > > >>>> ]Deron > > >>>> > >> Eriksson ---01/08/2016 01:31:48 PM---Apparently it is being > > >>>> handled by > > >>>> > >> https://issues.apache.org/jira/browse/INFRA-10714 and I did > not > > se > > >>>> > >> > > >>>> > >> From: Deron Eriksson <deroneriks...@gmail.com> > > >>>> > >> To: dev@systemml.incubator.apache.org > > >>>> > >> Date: 01/08/2016 01:31 PM > > >>>> > >> Subject: Re: SystemML JIRA Site Is Live! > > >>>> > >> -- > > >>>> > >> > > >>>> > >> > > >>>> > >> > > >>>> > >> Apparently it is being handled by > > >>>> > >> https://issues.apache.org/jira/browse/INFRA-10714 and I did > not > > >>>> see the > > >>>> > >> comment. I will request the notifications scheme in the 10714 > > >>>> comments. > > >>>> > >> > > >>>> > >> Deron > > >>>> > >> > > >>>> > >> > > >>>> > >> On Fri, Jan 8, 2016 at 1:26 PM, Deron Eriksson < > > >>>> deroneriks...@gmail.com > > >>>> > > > > >>>> > >> wrote: > > >>>> > >> > > >>>> > >> > I submitted a request for a notifications scheme. See status > at > > >>>> > >> > https://issues.apache.org/jira/browse/INFRA-11050 > > >>>> > >> > > > >>>> > >> > Deron > > >>>> > >> > > > >>>> > >> > > > >>>> > >> > On Fri, Jan 8, 2016 at 12:36 PM, Luciano Resende < > > >>>> > luckbr1...@gmail.com> > > >>>> > >> > wrote: > > >>>> > >> > > > >>>> > >> >> On Fri, Jan 8, 2016 at 11:09 AM, Deron Eriksson < > > >>>> > >> deroneriks...@gmail.com> > > >>>> > >> >> wrote: > > >>>> > >> >> > > >>>> > >> >> > Hi Luciano, > > >>>> > >> >> > > > >>>> > >> >> > Right now there is no notification scheme for the project. > > See > > >>>> > >> >> > > > >>>> > >> >> > > > >>>> > >> >> > > >>>> > >> > > >>>> > > > >>>> > > > https://issues.apache.org/jira/plugins/servlet/project-config/SYSTEMML/notifications > > >>>> > >> >> > > > >>>> > >> >> > I don't see an option to create or modify a notification > > >>>> scheme. > > >>>> > >> >> > > > >>>> > >> >> > Do you happen to know if we need to submit a request to > > INFRA > > >>>> to do > > >>>> > >> >> this? > > >>>> > >> >> > > > >>>> > >> >> > > > >>>> > >> >> Yes, please. > > >>>> > >> >> > > >>>> > >> >> > > >>>> > >> >> > > >>>> > >> >> > > >>>> > >> >> -- > > >>>> > >> >> Luciano Resende > > >>>> > >> >> http://people.apache.org/~lresende > > >>>> > >> >> http://twitter.com/lresende1975 > > >>>> > >> >> http://lresende.blogspot.com/ > > >>>> > >> >> > > >>>> > >> > > > >>>> > >> > > > >>>> > >> > > >>>> > >> > > >>>> > >> > > >>>> > > > > >>>> > > > >>>> > > >>>> > > >>>> > > >>>> -- > > >>>> Luciano Resende > > >>>> http://people.apache.org/~lresende > > >>>> http://twitter.com/lresende1975 > > >>>> http://lresende.blogspot.com/ > > >>>> > > >>>> > > >>>> > > >>> > > >> > > > > > > > > > -- > Luciano Resende > http://people.apache.org/~lresende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ > -- Mike Dusenberry GitHub: github.com/dusenberrymw LinkedIn: linkedin.com/in/mikedusenberry Sent from my iPhone.

SystemML Daily Test Builds

2016-01-13 Thread Mike Dusenberry
possibility would be to have Jenkins email the dev list on any failures. The builds can be found here: [ https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/]. Thanks to Alex! -Mike -- Mike Dusenberry GitHub: github.com/dusenberrymw LinkedIn: linkedin.com/in/mikedusenberry Sent from my iPhone.

Re: SystemML JIRA Site Is Live!

2016-01-12 Thread Mike Dusenberry
t; luckbr1...@gmail.com> > > >> > wrote: > > >> > > > >> >> On Fri, Jan 8, 2016 at 11:09 AM, Deron Eriksson < > > >> deroneriks...@gmail.com> > > >> >> wrote: > > >> >> > > >> >> > Hi Luciano, > > >> >> > > > >> >> > Right now there is no notification scheme for the project. See > > >> >> > > > >> >> > > > >> >> > > >> > > > https://issues.apache.org/jira/plugins/servlet/project-config/SYSTEMML/notifications > > >> >> > > > >> >> > I don't see an option to create or modify a notification scheme. > > >> >> > > > >> >> > Do you happen to know if we need to submit a request to INFRA to > do > > >> >> this? > > >> >> > > > >> >> > > > >> >> Yes, please. > > >> >> > > >> >> > > >> >> > > >> >> > > >> >> -- > > >> >> Luciano Resende > > >> >> http://people.apache.org/~lresende > > >> >> http://twitter.com/lresende1975 > > >> >> http://lresende.blogspot.com/ > > >> >> > > >> > > > >> > > > >> > > >> > > >> > > > > > > > > > -- > Luciano Resende > http://people.apache.org/~lresende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ > -- Mike Dusenberry GitHub: github.com/dusenberrymw LinkedIn: linkedin.com/in/mikedusenberry Sent from my iPhone

SystemML Committer Git Guide

2015-12-02 Thread Mike Dusenberry
he repo:   * `git push apache master` ## Merging (script) * WIP ## Tricks * If you add the phrase "Closes #4." to the end of a commit message and then push to Apache, GitHub will automatically close pull request 4, and the commit will contain a link to that pull request. --- Che

Re: Maven profiles for distributions

2015-12-02 Thread Mike Dusenberry
Yeah I thinking lumping them all together would be fine too. As long as the regular dev builds are sped up, I'm fine either way.  -Mike -- Mike Dusenberry GitHub: github.com/dusenberrymw LinkedIn: linkedin.com/in/mikedusenberry Sent from my iPhone On Wed, Dec 2, 2015 at 3:52 PM