[VOTE] Apache SystemML 0.10.0-incubating (RC1)
Please vote on releasing the following candidate as Apache SystemML version 0.10.0-incubating ! The vote is open for at least 72 hours and will close on Saturday, Wednesday 25 and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache SystemML 0.10.0-incubating [ ] -1 Do not release this package because ... To learn more about Apache SystemML, please see http://systemml.apache.org/ The tag to be voted on is v0.10.0-incubating-rc1 (ddf0e0941afe5d9c2cc7c574a6983aadd98c1fc3) https://github.com/apache/incubator-systemml/tree/ddf0e0941afe5d9c2cc7c574a6983aadd98c1fc3 The release artifacts can be found at : https://dist.apache.org/repos/dist/dev/incubator/systemml/0.10.0-incubating-rc1/ The maven release artifacts, including signatures, digests, etc. can be found at: https://repository.apache.org/content/repositories/orgapachesystemml-1005/ = == Apache Incubator release policy == = Please find below the guide to release management during incubation: http://incubator.apache.org/guides/releasemanagement.html === == How can I help test this release? == === If you are a SystemML user, you can help us test this release by taking an existing Algorithm or workload and running on this release candidate, then reporting any regressions. == What justifies a -1 vote for this release? == -1 votes should only occur for significant stop-ship bugs or legal related issues (e.g. wrong license, missing header files, etc). Minor bugs or regressions should not block this release. -- Luciano Resende http://twitter.com/lresende1975 http://lresende.blogspot.com/
'hello world' tests of the main distributions
Hi, We have a test suite of 5000+ tests but I don't think we have a standard way of testing the distribution artifacts once they are built. I just did some 'hello world' tests of the various distribution artifacts to be sure that I could run a 'hello world' DML script using the various distributions. In case it's helpful to others, here are the various things I did (on OS X). # build distribution artifacts mvn clean package -P distribution cd target # verify jar works java -cp ./lib/*:systemml-0.10.0-incubating-SNAPSHOT.jar org.apache.sysml.api.DMLScript -s "print('hello world');" # verify SystemML.jar works java -cp ./lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s "print('hello world');" # verify standalone jar works java -jar systemml-0.10.0-incubating-SNAPSHOT-standalone.jar -s "print('hello world');" # verify src works tar -xvzf systemml-0.10.0-incubating-SNAPSHOT-src.tar.gz cd systemml-0.10.0-incubating-SNAPSHOT-src mvn clean package -P distribution cd target/ java -cp ./lib/*:systemml-0.10.0-incubating-SNAPSHOT.jar org.apache.sysml.api.DMLScript -s "print('hello world');" java -cp ./lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s "print('hello world');" java -jar systemml-0.10.0-incubating-SNAPSHOT-standalone.jar -s "print('hello world');" cd .. cd .. # verify in-memory jar works echo "import org.apache.sysml.api.jmlc.*;public class JMLCEx {public static void main(String[] args) throws Exception {Connection conn = new Connection();PreparedScript script = conn.prepareScript(\"print('hello world');\", new String[]{}, new String[]{}, false);script.executeScript();}}" > JMLCEx.java javac -cp systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar JMLCEx.java java -cp .:systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar JMLCEx # verify standalone tar.gz works tar -xvzf systemml-0.10.0-incubating-SNAPSHOT-standalone.tar.gz cd systemml-0.10.0-incubating-SNAPSHOT-standalone echo "print('hello world');" > hello.dml ./runStandaloneSystemML.sh hello.dml cd .. # verify distrib tar.gz works tar -xvzf systemml-0.10.0-incubating-SNAPSHOT.tar.gz cd systemml-0.10.0-incubating-SNAPSHOT java -cp ../lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s "print('hello world');" export SPARK_HOME=/Users/deroneriksson/spark-1.5.1-bin-hadoop2.6 $SPARK_HOME/bin/spark-submit SystemML.jar -s "print('hello world');" -exec hybrid_spark hadoop jar SystemML.jar -s "print('hello world');" cd .. Deron
Re: Starting a SystemML 0.10 release?
Hi Luciano, The fix is tested and merged. I believe we should be good to go now to cut an RC. Deron On Fri, May 20, 2016 at 3:13 PM, Deron Erikssonwrote: > Thank you Luciano. I have a fix. I will test with your latest update to > the Apache parent pom and then merge. > > Deron > > > On Fri, May 20, 2016 at 2:58 PM, Luciano Resende > wrote: > >> Ok, thanks for letting me know... I was about to cut a RC1, so I will wait >> a bit more... >> >> On Fri, May 20, 2016 at 2:54 PM, Deron Eriksson >> wrote: >> >> > BTW, I am investigating. I believe the issue is caused because of my >> update >> > to add an assembly (for the proper LICENSE and NOTICE) for the main jar. >> > >> > Deron >> > >> > >> > On Fri, May 20, 2016 at 2:24 PM, Deron Eriksson < >> deroneriks...@gmail.com> >> > wrote: >> > >> > > Hi, >> > > >> > > Luciano, before starting the RC, I think I found an issue. The current >> > > SystemML.jar apparently doesn't specify a main class in the >> MANIFEST.MF >> > > (which it did in the previous 0.9.0-incubating release). Therefore >> > > something like: >> > >$SPARK_HOME/bin/spark-submit SystemML.jar -s "print('hello >> world');" >> > > -exec hybrid_spark >> > > will generate the following error rather than executing: >> > > Error: No main class set in JAR; please specify one with --class >> > > >> > > Deron >> > > >> > > >> > > On Thu, May 19, 2016 at 3:22 PM, Deron Eriksson < >> deroneriks...@gmail.com >> > > >> > > wrote: >> > > >> > >> Hi, >> > >> >> > >> PR162 and PR167 have been merged. Thank you Glenn for all the help >> > >> testing PR167. >> > >> >> > >> Deron >> > >> >> > >> >> > >> On Thu, May 19, 2016 at 12:43 AM, Matthias Boehm >> > >> wrote: >> > >> >> > >>> sounds good to me - in addition to PR167, I'd also like to get PR162 >> > >>> into this release. Furthermore, it would be good to run our full >> > >>> performance testsuite (at least up to 80GB) but this could be done >> on >> > the >> > >>> RC too. Thanks guys for taking care of the release again. >> > >>> >> > >>> Regards, >> > >>> Matthias >> > >>> >> > >>> >> > >>> [image: Inactive hide details for Luciano Resende ---05/18/2016 >> > 06:06:46 >> > >>> PM---On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson >> > > >>> Resende ---05/18/2016 06:06:46 PM---On Wed, May 18, 2016 at 5:49 PM, >> > Deron >> > >>> Eriksson wrote: >> > >>> >> > >>> From: Luciano Resende >> > >>> To: dev@systemml.incubator.apache.org >> > >>> Date: 05/18/2016 06:06 PM >> > >>> Subject: Re: Starting a SystemML 0.10 release? >> > >>> -- >> > >>> >> > >>> >> > >>> >> > >>> On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson < >> > deroneriks...@gmail.com >> > >>> > >> > >>> wrote: >> > >>> >> > >>> > Hi, >> > >>> > >> > >>> > I've looked over all the release packages and the NOTICE and >> LICENSES >> > >>> are >> > >>> > looking much better. I believe we have addressed all of the issues >> > >>> brought >> > >>> > up during the 0.9 release and have fixed many additional issues. >> > >>> > >> > >>> >> > >>> Great, thanks for helping here. >> > >>> >> > >>> >> > >>> > >> > >>> > Are we about ready for our next release, 0.10? I believe it would >> be >> > >>> nice >> > >>> > for PR167 (https://github.com/apache/incubator-systemml/pull/167) >> to >> > >>> be >> > >>> > included since it updates the dml script packaging. Should any >> other >> > >>> > updates be included? Does anyone have any additional concerns? >> > >>> > >> > >>> > >> > >>> Please let me know when this is in then. >> > >>> >> > >>> >> > >>> > Luciano, would you be available as RM for this SystemML release? >> > >>> > >> > >>> >> > >>> Sure. >> > >>> >> > >>> >> > >>> > >> > >>> > Deron >> > >>> > >> > >>> >> > >>> >> > >>> >> > >>> -- >> > >>> Luciano Resende >> > >>> http://twitter.com/lresende1975 >> > >>> http://lresende.blogspot.com/ >> > >>> >> > >>> >> > >>> >> > >> >> > > >> > >> >> >> >> -- >> Luciano Resende >> http://twitter.com/lresende1975 >> http://lresende.blogspot.com/ >> > >
Re: Starting a SystemML 0.10 release?
Thank you Luciano. I have a fix. I will test with your latest update to the Apache parent pom and then merge. Deron On Fri, May 20, 2016 at 2:58 PM, Luciano Resendewrote: > Ok, thanks for letting me know... I was about to cut a RC1, so I will wait > a bit more... > > On Fri, May 20, 2016 at 2:54 PM, Deron Eriksson > wrote: > > > BTW, I am investigating. I believe the issue is caused because of my > update > > to add an assembly (for the proper LICENSE and NOTICE) for the main jar. > > > > Deron > > > > > > On Fri, May 20, 2016 at 2:24 PM, Deron Eriksson > > > wrote: > > > > > Hi, > > > > > > Luciano, before starting the RC, I think I found an issue. The current > > > SystemML.jar apparently doesn't specify a main class in the MANIFEST.MF > > > (which it did in the previous 0.9.0-incubating release). Therefore > > > something like: > > >$SPARK_HOME/bin/spark-submit SystemML.jar -s "print('hello world');" > > > -exec hybrid_spark > > > will generate the following error rather than executing: > > > Error: No main class set in JAR; please specify one with --class > > > > > > Deron > > > > > > > > > On Thu, May 19, 2016 at 3:22 PM, Deron Eriksson < > deroneriks...@gmail.com > > > > > > wrote: > > > > > >> Hi, > > >> > > >> PR162 and PR167 have been merged. Thank you Glenn for all the help > > >> testing PR167. > > >> > > >> Deron > > >> > > >> > > >> On Thu, May 19, 2016 at 12:43 AM, Matthias Boehm > > >> wrote: > > >> > > >>> sounds good to me - in addition to PR167, I'd also like to get PR162 > > >>> into this release. Furthermore, it would be good to run our full > > >>> performance testsuite (at least up to 80GB) but this could be done on > > the > > >>> RC too. Thanks guys for taking care of the release again. > > >>> > > >>> Regards, > > >>> Matthias > > >>> > > >>> > > >>> [image: Inactive hide details for Luciano Resende ---05/18/2016 > > 06:06:46 > > >>> PM---On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson > > >>> Resende ---05/18/2016 06:06:46 PM---On Wed, May 18, 2016 at 5:49 PM, > > Deron > > >>> Eriksson wrote: > > >>> > > >>> From: Luciano Resende > > >>> To: dev@systemml.incubator.apache.org > > >>> Date: 05/18/2016 06:06 PM > > >>> Subject: Re: Starting a SystemML 0.10 release? > > >>> -- > > >>> > > >>> > > >>> > > >>> On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson < > > deroneriks...@gmail.com > > >>> > > > >>> wrote: > > >>> > > >>> > Hi, > > >>> > > > >>> > I've looked over all the release packages and the NOTICE and > LICENSES > > >>> are > > >>> > looking much better. I believe we have addressed all of the issues > > >>> brought > > >>> > up during the 0.9 release and have fixed many additional issues. > > >>> > > > >>> > > >>> Great, thanks for helping here. > > >>> > > >>> > > >>> > > > >>> > Are we about ready for our next release, 0.10? I believe it would > be > > >>> nice > > >>> > for PR167 (https://github.com/apache/incubator-systemml/pull/167) > to > > >>> be > > >>> > included since it updates the dml script packaging. Should any > other > > >>> > updates be included? Does anyone have any additional concerns? > > >>> > > > >>> > > > >>> Please let me know when this is in then. > > >>> > > >>> > > >>> > Luciano, would you be available as RM for this SystemML release? > > >>> > > > >>> > > >>> Sure. > > >>> > > >>> > > >>> > > > >>> > Deron > > >>> > > > >>> > > >>> > > >>> > > >>> -- > > >>> Luciano Resende > > >>> http://twitter.com/lresende1975 > > >>> http://lresende.blogspot.com/ > > >>> > > >>> > > >>> > > >> > > > > > > > > > -- > Luciano Resende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ >
Re: Starting a SystemML 0.10 release?
Ok, thanks for letting me know... I was about to cut a RC1, so I will wait a bit more... On Fri, May 20, 2016 at 2:54 PM, Deron Erikssonwrote: > BTW, I am investigating. I believe the issue is caused because of my update > to add an assembly (for the proper LICENSE and NOTICE) for the main jar. > > Deron > > > On Fri, May 20, 2016 at 2:24 PM, Deron Eriksson > wrote: > > > Hi, > > > > Luciano, before starting the RC, I think I found an issue. The current > > SystemML.jar apparently doesn't specify a main class in the MANIFEST.MF > > (which it did in the previous 0.9.0-incubating release). Therefore > > something like: > >$SPARK_HOME/bin/spark-submit SystemML.jar -s "print('hello world');" > > -exec hybrid_spark > > will generate the following error rather than executing: > > Error: No main class set in JAR; please specify one with --class > > > > Deron > > > > > > On Thu, May 19, 2016 at 3:22 PM, Deron Eriksson > > > wrote: > > > >> Hi, > >> > >> PR162 and PR167 have been merged. Thank you Glenn for all the help > >> testing PR167. > >> > >> Deron > >> > >> > >> On Thu, May 19, 2016 at 12:43 AM, Matthias Boehm > >> wrote: > >> > >>> sounds good to me - in addition to PR167, I'd also like to get PR162 > >>> into this release. Furthermore, it would be good to run our full > >>> performance testsuite (at least up to 80GB) but this could be done on > the > >>> RC too. Thanks guys for taking care of the release again. > >>> > >>> Regards, > >>> Matthias > >>> > >>> > >>> [image: Inactive hide details for Luciano Resende ---05/18/2016 > 06:06:46 > >>> PM---On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson >>> Resende ---05/18/2016 06:06:46 PM---On Wed, May 18, 2016 at 5:49 PM, > Deron > >>> Eriksson wrote: > >>> > >>> From: Luciano Resende > >>> To: dev@systemml.incubator.apache.org > >>> Date: 05/18/2016 06:06 PM > >>> Subject: Re: Starting a SystemML 0.10 release? > >>> -- > >>> > >>> > >>> > >>> On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson < > deroneriks...@gmail.com > >>> > > >>> wrote: > >>> > >>> > Hi, > >>> > > >>> > I've looked over all the release packages and the NOTICE and LICENSES > >>> are > >>> > looking much better. I believe we have addressed all of the issues > >>> brought > >>> > up during the 0.9 release and have fixed many additional issues. > >>> > > >>> > >>> Great, thanks for helping here. > >>> > >>> > >>> > > >>> > Are we about ready for our next release, 0.10? I believe it would be > >>> nice > >>> > for PR167 (https://github.com/apache/incubator-systemml/pull/167) to > >>> be > >>> > included since it updates the dml script packaging. Should any other > >>> > updates be included? Does anyone have any additional concerns? > >>> > > >>> > > >>> Please let me know when this is in then. > >>> > >>> > >>> > Luciano, would you be available as RM for this SystemML release? > >>> > > >>> > >>> Sure. > >>> > >>> > >>> > > >>> > Deron > >>> > > >>> > >>> > >>> > >>> -- > >>> Luciano Resende > >>> http://twitter.com/lresende1975 > >>> http://lresende.blogspot.com/ > >>> > >>> > >>> > >> > > > -- Luciano Resende http://twitter.com/lresende1975 http://lresende.blogspot.com/