[VOTE] Apache SystemML 0.10.0-incubating (RC1)

2016-05-20 Thread Luciano Resende
Please vote on releasing the following candidate as Apache SystemML version
0.10.0-incubating !

The vote is open for at least 72 hours and will close on Saturday,
Wednesday 25 and passes if a majority of at least 3 +1 PMC votes are cast.

[ ] +1 Release this package as Apache SystemML 0.10.0-incubating
[ ] -1 Do not release this package because ...

To learn more about Apache SystemML, please see http://systemml.apache.org/

The tag to be voted on is v0.10.0-incubating-rc1
(ddf0e0941afe5d9c2cc7c574a6983aadd98c1fc3)

https://github.com/apache/incubator-systemml/tree/ddf0e0941afe5d9c2cc7c574a6983aadd98c1fc3

The release artifacts can be found at :

https://dist.apache.org/repos/dist/dev/incubator/systemml/0.10.0-incubating-rc1/

The maven release artifacts, including signatures, digests, etc. can be
found at:

https://repository.apache.org/content/repositories/orgapachesystemml-1005/


=
== Apache Incubator release policy ==
=
Please find below the guide to release management during incubation:
http://incubator.apache.org/guides/releasemanagement.html

===
== How can I help test this release? ==
===
If you are a SystemML user, you can help us test this release by taking an
existing Algorithm or workload and running on this release candidate, then
reporting any regressions.


== What justifies a -1 vote for this release? ==

-1 votes should only occur for significant stop-ship bugs or legal related
issues (e.g. wrong license, missing header files, etc). Minor bugs or
regressions should not block this release.


-- 
Luciano Resende
http://twitter.com/lresende1975
http://lresende.blogspot.com/


'hello world' tests of the main distributions

2016-05-20 Thread Deron Eriksson
Hi,

We have a test suite of 5000+ tests but I don't think we have a standard
way of testing the distribution artifacts once they are built. I just did
some 'hello world' tests of the various distribution artifacts to be sure
that I could run a 'hello world' DML script using the various
distributions. In case it's helpful to others, here are the various things
I did (on OS X).

# build distribution artifacts
mvn clean package -P distribution

cd target

# verify jar works
java -cp ./lib/*:systemml-0.10.0-incubating-SNAPSHOT.jar
org.apache.sysml.api.DMLScript -s "print('hello world');"

# verify SystemML.jar works
java -cp ./lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s
"print('hello world');"

# verify standalone jar works
java -jar systemml-0.10.0-incubating-SNAPSHOT-standalone.jar -s
"print('hello world');"

# verify src works
tar -xvzf systemml-0.10.0-incubating-SNAPSHOT-src.tar.gz
cd systemml-0.10.0-incubating-SNAPSHOT-src
mvn clean package -P distribution
cd target/
java -cp ./lib/*:systemml-0.10.0-incubating-SNAPSHOT.jar
org.apache.sysml.api.DMLScript -s "print('hello world');"
java -cp ./lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s
"print('hello world');"
java -jar systemml-0.10.0-incubating-SNAPSHOT-standalone.jar -s
"print('hello world');"
cd ..
cd ..

# verify in-memory jar works
echo "import org.apache.sysml.api.jmlc.*;public class JMLCEx {public static
void main(String[] args) throws Exception {Connection conn = new
Connection();PreparedScript script = conn.prepareScript(\"print('hello
world');\", new String[]{}, new String[]{},
false);script.executeScript();}}" > JMLCEx.java
javac -cp systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar JMLCEx.java
java -cp .:systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar JMLCEx

# verify standalone tar.gz works
tar -xvzf systemml-0.10.0-incubating-SNAPSHOT-standalone.tar.gz
cd systemml-0.10.0-incubating-SNAPSHOT-standalone
echo "print('hello world');" > hello.dml
./runStandaloneSystemML.sh hello.dml
cd ..

# verify distrib tar.gz works
tar -xvzf systemml-0.10.0-incubating-SNAPSHOT.tar.gz
cd systemml-0.10.0-incubating-SNAPSHOT
java -cp ../lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s
"print('hello world');"

export SPARK_HOME=/Users/deroneriksson/spark-1.5.1-bin-hadoop2.6
$SPARK_HOME/bin/spark-submit SystemML.jar -s "print('hello world');" -exec
hybrid_spark

hadoop jar SystemML.jar -s "print('hello world');"
cd ..

Deron


Re: Starting a SystemML 0.10 release?

2016-05-20 Thread Deron Eriksson
Hi Luciano,

The fix is tested and merged. I believe we should be good to go now to cut
an RC.

Deron


On Fri, May 20, 2016 at 3:13 PM, Deron Eriksson 
wrote:

> Thank you Luciano. I have a fix. I will test with your latest update to
> the Apache parent pom and then merge.
>
> Deron
>
>
> On Fri, May 20, 2016 at 2:58 PM, Luciano Resende 
> wrote:
>
>> Ok, thanks for letting me know... I was about to cut a RC1, so I will wait
>> a bit more...
>>
>> On Fri, May 20, 2016 at 2:54 PM, Deron Eriksson 
>> wrote:
>>
>> > BTW, I am investigating. I believe the issue is caused because of my
>> update
>> > to add an assembly (for the proper LICENSE and NOTICE) for the main jar.
>> >
>> > Deron
>> >
>> >
>> > On Fri, May 20, 2016 at 2:24 PM, Deron Eriksson <
>> deroneriks...@gmail.com>
>> > wrote:
>> >
>> > > Hi,
>> > >
>> > > Luciano, before starting the RC, I think I found an issue. The current
>> > > SystemML.jar apparently doesn't specify a main class in the
>> MANIFEST.MF
>> > > (which it did in the previous 0.9.0-incubating release).  Therefore
>> > > something like:
>> > >$SPARK_HOME/bin/spark-submit SystemML.jar -s "print('hello
>> world');"
>> > > -exec hybrid_spark
>> > > will generate the following error rather than executing:
>> > >   Error: No main class set in JAR; please specify one with --class
>> > >
>> > > Deron
>> > >
>> > >
>> > > On Thu, May 19, 2016 at 3:22 PM, Deron Eriksson <
>> deroneriks...@gmail.com
>> > >
>> > > wrote:
>> > >
>> > >> Hi,
>> > >>
>> > >> PR162 and PR167 have been merged. Thank you Glenn for all the help
>> > >> testing PR167.
>> > >>
>> > >> Deron
>> > >>
>> > >>
>> > >> On Thu, May 19, 2016 at 12:43 AM, Matthias Boehm 
>> > >> wrote:
>> > >>
>> > >>> sounds good to me - in addition to PR167, I'd also like to get PR162
>> > >>> into this release. Furthermore, it would be good to run our full
>> > >>> performance testsuite (at least up to 80GB) but this could be done
>> on
>> > the
>> > >>> RC too. Thanks guys for taking care of the release again.
>> > >>>
>> > >>> Regards,
>> > >>> Matthias
>> > >>>
>> > >>>
>> > >>> [image: Inactive hide details for Luciano Resende ---05/18/2016
>> > 06:06:46
>> > >>> PM---On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson
>> > > >>> Resende ---05/18/2016 06:06:46 PM---On Wed, May 18, 2016 at 5:49 PM,
>> > Deron
>> > >>> Eriksson  wrote:
>> > >>>
>> > >>> From: Luciano Resende 
>> > >>> To: dev@systemml.incubator.apache.org
>> > >>> Date: 05/18/2016 06:06 PM
>> > >>> Subject: Re: Starting a SystemML 0.10 release?
>> > >>> --
>> > >>>
>> > >>>
>> > >>>
>> > >>> On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson <
>> > deroneriks...@gmail.com
>> > >>> >
>> > >>> wrote:
>> > >>>
>> > >>> > Hi,
>> > >>> >
>> > >>> > I've looked over all the release packages and the NOTICE and
>> LICENSES
>> > >>> are
>> > >>> > looking much better. I believe we have addressed all of the issues
>> > >>> brought
>> > >>> > up during the 0.9 release and have fixed many additional issues.
>> > >>> >
>> > >>>
>> > >>> Great, thanks for helping here.
>> > >>>
>> > >>>
>> > >>> >
>> > >>> > Are we about ready for our next release, 0.10? I believe it would
>> be
>> > >>> nice
>> > >>> > for PR167 (https://github.com/apache/incubator-systemml/pull/167)
>> to
>> > >>> be
>> > >>> > included since it updates the dml script packaging. Should any
>> other
>> > >>> > updates be included? Does anyone have any additional concerns?
>> > >>> >
>> > >>> >
>> > >>> Please let me know when this is in then.
>> > >>>
>> > >>>
>> > >>> > Luciano, would you be available as RM for this SystemML release?
>> > >>> >
>> > >>>
>> > >>> Sure.
>> > >>>
>> > >>>
>> > >>> >
>> > >>> > Deron
>> > >>> >
>> > >>>
>> > >>>
>> > >>>
>> > >>> --
>> > >>> Luciano Resende
>> > >>> http://twitter.com/lresende1975
>> > >>> http://lresende.blogspot.com/
>> > >>>
>> > >>>
>> > >>>
>> > >>
>> > >
>> >
>>
>>
>>
>> --
>> Luciano Resende
>> http://twitter.com/lresende1975
>> http://lresende.blogspot.com/
>>
>
>


Re: Starting a SystemML 0.10 release?

2016-05-20 Thread Deron Eriksson
Thank you Luciano. I have a fix. I will test with your latest update to the
Apache parent pom and then merge.

Deron


On Fri, May 20, 2016 at 2:58 PM, Luciano Resende 
wrote:

> Ok, thanks for letting me know... I was about to cut a RC1, so I will wait
> a bit more...
>
> On Fri, May 20, 2016 at 2:54 PM, Deron Eriksson 
> wrote:
>
> > BTW, I am investigating. I believe the issue is caused because of my
> update
> > to add an assembly (for the proper LICENSE and NOTICE) for the main jar.
> >
> > Deron
> >
> >
> > On Fri, May 20, 2016 at 2:24 PM, Deron Eriksson  >
> > wrote:
> >
> > > Hi,
> > >
> > > Luciano, before starting the RC, I think I found an issue. The current
> > > SystemML.jar apparently doesn't specify a main class in the MANIFEST.MF
> > > (which it did in the previous 0.9.0-incubating release).  Therefore
> > > something like:
> > >$SPARK_HOME/bin/spark-submit SystemML.jar -s "print('hello world');"
> > > -exec hybrid_spark
> > > will generate the following error rather than executing:
> > >   Error: No main class set in JAR; please specify one with --class
> > >
> > > Deron
> > >
> > >
> > > On Thu, May 19, 2016 at 3:22 PM, Deron Eriksson <
> deroneriks...@gmail.com
> > >
> > > wrote:
> > >
> > >> Hi,
> > >>
> > >> PR162 and PR167 have been merged. Thank you Glenn for all the help
> > >> testing PR167.
> > >>
> > >> Deron
> > >>
> > >>
> > >> On Thu, May 19, 2016 at 12:43 AM, Matthias Boehm 
> > >> wrote:
> > >>
> > >>> sounds good to me - in addition to PR167, I'd also like to get PR162
> > >>> into this release. Furthermore, it would be good to run our full
> > >>> performance testsuite (at least up to 80GB) but this could be done on
> > the
> > >>> RC too. Thanks guys for taking care of the release again.
> > >>>
> > >>> Regards,
> > >>> Matthias
> > >>>
> > >>>
> > >>> [image: Inactive hide details for Luciano Resende ---05/18/2016
> > 06:06:46
> > >>> PM---On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson
>  > >>> Resende ---05/18/2016 06:06:46 PM---On Wed, May 18, 2016 at 5:49 PM,
> > Deron
> > >>> Eriksson  wrote:
> > >>>
> > >>> From: Luciano Resende 
> > >>> To: dev@systemml.incubator.apache.org
> > >>> Date: 05/18/2016 06:06 PM
> > >>> Subject: Re: Starting a SystemML 0.10 release?
> > >>> --
> > >>>
> > >>>
> > >>>
> > >>> On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson <
> > deroneriks...@gmail.com
> > >>> >
> > >>> wrote:
> > >>>
> > >>> > Hi,
> > >>> >
> > >>> > I've looked over all the release packages and the NOTICE and
> LICENSES
> > >>> are
> > >>> > looking much better. I believe we have addressed all of the issues
> > >>> brought
> > >>> > up during the 0.9 release and have fixed many additional issues.
> > >>> >
> > >>>
> > >>> Great, thanks for helping here.
> > >>>
> > >>>
> > >>> >
> > >>> > Are we about ready for our next release, 0.10? I believe it would
> be
> > >>> nice
> > >>> > for PR167 (https://github.com/apache/incubator-systemml/pull/167)
> to
> > >>> be
> > >>> > included since it updates the dml script packaging. Should any
> other
> > >>> > updates be included? Does anyone have any additional concerns?
> > >>> >
> > >>> >
> > >>> Please let me know when this is in then.
> > >>>
> > >>>
> > >>> > Luciano, would you be available as RM for this SystemML release?
> > >>> >
> > >>>
> > >>> Sure.
> > >>>
> > >>>
> > >>> >
> > >>> > Deron
> > >>> >
> > >>>
> > >>>
> > >>>
> > >>> --
> > >>> Luciano Resende
> > >>> http://twitter.com/lresende1975
> > >>> http://lresende.blogspot.com/
> > >>>
> > >>>
> > >>>
> > >>
> > >
> >
>
>
>
> --
> Luciano Resende
> http://twitter.com/lresende1975
> http://lresende.blogspot.com/
>


Re: Starting a SystemML 0.10 release?

2016-05-20 Thread Luciano Resende
Ok, thanks for letting me know... I was about to cut a RC1, so I will wait
a bit more...

On Fri, May 20, 2016 at 2:54 PM, Deron Eriksson 
wrote:

> BTW, I am investigating. I believe the issue is caused because of my update
> to add an assembly (for the proper LICENSE and NOTICE) for the main jar.
>
> Deron
>
>
> On Fri, May 20, 2016 at 2:24 PM, Deron Eriksson 
> wrote:
>
> > Hi,
> >
> > Luciano, before starting the RC, I think I found an issue. The current
> > SystemML.jar apparently doesn't specify a main class in the MANIFEST.MF
> > (which it did in the previous 0.9.0-incubating release).  Therefore
> > something like:
> >$SPARK_HOME/bin/spark-submit SystemML.jar -s "print('hello world');"
> > -exec hybrid_spark
> > will generate the following error rather than executing:
> >   Error: No main class set in JAR; please specify one with --class
> >
> > Deron
> >
> >
> > On Thu, May 19, 2016 at 3:22 PM, Deron Eriksson  >
> > wrote:
> >
> >> Hi,
> >>
> >> PR162 and PR167 have been merged. Thank you Glenn for all the help
> >> testing PR167.
> >>
> >> Deron
> >>
> >>
> >> On Thu, May 19, 2016 at 12:43 AM, Matthias Boehm 
> >> wrote:
> >>
> >>> sounds good to me - in addition to PR167, I'd also like to get PR162
> >>> into this release. Furthermore, it would be good to run our full
> >>> performance testsuite (at least up to 80GB) but this could be done on
> the
> >>> RC too. Thanks guys for taking care of the release again.
> >>>
> >>> Regards,
> >>> Matthias
> >>>
> >>>
> >>> [image: Inactive hide details for Luciano Resende ---05/18/2016
> 06:06:46
> >>> PM---On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson  >>> Resende ---05/18/2016 06:06:46 PM---On Wed, May 18, 2016 at 5:49 PM,
> Deron
> >>> Eriksson  wrote:
> >>>
> >>> From: Luciano Resende 
> >>> To: dev@systemml.incubator.apache.org
> >>> Date: 05/18/2016 06:06 PM
> >>> Subject: Re: Starting a SystemML 0.10 release?
> >>> --
> >>>
> >>>
> >>>
> >>> On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson <
> deroneriks...@gmail.com
> >>> >
> >>> wrote:
> >>>
> >>> > Hi,
> >>> >
> >>> > I've looked over all the release packages and the NOTICE and LICENSES
> >>> are
> >>> > looking much better. I believe we have addressed all of the issues
> >>> brought
> >>> > up during the 0.9 release and have fixed many additional issues.
> >>> >
> >>>
> >>> Great, thanks for helping here.
> >>>
> >>>
> >>> >
> >>> > Are we about ready for our next release, 0.10? I believe it would be
> >>> nice
> >>> > for PR167 (https://github.com/apache/incubator-systemml/pull/167) to
> >>> be
> >>> > included since it updates the dml script packaging. Should any other
> >>> > updates be included? Does anyone have any additional concerns?
> >>> >
> >>> >
> >>> Please let me know when this is in then.
> >>>
> >>>
> >>> > Luciano, would you be available as RM for this SystemML release?
> >>> >
> >>>
> >>> Sure.
> >>>
> >>>
> >>> >
> >>> > Deron
> >>> >
> >>>
> >>>
> >>>
> >>> --
> >>> Luciano Resende
> >>> http://twitter.com/lresende1975
> >>> http://lresende.blogspot.com/
> >>>
> >>>
> >>>
> >>
> >
>



-- 
Luciano Resende
http://twitter.com/lresende1975
http://lresende.blogspot.com/