Fw: 'hello world' tests of the main distributions

2016-05-21 Thread Berthold Reinwald
resending due to 'text/html' issue.


Regards,
Berthold Reinwald
IBM Almaden Research Center
office: (408) 927 2208; T/L: 457 2208
e-mail: reinw...@us.ibm.com
- Forwarded by Berthold Reinwald/Almaden/IBM on 05/21/2016 12:59 AM 
-

From:   Berthold Reinwald/Almaden/IBM
To: dev@systemml.incubator.apache.org
Date:   05/21/2016 12:39 AM
Subject:Re: 'hello world' tests of the main distributions



Thanks, Deron.

we should include this in the build process.
this is useful to test the integrity of the jar files, but nothing beyond 
that. 
aren't systemml-0.10.0-incubating-SNAPSHOT.jar and SystemML.jar identical, 
and we should drop one of these artifacts.

Regards,
Berthold Reinwald
IBM Almaden Research Center
office: (408) 927 2208; T/L: 457 2208
e-mail: reinw...@us.ibm.com


-Deron Eriksson  wrote: -
To: dev@systemml.incubator.apache.org
From: Deron Eriksson 
Date: 05/20/2016 03:33PM
Subject: 'hello world' tests of the main distributions

Hi,

We have a test suite of 5000+ tests but I don't think we have a standard
way of testing the distribution artifacts once they are built. I just did
some 'hello world' tests of the various distribution artifacts to be sure
that I could run a 'hello world' DML script using the various
distributions. In case it's helpful to others, here are the various things
I did (on OS X).

# build distribution artifacts
mvn clean package -P distribution

cd target

# verify jar works
java -cp ./lib/*:systemml-0.10.0-incubating-SNAPSHOT.jar
org.apache.sysml.api.DMLScript -s "print('hello world');"

# verify SystemML.jar works
java -cp ./lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s
"print('hello world');"

# verify standalone jar works
java -jar systemml-0.10.0-incubating-SNAPSHOT-standalone.jar -s
"print('hello world');"

# verify src works
tar -xvzf systemml-0.10.0-incubating-SNAPSHOT-src.tar.gz
cd systemml-0.10.0-incubating-SNAPSHOT-src
mvn clean package -P distribution
cd target/
java -cp ./lib/*:systemml-0.10.0-incubating-SNAPSHOT.jar
org.apache.sysml.api.DMLScript -s "print('hello world');"
java -cp ./lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s
"print('hello world');"
java -jar systemml-0.10.0-incubating-SNAPSHOT-standalone.jar -s
"print('hello world');"
cd ..
cd ..

# verify in-memory jar works
echo "import org.apache.sysml.api.jmlc.*;public class JMLCEx {public 
static
void main(String[] args) throws Exception {Connection conn = new
Connection();PreparedScript script = conn.prepareScript(\"print('hello
world');\", new String[]{}, new String[]{},
false);script.executeScript();}}" > JMLCEx.java
javac -cp systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar JMLCEx.java
java -cp .:systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar JMLCEx

# verify standalone tar.gz works
tar -xvzf systemml-0.10.0-incubating-SNAPSHOT-standalone.tar.gz
cd systemml-0.10.0-incubating-SNAPSHOT-standalone
echo "print('hello world');" > hello.dml
./runStandaloneSystemML.sh hello.dml
cd ..

# verify distrib tar.gz works
tar -xvzf systemml-0.10.0-incubating-SNAPSHOT.tar.gz
cd systemml-0.10.0-incubating-SNAPSHOT
java -cp ../lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s
"print('hello world');"

export SPARK_HOME=/Users/deroneriksson/spark-1.5.1-bin-hadoop2.6
$SPARK_HOME/bin/spark-submit SystemML.jar -s "print('hello world');" -exec
hybrid_spark

hadoop jar SystemML.jar -s "print('hello world');"
cd ..

Deron




Re: Fw: 'hello world' tests of the main distributions

2016-05-21 Thread Deron Eriksson
Hi Berthold,

I agree that those examples are simply a way to test the integrity of the
various build artifacts at only the most basic level. I wanted to post that
information in case it could help save anyone a few minutes when verifying
our latest release candidates.

The SystemML.jar appears in target/ as part of the build process (it is
identical to the other main jar), since it is included with that name in a
couple of the build artifacts. However, it's not included with the release
candidate files (
https://dist.apache.org/repos/dist/dev/incubator/systemml/0.10.0-incubating-rc1/),
so it can probably stay. It would be fine to delete it at the end of the
build process, if someone wants to tackle it.

Deron


On Sat, May 21, 2016 at 1:04 AM, Berthold Reinwald 
wrote:

> resending due to 'text/html' issue.
>
>
> Regards,
> Berthold Reinwald
> IBM Almaden Research Center
> office: (408) 927 2208; T/L: 457 2208
> e-mail: reinw...@us.ibm.com
> - Forwarded by Berthold Reinwald/Almaden/IBM on 05/21/2016 12:59 AM
> -
>
> From:   Berthold Reinwald/Almaden/IBM
> To: dev@systemml.incubator.apache.org
> Date:   05/21/2016 12:39 AM
> Subject:Re: 'hello world' tests of the main distributions
>
>
>
> Thanks, Deron.
>
> we should include this in the build process.
> this is useful to test the integrity of the jar files, but nothing beyond
> that.
> aren't systemml-0.10.0-incubating-SNAPSHOT.jar and SystemML.jar identical,
> and we should drop one of these artifacts.
>
> Regards,
> Berthold Reinwald
> IBM Almaden Research Center
> office: (408) 927 2208; T/L: 457 2208
> e-mail: reinw...@us.ibm.com
>
>
> -Deron Eriksson  wrote: -
> To: dev@systemml.incubator.apache.org
> From: Deron Eriksson 
> Date: 05/20/2016 03:33PM
> Subject: 'hello world' tests of the main distributions
>
> Hi,
>
> We have a test suite of 5000+ tests but I don't think we have a standard
> way of testing the distribution artifacts once they are built. I just did
> some 'hello world' tests of the various distribution artifacts to be sure
> that I could run a 'hello world' DML script using the various
> distributions. In case it's helpful to others, here are the various things
> I did (on OS X).
>
> # build distribution artifacts
> mvn clean package -P distribution
>
> cd target
>
> # verify jar works
> java -cp ./lib/*:systemml-0.10.0-incubating-SNAPSHOT.jar
> org.apache.sysml.api.DMLScript -s "print('hello world');"
>
> # verify SystemML.jar works
> java -cp ./lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s
> "print('hello world');"
>
> # verify standalone jar works
> java -jar systemml-0.10.0-incubating-SNAPSHOT-standalone.jar -s
> "print('hello world');"
>
> # verify src works
> tar -xvzf systemml-0.10.0-incubating-SNAPSHOT-src.tar.gz
> cd systemml-0.10.0-incubating-SNAPSHOT-src
> mvn clean package -P distribution
> cd target/
> java -cp ./lib/*:systemml-0.10.0-incubating-SNAPSHOT.jar
> org.apache.sysml.api.DMLScript -s "print('hello world');"
> java -cp ./lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s
> "print('hello world');"
> java -jar systemml-0.10.0-incubating-SNAPSHOT-standalone.jar -s
> "print('hello world');"
> cd ..
> cd ..
>
> # verify in-memory jar works
> echo "import org.apache.sysml.api.jmlc.*;public class JMLCEx {public
> static
> void main(String[] args) throws Exception {Connection conn = new
> Connection();PreparedScript script = conn.prepareScript(\"print('hello
> world');\", new String[]{}, new String[]{},
> false);script.executeScript();}}" > JMLCEx.java
> javac -cp systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar JMLCEx.java
> java -cp .:systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar JMLCEx
>
> # verify standalone tar.gz works
> tar -xvzf systemml-0.10.0-incubating-SNAPSHOT-standalone.tar.gz
> cd systemml-0.10.0-incubating-SNAPSHOT-standalone
> echo "print('hello world');" > hello.dml
> ./runStandaloneSystemML.sh hello.dml
> cd ..
>
> # verify distrib tar.gz works
> tar -xvzf systemml-0.10.0-incubating-SNAPSHOT.tar.gz
> cd systemml-0.10.0-incubating-SNAPSHOT
> java -cp ../lib/*:SystemML.jar org.apache.sysml.api.DMLScript -s
> "print('hello world');"
>
> export SPARK_HOME=/Users/deroneriksson/spark-1.5.1-bin-hadoop2.6
> $SPARK_HOME/bin/spark-submit SystemML.jar -s "print('hello world');" -exec
> hybrid_spark
>
> hadoop jar SystemML.jar -s "print('hello world');"
> cd ..
>
> Deron
>
>
>