Re: Running the bivar-stats example

2016-10-19 Thread Glenn Weidner
Hi Sandeep, Thank you for contacting the Apache SystemML community. Based on the following trace fragment: spark.SparkContext: Running Spark version 2.0.0 it looks like you're running against Spark 2.0 which is not officially supported with the current master code base. Can you retry with an e

Running the bivar-stats example

2016-10-19 Thread Narayanaswami, Sandeep
Hi SystemML community, I’m trying to run the bivariate stats example script on Spark. I’m only doing a toy example with very small data, but I have been running into errors. My script invocation is as follows: spark-submit --master local[4] SystemML.jar -f scripts/algorithms/bivar-stats.dml -ex

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Glenn Weidner
Yes - that is correct for test cases involving ID column for DataFrameVectorFrameConversionTest, DataFrameVectorScriptTest, MLContextTest. The four failures for MLContextFrameTest were slightly different and involve similar fix as done for FrameConverterTest under [SYSTEMML-568] where FrameRDDCon

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Matthias Boehm
Glenn, all these issues were only caused by wrong tests that used an invalid ID schema or populated this column incorrectly, right? If so, then I think it's fine to release. However, if we touch it anyway, we should globally change the ID schema from double to long, which is more intuitive when

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Deron Eriksson
OK, so I think it's my understanding that for the 'src' release for rc3, the pom is using Spark 1.4 and the test suite passes for Spark 1.4, so this issue being discussed regarding test cases on Spark 1.6 is not a blocker for this release since the 'src' release builds and all tests pass. If this

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Luciano Resende
if tests are consistently failing, then we should cancel the RC and either fix the test or mark it as @ignored. Intermittent fails might be ok, but it's a community decision. On Wed, Oct 19, 2016 at 10:50 AM, Deron Eriksson wrote: > I believe that for an Apache release, our test suite is suppos

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Deron Eriksson
I believe that for an Apache release, our test suite is supposed to pass (although I'm pretty sure random test fails can be ignored). See 2.1 of Release Check List here: http://incubator.apache.org/guides/releasemanagement.html#check-list "2.1 Build is successful including automated tests. The ex

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Glenn Weidner
It's a nice-to-have but not a release blocker. Thanks, Glenn From: Niketan Pansare/Almaden/IBM@IBMUS To: dev@systemml.incubator.apache.org Date: 10/18/2016 05:38 PM Subject:Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3) Glenn: Would you prefer to have https://github.com/

Re: Contributing to SystemML, was Re: Building a community around SystemML

2016-10-19 Thread Dhiren Navani
Thanks Luciano! I am a student actually. So I got busy with academics. But I do want to learn working with SystemML, though taking it slowly. For now can you point me to the resources to start with? On 18 October 2016 at 16:01, Luciano Resende wrote: > On Wed, Sep 28, 2016 at 1:50 PM, Dhiren Nav