Re: Running the bivar-stats example

2016-10-19 Thread Glenn Weidner
Hi Sandeep, Thank you for contacting the Apache SystemML community. Based on the following trace fragment: spark.SparkContext: Running Spark version 2.0.0 it looks like you're running against Spark 2.0 which is not officially supported with the current master code base. Can you retry with an

Running the bivar-stats example

2016-10-19 Thread Narayanaswami, Sandeep
Hi SystemML community, I’m trying to run the bivariate stats example script on Spark. I’m only doing a toy example with very small data, but I have been running into errors. My script invocation is as follows: spark-submit --master local[4] SystemML.jar -f scripts/algorithms/bivar-stats.dml

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Glenn Weidner
Yes - that is correct for test cases involving ID column for DataFrameVectorFrameConversionTest, DataFrameVectorScriptTest, MLContextTest. The four failures for MLContextFrameTest were slightly different and involve similar fix as done for FrameConverterTest under [SYSTEMML-568] where

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Deron Eriksson
OK, so I think it's my understanding that for the 'src' release for rc3, the pom is using Spark 1.4 and the test suite passes for Spark 1.4, so this issue being discussed regarding test cases on Spark 1.6 is not a blocker for this release since the 'src' release builds and all tests pass. If this

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Luciano Resende
if tests are consistently failing, then we should cancel the RC and either fix the test or mark it as @ignored. Intermittent fails might be ok, but it's a community decision. On Wed, Oct 19, 2016 at 10:50 AM, Deron Eriksson wrote: > I believe that for an Apache

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Deron Eriksson
I believe that for an Apache release, our test suite is supposed to pass (although I'm pretty sure random test fails can be ignored). See 2.1 of Release Check List here: http://incubator.apache.org/guides/releasemanagement.html#check-list "2.1 Build is successful including automated tests. The

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Glenn Weidner
It's a nice-to-have but not a release blocker. Thanks, Glenn From: Niketan Pansare/Almaden/IBM@IBMUS To: dev@systemml.incubator.apache.org Date: 10/18/2016 05:38 PM Subject:Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3) Glenn: Would you prefer to have

Re: Contributing to SystemML, was Re: Building a community around SystemML

2016-10-19 Thread Dhiren Navani
Thanks Luciano! I am a student actually. So I got busy with academics. But I do want to learn working with SystemML, though taking it slowly. For now can you point me to the resources to start with? On 18 October 2016 at 16:01, Luciano Resende wrote: > On Wed, Sep 28, 2016

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Acs S
So far all issues Glen has seen based on running unit test cases using Spark 1.6 are related to Test Case code itself, not base code. Probably we don't need to include that change at this hour for 0.11 unless there are any critical issues we need to get in. -Arvind From: Niketan Pansare