Re: GSoC Project Presentation Guobao (Parameter Server)

2018-08-10 Thread Krishna Kalyan
Congratulations Guobao. On Thu, Aug 9, 2018, 8:22 PM Guobao Li wrote: > Thanks Deron! It was my great pleasure. > > On Thu, Aug 9, 2018 at 8:17 PM Deron Eriksson > wrote: > > > Great work and presentation, Guobao! Congratulations! > > > > Deron > > > > On Thu, Aug 9, 2018 at 9:52 AM Matthias

Re: [VOTE] Apache SystemML 1.1.0 (RC2)

2018-03-27 Thread Krishna Kalyan
+1 Ran performance test suite one singlenode and hybrid spark execution mode. On Tue, Mar 27, 2018 at 2:40 AM, Ted Yu wrote: > +1 > > Ran Unit tests. > > On Mon, Mar 26, 2018 at 3:00 PM, Niketan Pansare > wrote: > > > +1. Ran NN Unit test for GPU and

Re: [Discuss] GSoC 2018

2018-01-30 Thread Krishna Kalyan
l - On Sun, Jan 28, 2018 at 12:41 AM, Krishna Kalyan <krishnakaly...@gmail.com> wrote: > Hello Matthias and Nakul, > 4 more ideas that could be included. > > [Perftest] > - Compare runtime System-ML to Julia, R, Sklearn, Spark MLLib based on data > gen scripts. >

Re: [Discuss] GSoC 2018

2018-01-28 Thread Krishna Kalyan
; > > > > > On 1/22/2018 8:53 AM, Nakul Jindal wrote: > > > > > > > >> Hi Krishna, > > > >> > > > >> That is a great idea. Thank you for offering to be a > mentor/co-mentor. > > > >> I suggest that you th

[Discuss] GSoC 2018

2018-01-21 Thread Krishna Kalyan
Hello All, I was wondering if system-ml community was planning to participate in GSoC this year. I had a wonderful time last year and learned a lot!. If we could have a couple of JIRAS for GSoC 2018 it would be great. I am willing to help out as a mentor/ co-mentor if that is a bottleneck. [1]

Univariate Stats : Error during performance test

2017-12-06 Thread Krishna Kalyan
Hello All, I noticed minor error for (Univariate Stats) while running my performance test loads. ERROR: Categorical attributes can only take values starting from 1. Encountered a value .SCALAR.STRING.true minF.SCALAR.DOUBLE.false _Var73.SCALAR.STRING Full trace:

Running Performance Test workloads

2017-12-06 Thread Krishna Kalyan
Hello, I have been running some performance tests on AWS, EMR Cluster. [1 master, 2 slaves] instance type m3.xlarge. Incase you want to run some performance workloads on 1.0.0 release please follow the steps below. - Set SYSTEMML_HOME, SPARK_HOME environment variables in your cluster - Download

Re: SystemML 1.0 release timeline

2017-11-14 Thread Krishna Kalyan
+1 Regards, Krishna On Sun, Nov 12, 2017 at 5:53 AM, Matthias Boehm wrote: > just FYI: I've created SYSTEMML-2011 to track all QA-related tasks and > issues. The first run of our (old) perftest suite for 80MB-80GB ran fine > except for a data generation issue on stratstats

Re: PCA data gen script, no output

2017-09-16 Thread Krishna Kalyan
ns. If this does not > work, I would suspect some permission issues next - maybe the bridge from > python to the jvm hides some error output. If this is also not the case, > please provide the -explain output and I have a closer look. > > Regards, > Matthias > > On Fri, Se

Re: PCA data gen script, no output

2017-09-16 Thread Krishna Kalyan
ark context creation) in my environment. Since your log shows > a runtime of 5000s, you might want to reduce the data size a bit. > > Regards, > Matthias > > On Fri, Sep 15, 2017 at 11:08 PM, Krishna Kalyan <krishnakaly...@gmail.com > > > wrote: > > > Thanks for

Re: PCA data gen script, no output

2017-09-16 Thread Krishna Kalyan
n Fri, Sep 15, 2017 at 5:47 PM, Krishna Kalyan <krishnakaly...@gmail.com> > wrote: > > > Hello, > > I using PCA > > <https://github.com/apache/systemml/blob/master/scripts/ > > datagen/genRandData4PCA.dml> > > data > > generation scripts to gener

PCA data gen script, no output

2017-09-15 Thread Krishna Kalyan
Hello, I using PCA data generation scripts to generate data. Unfortunately they do not produce any output in the specified target directory. Command used: systemml/bin/systemml-spark-submit.py -f

Re: [VOTE] Apache SystemML 0.15.0 (RC2)

2017-09-13 Thread Krishna Kalyan
+1 Ran perf test suit (80 MB) for all families on my local machine. Krishna On Wed, Sep 13, 2017 at 2:35 PM, Arvind Surve wrote: > +1 > - Run successful automation verification for following-- License > Verification > -- Binary Artifacts-- Source code

Setting up python3 dev environment

2017-09-09 Thread Krishna Kalyan
Hello, I have problems setting up dev environment to work with python DML. Step taken: cd systemml mvn clean package cd src/main/python/ sudo pip3 install -e . Sample Code that I ran, #!/usr/bin/env python3 import numpy as np import systemml as sml from pyspark import SparkContext sc =

Performance Test: Phase-2 Release

2017-08-02 Thread Krishna Kalyan
Dear SystemML Community, Thank you so much for your support and guidance so far. Our Phase-2 release includes: - HDFS support - Support to upload pref-test results automatically to google docs + automatically summarise data from google docs between two versions. - Support for additional arguments

Re: Training Failure in Clustering : Execution mode singlenode

2017-07-30 Thread Krishna Kalyan
it. However, I'm able to > reproduce > > the issue when forcing it into singlenode. Thanks for catching this - > I'll > > take care of it. > > > > Regards, > > Matthias > > > > > > On Sat, Jul 29, 2017 at 9:34 AM, Krishna Kalyan < > krishnak

Training Failure in Clustering : Execution mode singlenode

2017-07-29 Thread Krishna Kalyan
Hello All, I am faced with an error below while trying to train Kmeans algorithm. ERROR: Runtime error in program block generated from statement block between lines 94 and 120 Could someone please guide with the fix. Full Error Stack Trace :

Issue with Clustering : Predict

2017-07-26 Thread Krishna Kalyan
Hello All, I am having issues with running the predict script of the clustering algorithm. I am unable to figure out what exactly is the problem and how to go about fixing it. Could someone please guide. Steps I followed. Ran data-gen scrips for clustering Ran training scripts for clustering Ran

Questions on ALS documentation

2017-06-06 Thread Krishna Kalyan
Hello, According to the documentation below http://apache.github.io/incubator-systemml/algorithms-matrix-factorization.html#usage-1 The usage of ALS algorithm can be invoked by calling ALS.dml script. However in the algorithms folder we have ALS-CG.dml ALS-DS.dml I was wondering if we need to