Re: [VOTE] Apache SystemML 0.13.0-incubating (RC2)

2017-02-23 Thread fschueler
+1 Ran the same python notebook that Glenn ran on a Spark 2.1 instance using python 2.7 and ran the examples from the MLContext documentation on a Scala (Toree) notebook using Spark 2.1. -Felix Am 24.02.2017 01:46 schrieb Glenn Weidner: +1 Successfully ran LinearRegression,

Re: Minimum required Spark version

2017-02-21 Thread fschueler
Thanks Deron :) Am 21.02.2017 10:09 schrieb Deron Eriksson: Note that MLContext has been updated to log a warning rather than throw an exception to the user for Spark versions previous to 2.1.0. Deron On Mon, Feb 20, 2017 at 2:29 PM, Matthias Boehm1 wrote: that's

Remove documentation for old MLContext API

2017-02-02 Thread fschueler
As a step to deprecate the old MLContext API, I suggest to remove its documentation for the next release (together with a deprecation of the actual API so that we can remove it in 1.0). Currently the section about the old API is placed in between up-to-date documentation and makes it pretty

Scala API/DSL alignment

2017-01-20 Thread fschueler
Hi all, I started writing a short doc that summarized our current approaches to interacting with SystemML in Scala: https://docs.google.com/document/d/1ntdfmSBB83zdcWZl2iv4yMsrA3ZHDM-mzX5lMfFpfeo/edit?usp=sharing The doc contains currently implemented features as well as considerations for

Re: Maven build failing

2017-01-06 Thread fschueler
Hi Sandeep, it seems like you can't connect to the maven repository. Can you open the link to the repository in a browser? (https://repo1.maven.org/maven2/) Are you behind a proxy maybe? If nothing else, you can download a binary release from our website to get started working with

[Discuss] Google Summer of Code (GSoc) 2017

2017-01-06 Thread fschueler
Hi all, as it just came up on the ML, I want to bring this up again for general discussion. I think we should try to get at least one or two students for this year's GSOC. If you have never heard of GSOC, look here: http://write.flossmanuals.net/gsoc-mentoring/what-is-gsoc/ and here:

Performance differences between SystemML LibMatrixMult and Breeze with native BLAS

2016-11-30 Thread fschueler
(our default blocksize) with Breeze being about 5-6 times faster here. The code I used can be found here: https://github.com/fschueler/incubator-systemml/blob/model_types/src/test/scala/org/apache/sysml/api/linalg/layout/local/SystemMLLocalBackendTest.scala Running this code with 50 iterations

Re: Parfor semantics

2016-11-22 Thread fschueler
The constrained optimizer doesn't seem to know about a REMOTE_SPARK execution mode and either sets CP or REMOTE_MR. I can open a jira for that and provide a fix. Felix Am 22.11.2016 02:07 schrieb Matthias Boehm: yes, this came up several times - initially we only supported opt=NONE where

Parfor semantics

2016-11-21 Thread fschueler
While debugging some ParFor code it became clear that the parameters for parfor can be easily overwritten by the optimizer. One example is when I write: ``` parfor (i in 1:10, par=10, mode=REMOTE_SPARK) { // some code here } ``` Depending on the data size and cluster resources, the

Collection project progress for SystemML report

2016-10-31 Thread fschueler
Hi all, we are in the process of writing the next Apache PMC report for SystemML. This report is an important part of the graduation process as an Apache incubator where we can show our progress as a project and community. We are therefore collecting everything that demonstrates the progress

Re: Podling Report Reminder - November 2016

2016-10-31 Thread fschueler
I will help you, Deron! Felix Am 31.10.2016 20:26 schrieb Deron Eriksson: If there are no other volunteers to help with the report, I will help. If anyone else is interested in writing the monthly report, I would also be very happy to provide any assistance and guidance. Contributing to the

Re: [VOTE] SystemML New Logo Ideas

2016-10-21 Thread fschueler
I really like all of these ideas, so whatever is chosen in the end will be great. #1 and #2 remind me a little bit of the lightbend logo (http://www.lightbend.com/) and I like the isometric versions for shirts, stickers, action figures ;) Am 21.10.2016 20:27 schrieb Frederick R Reiss:

Re: UX Research

2016-10-17 Thread fschueler
Jeremy and others, thanks for the detailed presentation! The storyboards look great and it would be nice to see SystemML getting to a point where those scenarios just work! From the point of development I wonder how much is adding new features (that enhance user experience) versus making it

Re: Building a community around SystemML

2016-09-28 Thread fschueler
I think those are excellent ideas! Especially the point about communicating on the mailing-list. Google summer of code is a great way of getting people involved with the project long-term and we should think about possible projects. Application for mentoring organizations usually starts in

Re: Proof of Concept: Embedded Scala DSL

2016-09-28 Thread fschueler
it is not necessarily required but please make the scope explicit. Regards, Matthias fschueler---09/23/2016 04:36:14 PM---As discussed in the related Jira (SYSTEMML-451) I have started to implement a prototype/proof of co From: fschue...@posteo.de To: dev@systemml.incubator.apache.org Date: 09/23/2016 04

Re: Proof of Concept: Embedded Scala DSL

2016-09-26 Thread fschueler
operations? I think for this initial prototype it is not necessarily required but please make the scope explicit. Regards, Matthias fschueler---09/23/2016 04:36:14 PM---As discussed in the related Jira (SYSTEMML-451) I have started to implement a prototype/proof of co From: fschue...@posteo.de

Proof of Concept: Embedded Scala DSL

2016-09-23 Thread fschueler
As discussed in the related Jira (SYSTEMML-451) I have started to implement a prototype/proof of concept for an embedded DSL in Scala. I have summarized the current approach in a short document that you can find on github together with the code: https://github.com/fschueler/emma/blob/sysml