remove castAsScalar?

2016-04-21 Thread Deron Eriksson
Hi, In the ongoing discussion concerning printing a matrix (at https://github.com/apache/incubator-systemml/pull/120), I noticed that castAsScalar was introduced to the language as a mistake. It has been replaced by as.scalar but castAsScalar has been kept around until now for historical reasons.

Re: remove castAsScalar?

2016-04-22 Thread Deron Eriksson
gards, > Matthias > > [image: Inactive hide details for Deron Eriksson ---04/21/2016 05:33:56 > PM---Hi, In the ongoing discussion concerning printing a matrix]Deron > Eriksson ---04/21/2016 05:33:56 PM---Hi, In the ongoing discussion > concerning printing a matrix (at > >

Draft - May 2016 SystemML Incubator Podling Report

2016-05-02 Thread Deron Eriksson
Hi, I created a draft for the May 2016 SystemML podling report that is due this Wednesday. Please provide feedback if you'd like anything updated. For PMC members, if the issue is private related to the project, please use the private mailing list for discussion. Thanks! Deron Sy

Submitted May 2016 SystemML Incubator Podling Report

2016-05-04 Thread Deron Eriksson
I submitted the May SystemML podling report to https://wiki.apache.org/incubator/May2016. If any further changes are needed today, please let Mike Dusenberry, Luciano Resende, or myself know, since we have write access to the Apache wiki. Deron

Fwd: [VOTE] Apache SystemML 0.9.0-incubating (RC3)

2016-05-04 Thread Deron Eriksson
Hi, Here is a list of Justin Mclean's findings from our last incubator release. We need to verify that all potential issues have been addressed before our next release. I will go over the list and figure out which have been fixed already. Deron -- Forwarded message -- From: Just

Re: Starting a SystemML 0.10.0 release ?

2016-05-07 Thread Deron Eriksson
Hi, I believe the js and css issues have been addressed (see src/assembly/source/LICENSE) for the src packages. The standalone license also features the js/css licenses but I believe this is not necessary because the documentation is currently not packaged into any artifact except the src distribu

Re: [NOTICE] New Apache SystemML Committers and PPMC Members

2016-05-11 Thread Deron Eriksson
Welcome and congratulations Glenn Weidner and Faraz Makari! Thank you for all your great contributions to the project! It has been great working with both of you on SystemML. Deron On Tue, May 10, 2016 at 3:09 PM, Luciano Resende wrote: > I would like to welcome both Glenn Weidner and Faraz M

Citations

2016-05-12 Thread Deron Eriksson
Here are Justin Mcclean's finding from our last release (0.9.0): https://www.mail-archive.com/dev@systemml.incubator.apache.org/msg00482.html I think most issues raised by Justin have now been resolved. Could someone look at [4] and [8] to see if we need to cite anything in the LICENSE or NOTICE

Re: Citations

2016-05-13 Thread Deron Eriksson
ng source code / libraries into their > LICENSE/NOTICE files. > > Regards, > Matthias > > [image: Inactive hide details for Deron Eriksson ---05/12/2016 04:34:03 > PM---Here are Justin Mcclean's finding from our last release (0]Deron > Eriksson ---05/12/2016 04:34:03 PM---

Re: Discussion on GPU backend

2016-05-18 Thread Deron Eriksson
Hi, I'm wondering what would be a good way to handle JCuda in terms of the build release packages. Currently we have 11 artifacts that we are building: systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar systemml-0.10.0-incubating-SNAPSHOT-javadoc.jar systemml-0.10.0-incubating-SNAPSHOT-sour

Re: Discussion on GPU backend

2016-05-18 Thread Deron Eriksson
ks, > > Niketan Pansare > IBM Almaden Research Center > E-mail: npansar At us.ibm.com > http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar > > [image: Inactive hide details for Deron Eriksson ---05/18/2016 10:51:17 > AM---Hi, I'm wondering what would

package dml files in folders in jars for 0.10.0?

2016-05-18 Thread Deron Eriksson
Hi, Currently the DML algorithm scripts are written to the base directory of the following artifacts: systemml-0.10.0-incubating-SNAPSHOT.jar systemml-0.10.0-incubating-SNAPSHOT-inmemory.jar systemml-0.10.0-incubating-SNAPSHOT-sources.jar systemml-0.10.0-incubating-SNAPSHOT-standalone.jar

Re: package dml files in folders in jars for 0.10.0?

2016-05-18 Thread Deron Eriksson
t; IBM Almaden Research Center > E-mail: npansar At us.ibm.com > *http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar* > <http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar> > > Deron Eriksson ---05/18/2016 01:15:36 PM---Hi, Currently the D

Starting a SystemML 0.10 release?

2016-05-18 Thread Deron Eriksson
Hi, I've looked over all the release packages and the NOTICE and LICENSES are looking much better. I believe we have addressed all of the issues brought up during the 0.9 release and have fixed many additional issues. Are we about ready for our next release, 0.10? I believe it would be nice for P

Re: Starting a SystemML 0.10 release?

2016-05-18 Thread Deron Eriksson
Thank you! Deron On Wed, May 18, 2016 at 6:06 PM, Luciano Resende wrote: > On Wed, May 18, 2016 at 5:49 PM, Deron Eriksson > wrote: > > > Hi, > > > > I've looked over all the release packages and the NOTICE and LICENSES are > > looking much better.

Re: Starting a SystemML 0.10 release?

2016-05-19 Thread Deron Eriksson
un our full performance > testsuite (at least up to 80GB) but this could be done on the RC too. > Thanks guys for taking care of the release again. > > Regards, > Matthias > > > [image: Inactive hide details for Luciano Resende ---05/18/2016 06:06:46 > PM---On Wed, May 18, 20

Re: Starting a SystemML 0.10 release?

2016-05-20 Thread Deron Eriksson
int('hello world');" -exec hybrid_spark will generate the following error rather than executing: Error: No main class set in JAR; please specify one with --class Deron On Thu, May 19, 2016 at 3:22 PM, Deron Eriksson wrote: > Hi, > > PR162 and PR167 have been merged. Thank

Re: Starting a SystemML 0.10 release?

2016-05-20 Thread Deron Eriksson
BTW, I am investigating. I believe the issue is caused because of my update to add an assembly (for the proper LICENSE and NOTICE) for the main jar. Deron On Fri, May 20, 2016 at 2:24 PM, Deron Eriksson wrote: > Hi, > > Luciano, before starting the RC, I think I found an issue. Th

Re: Starting a SystemML 0.10 release?

2016-05-20 Thread Deron Eriksson
20, 2016 at 2:54 PM, Deron Eriksson > wrote: > > > BTW, I am investigating. I believe the issue is caused because of my > update > > to add an assembly (for the proper LICENSE and NOTICE) for the main jar. > > > > Deron > > > > > > On Fri, May

Re: Starting a SystemML 0.10 release?

2016-05-20 Thread Deron Eriksson
Hi Luciano, The fix is tested and merged. I believe we should be good to go now to cut an RC. Deron On Fri, May 20, 2016 at 3:13 PM, Deron Eriksson wrote: > Thank you Luciano. I have a fix. I will test with your latest update to > the Apache parent pom and then merge. > > Deron

'hello world' tests of the main distributions

2016-05-20 Thread Deron Eriksson
Hi, We have a test suite of 5000+ tests but I don't think we have a standard way of testing the distribution artifacts once they are built. I just did some 'hello world' tests of the various distribution artifacts to be sure that I could run a 'hello world' DML script using the various distributio

Re: Fw: 'hello world' tests of the main distributions

2016-05-21 Thread Deron Eriksson
0.10.0-incubating-SNAPSHOT.jar and SystemML.jar identical, > and we should drop one of these artifacts. > > Regards, > Berthold Reinwald > IBM Almaden Research Center > office: (408) 927 2208; T/L: 457 2208 > e-mail: reinw...@us.ibm.com > > > -Deron Eriksson wrote

Formalize a release candidate review process?

2016-05-21 Thread Deron Eriksson
Hi, It might be nice to formalize what needs to be done when reviewing a release candidate. I don't mean this as something that would add bureaucracy that would slow us down. Rather, it would be nice to have something as simple as a basic checklist of items that we could volunteer to check. That w

branch for 0.10?

2016-05-23 Thread Deron Eriksson
Should there be a branch-0.10 on GitHub? The current pom.xml on master is referring to the 0.11.0-SNAPSHOT. Deron

Re: branch for 0.10?

2016-05-23 Thread Deron Eriksson
gt; > On Mon, May 23, 2016 at 10:31 AM, Deron Eriksson > wrote: > > > Should there be a branch-0.10 on GitHub? The current pom.xml on master is > > referring to the 0.11.0-SNAPSHOT. > > > > Deron > > > > > > -- > Luciano Resende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ >

Re: branch for 0.10?

2016-05-23 Thread Deron Eriksson
10:38 AM, Frederick R Reiss wrote: > I'd say wait until we have a final 0.1.0 release candidate, then branch. I > don't believe anyone has any open PRs that need to go into the trunk right > away. > > Fred > > [image: Inactive hide details for Deron Eriksson ---05/23/

Re: Formalize a release candidate review process?

2016-05-23 Thread Deron Eriksson
candidate, and another session > would be thse items below with a bit more info on how ro execute them... > And then people could claim these or respond to the vote with the things > they have tested. > > Btw, for the build ones, we should recommend building with an empty maven > repo

synchronized prints?

2016-05-23 Thread Deron Eriksson
Hi, Is there a way to make sure that print statements are synchronized while developing a DML script? By this, I mean is there currently a way to ensure that the order of print statements in a DML script are the order in which they are displayed to standard output? Deron

Re: synchronized prints?

2016-05-23 Thread Deron Eriksson
tter to just ensure consistency natively. > > -- > > Mike Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberry > > Sent from my iPhone. > > > > On May 23, 2016, at 2:02 PM, Matthias Boehm wrote: > > > > a simple worka

Location for release validation checklist?

2016-05-24 Thread Deron Eriksson
Hi, The release candidate validation checklist needs to be easy to modify by SystemML committers/contributors. As a result, it should probably take a 'Wiki' form. This raises the question of where it should go? Seems like the options are: 1) md file in the project itself (not a wiki, not easy to

missing release candidate checksums?

2016-05-24 Thread Deron Eriksson
Hi, I noticed that not all the artifacts at https://dist.apache.org/repos/dist/dev/incubator/systemml/0.10.0-incubating-rc1/ have md5 checksums. Also, the previous release (see https://repo1.maven.org/maven2/org/apache/systemml/systemml/0.9.0-incubating/) featured sha1 checksums but the current r

Re: missing release candidate checksums?

2016-05-24 Thread Deron Eriksson
In my opinion, I don't think restarting the vote is needed for this. On Tue, May 24, 2016 at 8:21 PM, Luciano Resende wrote: > On Tue, May 24, 2016 at 5:20 PM, Deron Eriksson > wrote: > > > Hi, > > > > I noticed that not all the artifacts at > > > &

Re: Location for release validation checklist?

2016-05-24 Thread Deron Eriksson
asy as possible for people to update it. Deron On Tue, May 24, 2016 at 8:20 PM, Luciano Resende wrote: > On Tue, May 24, 2016 at 5:16 PM, Deron Eriksson > wrote: > > > Hi, > > > > The release candidate validation checklist needs to be easy to modify by > > S

Re: Location for release validation checklist?

2016-05-25 Thread Deron Eriksson
Hi, Checklist on a jira sounds good to me. Sorry if I misunderstood the previous comment. Deron On Wed, May 25, 2016 at 10:07 AM, Luciano Resende wrote: > On Wed, May 25, 2016 at 9:06 AM, wrote: > > > Another possibility would be to create a new JIRA issue for each release > > (candidate) an

Re: missing release candidate checksums?

2016-05-25 Thread Deron Eriksson
and maybe: ? systemml-0.10.0-incubating.pom.md5 Also, the previous release had sha1 checksums. Do we need those too or is that overkill? Deron On Wed, May 25, 2016 at 10:16 AM, Luciano Resende wrote: > On Tue, May 24, 2016 at 5:20 PM, Deron Eriksson > wrote: > > > Hi, > &g

Release checklist for 0.10.0-incubating-rc1

2016-05-25 Thread Deron Eriksson
Hi, I created a release checklist JIRA for the release candidate. https://issues.apache.org/jira/browse/SYSTEMML-708 Please feel free to add items, remove items, modify items, or post validation results. Thanks! Deron

Re: Location for release validation checklist?

2016-05-25 Thread Deron Eriksson
May 25, 2016 at 11:03 AM, Deron Eriksson > wrote: > > > Hi, > > > > Checklist on a jira sounds good to me. Sorry if I misunderstood the > > previous comment. > > > > Deron > > > > > > On Wed, May 25, 2016 at 10:07 AM, Lucia

Re: [VOTE] Apache SystemML 0.10.0-incubating (RC1)

2016-05-25 Thread Deron Eriksson
I may have found an issue with the standalone (uber) jar LICENSE and NOTICE. Investigating. Deron On Wed, May 25, 2016 at 12:47 PM, wrote: > +1 > > I ran scripts in Jupyter and Zeppelin using both the Scala and Python > MLContext APIs in order to test our notebook integration. > > One thing to

Re: [VOTE] Apache SystemML 0.10.0-incubating (RC1)

2016-05-25 Thread Deron Eriksson
Hi Luciano, 10 of the 11 artifacts look good to me for LICENSE and NOTICE (as far as I can tell they reflect the artifact contents). However the standalone uberjar (systemml-0.10.0-incubating-standalone.jar) does not have the correct LICENSE and NOTICE (one of my commits in the last week must have

Re: [VOTE] Apache SystemML 0.10.0-incubating (RC1)

2016-05-25 Thread Deron Eriksson
That sounds good to me. On Wed, May 25, 2016 at 3:58 PM, Luciano Resende wrote: > On Wed, May 25, 2016 at 1:54 PM, Deron Eriksson > wrote: > > > Hi Luciano, > > > > 10 of the 11 artifacts look good to me for LICENSE and NOTICE (as far as > I > > can tel

Re: [VOTE] Apache SystemML 0.10.0-incubating (RC1)

2016-05-26 Thread Deron Eriksson
+1 Deron On Wed, May 25, 2016 at 4:28 PM, wrote: > Great, I created SYSTEMML-710 to track this. Would be good as a simple > starter task as well. > > -- > > Mike Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberry > > Sent from my iPhone. > > > > On May 25,

Re: [VOTE] Apache SystemML 0.10.0-incubating (RC1)

2016-05-27 Thread Deron Eriksson
== > > > == Apache Incubator release policy == > > > = > > > Please find below the guide to release management during incubation: > > > *http://incubator.apache.org/guides/releasemanagement.html* > >

Executing DMLScript in Eclipse on Windows

2016-05-27 Thread Deron Eriksson
Hi, On OS X during development, I usually run SystemML using an Eclipse debug configuration that uses DMLScript as the main class. I tried doing the same thing on Windows, and when I do this, I see the following winutils.exe exception: 16/05/27 12:01:54 ERROR util.Shell: Failed to locate the winu

Re: Executing DMLScript in Eclipse on Windows

2016-05-27 Thread Deron Eriksson
.path=\src\test\config\hadoop_bin_windows\bin > > Regards, > Matthias > > [image: Inactive hide details for Deron Eriksson ---05/27/2016 12:14:34 > PM---Hi, On OS X during development, I usually run SystemML usi]Deron > Eriksson ---05/27/2016 12:14:34 PM---Hi, On OS X during develop

Re: [VOTE] Apache SystemML 0.10.0-incubating (RC2)

2016-06-01 Thread Deron Eriksson
+1, but please note following findings: 1. Is the *source-release.zip artifact unnecessary, since we have src.tar.gz and src.zip artifacts? Also, it contains the Hadoop binaries. So, it can't be used as the "source release" artifact. 2. No standalone uberjar is present (I am happy with this since

Re: [VOTE] Apache SystemML 0.10.0-incubating (RC2)

2016-06-02 Thread Deron Eriksson
+1 > > Tested the main JAR with a PySpark Jupyter notebook. > > -- > > Mike Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberry > > Sent from my iPhone. > > > > On Jun 1, 2016, at 12:16 PM, Deron Eriksson > wrote: >

Release notes for 0.10.0

2016-06-13 Thread Deron Eriksson
Hi, We need to put together a page of release notes for the 0.10.0 release (similar to http://systemml.apache.org/0.9.0-incubating/release_notes.html). Could SystemML committers and contributors please respond to this thread with what they feel are the major updates/improvements in this release?

Re: Release notes for 0.10.0

2016-06-15 Thread Deron Eriksson
* Random data generator for ALS > > i) Various fixes > - Dozens of fixes for diverse issues, fix pack for 0.9 release > > j) Build, documentation, examples > * [SYSTEMML-551] Enhanced jmlc javadoc > * [SYSTEMML-484] Build javadoc jar > * [SYSTEMML-468] Contributing to Syste

Re: [DISCUSS] Version-specific documentation

2016-06-22 Thread Deron Eriksson
I would like it if we move towards having a version of the complete documentation for each release. The documentation for each release can be published on the main website, similar to what Apache Spark does: http://spark.apache.org/documentation.html By the way, this will mean that when we do a re

Re: Build failed in Jenkins: SystemML-DailyTest #338

2016-06-24 Thread Deron Eriksson
It might be nice to create a new Jenkins job that we can manually modify and start to test specific test failures like this in the Jenkins environment. We could go into 'configure' and set the test to execute (mvn clean test -Dtest=MyTest, or something like that). Deron On Fri, Jun 24, 2016 at 1

print a value in a frame?

2016-06-29 Thread Deron Eriksson
How do I print a value in a frame? Suppose I have the following 2x2 csv file: one,two three,four I read it in with: M = read($Min, data_type='frame', format='csv'); (1) If I try: print(M[1,1]); I get: ERROR: null -- line 1, column 0 -- print statement can only print scalars (2) If I try:

Re: print a value in a frame?

2016-06-29 Thread Deron Eriksson
ix toString(). > > Regards, > Matthias > > [image: Inactive hide details for Deron Eriksson ---06/29/2016 01:23:41 > PM---How do I print a value in a frame? Suppose I have the foll]Deron > Eriksson ---06/29/2016 01:23:41 PM---How do I print a value in a frame? > Suppose I have t

Update SystemML Project Incubation Status page

2016-07-01 Thread Deron Eriksson
Hi Luciano and others, How do we update the "SystemML Project Incubation Status" page at http://incubator.apache.org/projects/systemml.html? I noticed at http://incubator.apache.org/clutch.html that we are listed as having not elected any new committers to the project since its establishment as a

Re: Contribute to SYSTEMML

2016-07-05 Thread Deron Eriksson
Hello Garvit, You might also find "Contributing to SystemML" to be useful: http://apache.github.io/incubator-systemml/contributing-to-systemml.html Deron On Tue, Jul 5, 2016 at 2:26 PM, Nakul Jindal wrote: > Hi Garvit, > > A good place to get started is to look at the SystemML JIRA site: > ht

Re: print a value in a frame?

2016-07-05 Thread Deron Eriksson
PM, Matthias Boehm wrote: > quick correction: I meant to say, option 2 because you have a frame of > strings (option 3 is only possible if you have numeric/boolean data). Btw, > it's fixed now - so please go ahead and give it a try. Thanks. > > > Regards, > Matthias > > [ima

Re: [DISCUSS] SystemML 0.11 release

2016-07-30 Thread Deron Eriksson
+1 for quick release cycle +1 for 2.0 support +1 for simplified release artifacts Simplifying the release artifacts could potentially halve the time it requires for me to validate a release, so I am definitely in favor of that. I really like the idea of having essentially one or two artifacts that

Re: Build failed in Jenkins: SystemML-DailyTest #413

2016-07-30 Thread Deron Eriksson
3/changes> > > Changes: > > [Deron Eriksson] [SYSTEMML-832] Upgrade Scala version and prune > dependencies > > -- > Started by timer > [EnvInject] - Loading node environment variables. > [EnvInject] - Preparing an environment for

Re: [DISCUSS] Migration to Spark 2.0.0

2016-08-02 Thread Deron Eriksson
I would definitely be in favor of moving to Spark 2.0 as early as possible. This will allow SystemML to be current with cutting edge Spark. It would be nice to focus our efforts on the latest Spark. Deron On Tue, Aug 2, 2016 at 12:05 PM, wrote: > I'm in favor of moving to Spark 2.0 now, meanin

Draft for August monthly report

2016-08-02 Thread Deron Eriksson
Here is a draft I created for the August monthly report. Feedback welcome. Deron - SystemML SystemML provides declarative large-scale machine learning (ML) that aims at flexible specification of ML algorithms and automatic generation of hybrid runtime plans ranging from single node, in-memor

Re: Draft for August monthly report

2016-08-03 Thread Deron Eriksson
t; > Regards, > Matthias > > > [image: Inactive hide details for Deron Eriksson ---08/02/2016 05:39:53 > PM---Here is a draft I created for the August monthly report. F]Deron > Eriksson ---08/02/2016 05:39:53 PM---Here is a draft I created for the > August monthly report. Feedback we

Re: [DISCUSS] Migration to Spark 2.0.0

2016-08-05 Thread Deron Eriksson
l features since 0.10 (specifically frames, the prototype > Python > > DSL, and the new MLContext) and it would be good to have a Spark 1.6 > branch > > of our version tree where we can backport the debugged versions of these > > features if needed. > > > > I would reco

Re: [DISCUSS] Migration to Spark 2.0.0

2016-08-16 Thread Deron Eriksson
etailed code comments and suggestions to try out can be made in the > branch commit instead of this mail thread. > > Thanks, > Glenn > > Deron Eriksson ---08/05/2016 02:02:10 PM---I am open to the idea of > supporting Spark 2 and Spark<2 concurrently if someone shows th

Re: Calling System ML from sparkR

2016-08-17 Thread Deron Eriksson
Hi Sourav, Great question. Work is currently being performed by Alok Singh (see https://issues.apache.org/jira/browse/SYSTEMML-860) regarding this topic. Deron On Mon, Aug 15, 2016 at 9:31 AM, Sourav Mazumder < sourav.mazumde...@gmail.com> wrote: > Hi, > > Is there any work going on to call Sy

Re: Fw: [DISCUSS] SystemML with Spark 2.0 support and roadmap

2016-08-17 Thread Deron Eriksson
+1 Continuing to support Spark 1.4/1.6 for now while setting a cutover date for 2.0 sounds like a great idea. This allows for the creation of a really solid release for 1.x, which greatly benefits SystemML users using Spark 1.x. It also gives these users a general date that they can use to plan mig

Re: [DISCUSS] SystemML with Spark 2.0 support and roadmap

2016-08-23 Thread Deron Eriksson
sounds like a good plan to allow us to continue supporting the Spark > 1.x line in the short term, with a plan for moving to Spark 2.x support > soon. > > -Mike > > -- > > Mike Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberr

Re: [DISCUSS] Apache SystemML Release 1.0.0

2016-08-25 Thread Deron Eriksson
Luciano, Yes, I like the idea of the next release being SystemML 1.0. Given the significance of the version, it would be a good idea to not rush the release so that we can make this a truly great release. Deron On Thu, Aug 25, 2016 at 3:45 PM, Luciano Resende wrote: > On Thu, Aug 25, 2016 at

Re: [DISCUSS] Apache SystemML Release 1.0.0

2016-08-25 Thread Deron Eriksson
+1 Deron On Thu, Aug 25, 2016 at 4:56 PM, Luciano Resende wrote: > On Thu, Aug 25, 2016 at 4:01 PM, Deron Eriksson > wrote: > > > Luciano, > > > > Yes, I like the idea of the next release being SystemML 1.0. Given the > > significance of the version, it wou

Re: New SystemML website design

2016-09-04 Thread Deron Eriksson
Wow, these updates really look incredible! Thank you Jeremy Anderson for this amazing contribution! Deron On Sun, Sep 4, 2016 at 11:13 AM, Luciano Resende wrote: > Jeremy Anderson has been so kind to spend few days on a new design for the > Apache SystemML website, and this is now attached to

Re: New SystemML website design

2016-09-04 Thread Deron Eriksson
eremy. The website looks awesome !! > > Deron/Luciano: Do you think we should change the 'Get Started' link to > point to one of the beginner's guide rather than point to the Download > page ? Alternatively we can add a link in Download page instructing what > the u

Re: Build failed in Jenkins: SystemML-DailyTest #495

2016-09-09 Thread Deron Eriksson
ception. I've made a change and I'll run the test suite and verify the tests work and then commit a hotfix if that fixes it. Deron On Fri, Sep 9, 2016 at 4:01 PM, wrote: > See <https://sparktc.ibmcloud.com/jenkins/job/SystemML- > DailyTest/495/changes> > > Chan

Re: Simplification of MLContext and related APIs

2016-09-12 Thread Deron Eriksson
Feel free to not expose MatrixObject and FrameObject. I am fine with that. The only reason MatrixObject and FrameObject are exposed is that I felt if the new MLContext API did not expose them, there would be complaints from existing committers that these objects were not available. I can't see anyo

Re: Simplification of MLContext and related APIs

2016-09-12 Thread Deron Eriksson
ixObject/FrameObject and > other internal structures from API level, remove the > BinaryBlockMatrix/BinaryBlockFrame > types, and try to consolidate the various Matrix/Frame objects as well as > replicated compilation chains. > > Regards, > Matthias > > [image: Inactive hid

Re: [DISCUSS] SystemML releases 0.11 and 1.0

2016-09-21 Thread Deron Eriksson
+1 Deron On Tue, Sep 20, 2016 at 9:51 AM, Niketan Pansare wrote: > +1 for 0.11 release > > Thanks > > Niketan > > > On Sep 19, 2016, at 10:39 PM, Acs S wrote: > > > > I would agree to most of the part except that there would be need to > have SystemML support on Spark 2.0 for "Spark As A Serv

Re: [Discuss} SystemML Roadmap page

2016-09-23 Thread Deron Eriksson
+1 Great idea, Berthold. Adding a roadmap to the project will be a very welcome addition to the project, both for users and developers. Deron On Fri, Sep 23, 2016 at 12:10 PM, Berthold Reinwald wrote: > In the spirit of other Apache projects, we should publish a Roadmap page. > The page shoul

Re: Continuing development on the website

2016-09-28 Thread Deron Eriksson
Hello Luciano, I would prefer doing fixes on master for the website. However, I do not feel strongly about this issue. Anyone else any thoughts? Deron On Wed, Sep 28, 2016 at 1:28 PM, Luciano Resende wrote: > I have created a PR [1] porting the Jekyll based website to use the new > design co

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC1)

2016-09-28 Thread Deron Eriksson
-1, SYSTEMML-963 and SYSTEMML-967 are potential needed license fixes. Glenn and I should have these issues addressed by tomorrow. Deron On Wed, Sep 28, 2016 at 3:16 PM, Luciano Resende wrote: > On Wed, Sep 28, 2016 at 3:14 PM, Matthias Boehm wrote: > > > -1, unfortunately, SYSTEMML-964 and SY

Re: Continuing development on the website

2016-09-28 Thread Deron Eriksson
s been tagged as v0.1. > > On Wed, Sep 28, 2016 at 2:13 PM, Deron Eriksson > wrote: > > > Hello Luciano, > > > > I would prefer doing fixes on master for the website. However, I do not > > feel strongly about this issue. > > > > Anyone else any thought

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC1)

2016-09-29 Thread Deron Eriksson
The SYSTEMML-963 and SYSTEMML-967/-971 issues have been resolved and are no longer blocking the release. Deron On Wed, Sep 28, 2016 at 3:24 PM, Deron Eriksson wrote: > -1, SYSTEMML-963 and SYSTEMML-967 are potential needed license fixes. > Glenn and I should have these issues addres

Re: Enhancing SystemML JavaDocs

2016-09-30 Thread Deron Eriksson
Hi Luciano, I am definitely in favor of fixing these javadocs. I created https://issues.apache.org/jira/browse/SYSTEMML-842 two months ago to address this issue. However, there are so many problems with the javadocs that I think addressing this should probably be broken down into separate java pa

Re: Enhancing SystemML JavaDocs

2016-09-30 Thread Deron Eriksson
uld prefer to leave the empty (automatically generated) > javadoc comments - at least in eclipse, this provides a better overview of > parameters and exceptions. > > Regards, > Matthias > > [image: Inactive hide details for Deron Eriksson ---09/30/2016 12:35:30 > PM---Hi Lucian

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Deron Eriksson
I believe that for an Apache release, our test suite is supposed to pass (although I'm pretty sure random test fails can be ignored). See 2.1 of Release Check List here: http://incubator.apache.org/guides/releasemanagement.html#check-list "2.1 Build is successful including automated tests. The ex

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Deron Eriksson
be ok, but it's a community decision. > > On Wed, Oct 19, 2016 at 10:50 AM, Deron Eriksson > wrote: > > > I believe that for an Apache release, our test suite is supposed to pass > > (although I'm pretty sure random test fails can be ignored). > > &

rc3 source-release.zip artifact

2016-10-20 Thread Deron Eriksson
The 0.11.0 rc3 artifacts are located at: https://dist.apache.org/repos/dist/dev/incubator/systemml/0.11.0-incubating-rc3/ I see the following artifact: systemml-0.11.0-incubating-source-release.zip I do not recognize this artifact. Can anyone tell me what this artifact is? Can it be removed? Der

Re: [VOTE] SystemML New Logo Ideas

2016-10-21 Thread Deron Eriksson
I think they all look fantastic. My untrained eye likes the features of 3 and 4 but I completely defer to the judgements of others here since I have no training in design and the multitude of considerations involved such as scalability. I believe the logo trademark is an official requirement of th

Re: Local versions of Linear Algebra Operators in DML

2016-10-21 Thread Deron Eriksson
Hi Nakul, +1 I think having some clear characteristic to distinguish operations that only operate locally is a great idea. Otherwise, how would a user know that these operations are only local and not distributed? Adding this naming convention for local operations sounds reasonable to me so that w

Re: [VOTE] SystemML New Logo Ideas

2016-10-21 Thread Deron Eriksson
x27;t expecting > > this at all. Somehow my eyes always ignored this. > > > > Regards, > > Matthias > > > > > > On 10/21/2016 9:22 PM, Deron Eriksson wrote: > > > >> I think they all look fantastic. My untrained eye likes the features of >

Re: use of systemml-0.10.0.incubating.jar

2016-10-21 Thread Deron Eriksson
Hi James, Thank you for the great questions! I think some of the issues that you are experiencing are usage issues from a failure on our part to convey this information clearly. The good news is that a tremendous amount of effort and focus is currently being directed towards fixing our website and

Re: Local versions of Linear Algebra Operators in DML

2016-10-24 Thread Deron Eriksson
Would it be acceptable for a user to receive a log warning if the user uses an operation that is currently only implemented for single node? My concern is that there is an expectation for operations to be distributed with SystemML, and if an operation is not currently distributed, the user needs to

Re: [VOTE] SystemML New Logo Ideas

2016-10-25 Thread Deron Eriksson
+1 sounds great to me too. On Tue, Oct 25, 2016 at 12:44 PM, wrote: > +1 that sounds great to me. > > -- > > Mike Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberry > > Sent from my iPhone. > > > > On Oct 25, 2016, at 10:45 AM, Madison Myers > wrote: > > >

Re: SystemML Medium Blog

2016-10-25 Thread Deron Eriksson
+1. Great idea! On Tue, Oct 25, 2016 at 3:46 PM, Renee Mascarinas wrote: > +1 This is a great idea! It would be nice to invite the community to write > about their experiences with SystemML as well. Maybe we can start with > Medium and in the future, do a youtube vlog :] > > On Tue, Oct 25, 20

Re: Couple of questions on website contents

2016-10-25 Thread Deron Eriksson
Hi Luciano, Several updates to the website were merged today. I think we're at the point where we can publish the new website updates. Do you agree? Deron On Tue, Oct 25, 2016 at 11:02 AM, Jason Azares wrote: > Hi Luciano, > > Initial page: > > - What's the intention of the section just abov

Re: Couple of questions on website contents

2016-10-25 Thread Deron Eriksson
Hi Luciano, Since the current website updates are major improvements, I have gone ahead and published the new updates. I think we can now start publishing more frequently since important parts of the codebase have stabilized. Deron On Tue, Oct 25, 2016 at 5:40 PM, Deron Eriksson wrote: >

Re: SystemML 0.11.0-incubating RC4 feedback

2016-10-31 Thread Deron Eriksson
Hi, I mentioned here that the "source-release.zip" is not something I recognize: https://www.mail-archive.com/dev@systemml.incubator.apache.org/msg00960.html Is this mystery artifact created by the script to deploy release candidates? It should definitely be removed in my opinion. Deron On S

Re: rc3 source-release.zip artifact

2016-10-31 Thread Deron Eriksson
2016, at 10:55 PM, Glenn Weidner > wrote: > > > > > > In my opinion it can be removed. > > > > > > Thanks, > > > Glenn > > > > > > Deron Eriksson ---10/20/2016 01:36:04 PM---The 0.11.0 rc3 artifacts are > > located at: https://di

Re: Podling Report Reminder - November 2016

2016-10-31 Thread Deron Eriksson
If there are no other volunteers to help with the report, I will help. If anyone else is interested in writing the monthly report, I would also be very happy to provide any assistance and guidance. Contributing to the project monthly report is a great way to become familiar with ASF procedures and

Re: [DISCUSS] Adding tensorboard-like functionality to SystemML

2016-10-31 Thread Deron Eriksson
Hi Jeremy, I think moving forward with visualization and design is a great idea, especially since I feel there is currently momentum after the great design refactoring of the project website. Mike and Jeremy, please let me know if there's any way in which I can help. Deron On Fri, Oct 28, 2016

Re: Podling Report Reminder - November 2016

2016-10-31 Thread Deron Eriksson
Thank you Felix! I really appreciate it! Deron On Mon, Oct 31, 2016 at 1:01 PM, wrote: > I will help you, Deron! > > Felix > > > Am 31.10.2016 20:26 schrieb Deron Eriksson: > >> If there are no other volunteers to help with the report, I will help. If >> any

Re: SystemML 0.11.0-incubating RC4 feedback

2016-10-31 Thread Deron Eriksson
t reduce this confusion by dropping our number of released artifacts, as addressed by https://issues.apache.org/jira/browse/SYSTEMML-926. Deron On Mon, Oct 31, 2016 at 10:14 AM, Deron Eriksson wrote: > Hi, > > I mentioned here that the "source-release.zip" is not something

[DRAFT] November monthly report

2016-11-01 Thread Deron Eriksson
Hello, Here is a draft of the November monthly report due tomorrow that Felix and I put together. Feedback is welcome. Deron SystemML SystemML provides declarative large-scale machine learning (ML) that aims at flexible specification of ML algorithms and automatic generati

Re: [DRAFT] November monthly report

2016-11-02 Thread Deron Eriksson
> > Mike Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberry > > Sent from my iPhone. > > > > On Nov 1, 2016, at 4:43 PM, Deron Eriksson > wrote: > > > > Hello, > > > > Here is a draft of the November monthly

<    1   2   3   >