[jira] [Closed] (SYSTEMML-1628) Fix broken tabs on website
[ https://issues.apache.org/jira/browse/SYSTEMML-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deron Eriksson closed SYSTEMML-1628. > Fix broken tabs on website > -- > > Key: SYSTEMML-1628 > URL: https://issues.apache.org/jira/browse/SYSTEMML-1628 > Project: SystemML > Issue Type: Bug > Components: Website >Reporter: Deron Eriksson >Assignee: Deron Eriksson > Fix For: Not Applicable > > > The tabs on the main website's "Install SystemML" page do not work at all on > OSX Chrome and are broken on OSX Firefox. > See http://systemml.apache.org/install-systemml.html > In addition, there is incorrect content, so perform some basic content > cleanup too. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (SYSTEMML-1628) Fix broken tabs on website
[ https://issues.apache.org/jira/browse/SYSTEMML-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deron Eriksson resolved SYSTEMML-1628. -- Resolution: Fixed Fix Version/s: Not Applicable Fixed by https://github.com/apache/incubator-systemml-website/commit/c844e086e613d06c97da5dca29e8fa23a72c6b9f > Fix broken tabs on website > -- > > Key: SYSTEMML-1628 > URL: https://issues.apache.org/jira/browse/SYSTEMML-1628 > Project: SystemML > Issue Type: Bug > Components: Website >Reporter: Deron Eriksson >Assignee: Deron Eriksson > Fix For: Not Applicable > > > The tabs on the main website's "Install SystemML" page do not work at all on > OSX Chrome and are broken on OSX Firefox. > See http://systemml.apache.org/install-systemml.html > In addition, there is incorrect content, so perform some basic content > cleanup too. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (SYSTEMML-1627) Mlogreg fails with file not found on MNIST480m and certain mem configs
[
https://issues.apache.org/jira/browse/SYSTEMML-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Boehm updated SYSTEMML-1627:
-
Affects Version/s: SystemML 0.14
> Mlogreg fails with file not found on MNIST480m and certain mem configs
> --
>
> Key: SYSTEMML-1627
> URL: https://issues.apache.org/jira/browse/SYSTEMML-1627
> Project: SystemML
> Issue Type: Bug
>Affects Versions: SystemML 0.14
>Reporter: Matthias Boehm
>
> Scenario: MultiLogReg over MNIST480m (480M rows x 784, sparse) fails for
> certain memory configurations (where unary operations over 480Mx2
> intermediates run in CP and binary operations in SPARK), with the following
> exception:
> {code}
> Caused by: org.apache.sysml.runtime.DMLRuntimeException: ERROR: Runtime error
> in program block generated from statement block between lines 261 and 273 --
> Error evaluating instruction:
> SPARK°tak+*°Y·MATRIX·DOUBLE°_mVar432·MATRIX·DOUBLE°1·SCALAR·INT·true°_Var437·SCALAR·DOUBLE
> at
> org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:322)
> at
> org.apache.sysml.runtime.controlprogram.ProgramBlock.executeInstructions(ProgramBlock.java:221)
> at
> org.apache.sysml.runtime.controlprogram.ProgramBlock.execute(ProgramBlock.java:167)
> at
> org.apache.sysml.runtime.controlprogram.WhileProgramBlock.execute(WhileProgramBlock.java:165)
> ... 14 more
> Caused by: org.apache.hadoop.mapred.InvalidInputException: Input path does
> not exist:
> hdfs://larry.almaden.ibm.com:8020/user/biuser/scratch_space/_p684936_9.1.44.28/_t0/temp154_56
> at
> org.apache.hadoop.mapred.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:287)
> at
> org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:229)
> at
> org.apache.hadoop.mapred.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:45)
> at
> org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:315)
> {code}
> The root cause is a missing export on guarded parallelize (as introduced in
> the 0.14 release) of cached matrices which have previously been collected
> from input rdds. These matrix objects are not marked dirty and hence not
> exported although they do not have an associated hdfs file yet.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Comment Edited] (SYSTEMML-1618) Download pages should ideally use https: for KEYS, sigs and hashes
[ https://issues.apache.org/jira/browse/SYSTEMML-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023467#comment-16023467 ] Glenn Weidner edited comment on SYSTEMML-1618 at 5/24/17 7:09 PM: -- Fixed with [PR 60|https://github.com/apache/incubator-systemml-website/pull/60]. was (Author: gweidner): Fixed with [PR 60|https://github.com/apache/incubator-systemml/pull/60]. > Download pages should ideally use https: for KEYS, sigs and hashes > -- > > Key: SYSTEMML-1618 > URL: https://issues.apache.org/jira/browse/SYSTEMML-1618 > Project: SystemML > Issue Type: Improvement > Environment: http://systemml.apache.org/download >Reporter: Sebb >Assignee: Glenn Weidner > Fix For: SystemML 1.0 > > > The download pages should please use https links to KEYS, sigs and hashes > Please also ensure that the KEYS file is linked from the download page. > It's needed for users to be able to check the signatures. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (SYSTEMML-446) Phase 1: Exploit GPU BLAS libraries (integration)
[ https://issues.apache.org/jira/browse/SYSTEMML-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nakul Jindal updated SYSTEMML-446: -- Fix Version/s: (was: SystemML 0.13) SystemML 1.0 > Phase 1: Exploit GPU BLAS libraries (integration) > - > > Key: SYSTEMML-446 > URL: https://issues.apache.org/jira/browse/SYSTEMML-446 > Project: SystemML > Issue Type: Task > Components: Compiler, Runtime, Test >Affects Versions: SystemML 0.13, SystemML 0.14 >Reporter: Matthias Boehm >Assignee: Niketan Pansare > Fix For: SystemML 1.0 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (SYSTEMML-1625) Add (Unit) Tests for GPU functions
[ https://issues.apache.org/jira/browse/SYSTEMML-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nakul Jindal updated SYSTEMML-1625: --- Fix Version/s: (was: SystemML 0.13) SystemML 1.0 > Add (Unit) Tests for GPU functions > -- > > Key: SYSTEMML-1625 > URL: https://issues.apache.org/jira/browse/SYSTEMML-1625 > Project: SystemML > Issue Type: Sub-task > Components: Test >Reporter: Nakul Jindal >Assignee: Nakul Jindal > Fix For: SystemML 1.0 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (SYSTEMML-1625) Add (Unit) Tests for GPU functions
[ https://issues.apache.org/jira/browse/SYSTEMML-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nakul Jindal updated SYSTEMML-1625: --- Component/s: (was: Runtime) Test > Add (Unit) Tests for GPU functions > -- > > Key: SYSTEMML-1625 > URL: https://issues.apache.org/jira/browse/SYSTEMML-1625 > Project: SystemML > Issue Type: Sub-task > Components: Test >Reporter: Nakul Jindal >Assignee: Nakul Jindal > Fix For: SystemML 1.0 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (SYSTEMML-1625) Add (Unit) Tests for GPU functions
[ https://issues.apache.org/jira/browse/SYSTEMML-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nakul Jindal updated SYSTEMML-1625: --- Component/s: (was: Compiler) > Add (Unit) Tests for GPU functions > -- > > Key: SYSTEMML-1625 > URL: https://issues.apache.org/jira/browse/SYSTEMML-1625 > Project: SystemML > Issue Type: Sub-task > Components: Runtime >Reporter: Nakul Jindal >Assignee: Nakul Jindal > Fix For: SystemML 0.13 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (SYSTEMML-1570) Remove fused sel+ operator
[ https://issues.apache.org/jira/browse/SYSTEMML-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022389#comment-16022389 ] Matthias Boehm commented on SYSTEMML-1570: -- thanks [~nakul02] - it's not urgent but I would like to remove this sel+(X) operator in favor of max(X,0) rather sooner than later in order to avoid that people implement additional rewrites or custom conditions on top of it. > Remove fused sel+ operator > -- > > Key: SYSTEMML-1570 > URL: https://issues.apache.org/jira/browse/SYSTEMML-1570 > Project: SystemML > Issue Type: Task >Reporter: Matthias Boehm > Fix For: SystemML 1.0 > > > The fused operator sel+ (select positive values) is applied for patterns like > (X>0)*X and max(X,0) in order to eliminate unnecessary intermediates. It > stems from a time when max was sparse-unsafe and hence inefficient over > sparse data. However, meanwhile we mark scalar operators as conditionally > sparse-safe depending on the given scalar constant c, which applies for max > if c<=0. Hence, this sel+ operator is meanwhile completely useless and should > be removed. > Furthermore, we should also generalize the rewrites to rewrite the selection > of negative values (X<0)*X to min(X,0) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (SYSTEMML-1570) Remove fused sel+ operator
[ https://issues.apache.org/jira/browse/SYSTEMML-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022385#comment-16022385 ] Nakul Jindal commented on SYSTEMML-1570: [~mboehm7] - absolutely. We haven't yet seen it as a top heavy hitter that we wanted to focus on, so it hasn't been implemented yet. If you think this is urgent, let me know and I can work on it. > Remove fused sel+ operator > -- > > Key: SYSTEMML-1570 > URL: https://issues.apache.org/jira/browse/SYSTEMML-1570 > Project: SystemML > Issue Type: Task >Reporter: Matthias Boehm > Fix For: SystemML 1.0 > > > The fused operator sel+ (select positive values) is applied for patterns like > (X>0)*X and max(X,0) in order to eliminate unnecessary intermediates. It > stems from a time when max was sparse-unsafe and hence inefficient over > sparse data. However, meanwhile we mark scalar operators as conditionally > sparse-safe depending on the given scalar constant c, which applies for max > if c<=0. Hence, this sel+ operator is meanwhile completely useless and should > be removed. > Furthermore, we should also generalize the rewrites to rewrite the selection > of negative values (X<0)*X to min(X,0) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (SYSTEMML-1570) Remove fused sel+ operator
[ https://issues.apache.org/jira/browse/SYSTEMML-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022381#comment-16022381 ] Matthias Boehm commented on SYSTEMML-1570: -- [~nakul02] as it turns out, this task is kind of blocked because our GPU backend does not support binary max and min, specifically matrix-scalar max and min. Any plans to add this in the near future? > Remove fused sel+ operator > -- > > Key: SYSTEMML-1570 > URL: https://issues.apache.org/jira/browse/SYSTEMML-1570 > Project: SystemML > Issue Type: Task >Reporter: Matthias Boehm > Fix For: SystemML 1.0 > > > The fused operator sel+ (select positive values) is applied for patterns like > (X>0)*X and max(X,0) in order to eliminate unnecessary intermediates. It > stems from a time when max was sparse-unsafe and hence inefficient over > sparse data. However, meanwhile we mark scalar operators as conditionally > sparse-safe depending on the given scalar constant c, which applies for max > if c<=0. Hence, this sel+ operator is meanwhile completely useless and should > be removed. > Furthermore, we should also generalize the rewrites to rewrite the selection > of negative values (X<0)*X to min(X,0) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (SYSTEMML-1623) Memory efficiency JMLC matrix and frame conversions
[
https://issues.apache.org/jira/browse/SYSTEMML-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Boehm resolved SYSTEMML-1623.
--
Resolution: Fixed
Assignee: Matthias Boehm
Fix Version/s: SystemML 1.0
> Memory efficiency JMLC matrix and frame conversions
> ---
>
> Key: SYSTEMML-1623
> URL: https://issues.apache.org/jira/browse/SYSTEMML-1623
> Project: SystemML
> Issue Type: Bug
>Reporter: Matthias Boehm
>Assignee: Matthias Boehm
> Fix For: SystemML 1.0
>
>
> The current JMLC conversion functions cause a very inefficient and memory
> intensive code path with leads to unnecessary OOMs that can be easily
> avoided. This task aims to add and improve these primitives to allow
> convenient data conversions with much better memory efficiency.
> For example consider a scenario of a 500k x 90 input model available as csv
> file in the classpath, which string representation requires 1GB. The typical
> codepath currently use looks as follows:
> {code}
> ResourceStream(model_file)
> -> prep
> ---> StringBuilder -> String [3GB tmp, 1GB]
> -> convertToDoubleMatrix
> ---> byte[] -> ByteInputStream [2GB]
> ---> MatrixBlock [360MB]
> ---> double[][] [400MB]
> -> setMatrix
> ---> MatrixBlock [360MB]
> {code}
> which requires at least 4GB of memory due to strong references to all
> intermediates. The goal of this task is to reduce this to the following,
> which only requires 360MB of memory:
> {code}
> ResourceStream(model_file)
> -> convertToMatrix
> ---> MatrixBlock [360MB]
> -> setMatrix
> ---> by references
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
