[jira] [Closed] (SYSTEMML-1190) Allow Python/Scala UDF to be passed to SystemML

2017-01-24 Thread Niketan Pansare (JIRA)

 [ 
https://issues.apache.org/jira/browse/SYSTEMML-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Niketan Pansare closed SYSTEMML-1190.
-
   Resolution: Won't Fix
Fix Version/s: SystemML 1.0

> Allow Python/Scala UDF to be passed to SystemML
> ---
>
> Key: SYSTEMML-1190
> URL: https://issues.apache.org/jira/browse/SYSTEMML-1190
> Project: SystemML
>  Issue Type: New Feature
>Reporter: Niketan Pansare
> Fix For: SystemML 1.0
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-1195) Improve parfor parameter documentation

2017-01-24 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-1195:


 Summary: Improve parfor parameter documentation
 Key: SYSTEMML-1195
 URL: https://issues.apache.org/jira/browse/SYSTEMML-1195
 Project: SystemML
  Issue Type: Improvement
  Components: Documentation
Reporter: Deron Eriksson
Assignee: Deron Eriksson


The parfor documentation in the DML Language reference is missing certain 
parameters such as "log" and "profile". In addition, not all possible parameter 
values are listed for all the parameters.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SYSTEMML-1185) SystemML Breast Cancer Project

2017-01-24 Thread Mike Dusenberry (JIRA)

[ 
https://issues.apache.org/jira/browse/SYSTEMML-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836824#comment-15836824
 ] 

Mike Dusenberry commented on SYSTEMML-1185:
---

cc [~freiss]

> SystemML Breast Cancer Project
> --
>
> Key: SYSTEMML-1185
> URL: https://issues.apache.org/jira/browse/SYSTEMML-1185
> Project: SystemML
>  Issue Type: New Feature
>Reporter: Mike Dusenberry
>Assignee: Mike Dusenberry
>
> This issue tracks the new SystemML breast cancer project!
> Here is a list of past and present JIRA epics and issues that have blocked, 
> or are currently blocking progress on the breast cancer project.
>  
> Overall Deep Learning Epic
>   * https://issues.apache.org/jira/browse/SYSTEMML-540
>   *This is the overall "Deep Learning" JIRA epic, with all issues either 
> within or related to the epic.
> Past
> * https://issues.apache.org/jira/browse/SYSTEMML-633
> * https://issues.apache.org/jira/browse/SYSTEMML-951
>   ** Issue that completely blocked mini-batch training approaches.
> * https://issues.apache.org/jira/browse/SYSTEMML-914
>   ** Epic containing issues related to input DataFrame conversions that 
> blocked getting data into the system entirely.  Most of the issues 
> specifically refer to existing, internal converters.  993 was a particularly 
> large issue, and triggered a large body of work related to internal memory 
> estimates that were incorrect.  Also see 919, 946, & 994.
> * https://issues.apache.org/jira/browse/SYSTEMML-1076
> * https://issues.apache.org/jira/browse/SYSTEMML-1077
> * https://issues.apache.org/jira/browse/SYSTEMML-948
> Present
> * https://issues.apache.org/jira/browse/SYSTEMML-1160
>   ** Current open blocker to efficiently using a stochastic gradient descent 
> approach.
> * https://issues.apache.org/jira/browse/SYSTEMML-1078
>   ** Current open blocker to training even an initial deep learning model for 
> the project.  This is another example of an internal compiler bug.
> * https://issues.apache.org/jira/browse/SYSTEMML-686
>   ** We need distributed convolution and max pooling operators.
> * https://issues.apache.org/jira/browse/SYSTEMML-1159
>   ** This is the main issue that discusses the need for the `parfor` 
> construct to support efficient, parallel hyperparameter tuning on a cluster 
> with large datasets.  The broken remote parfor in 1129 blocked this issue, 
> which in turned blocked any meaningful work on training a deep neural net for 
> the project.
> * https://issues.apache.org/jira/browse/SYSTEMML-1142
>   ** This was one of the blockers to doing hyperparameter tuning.
> * https://issues.apache.org/jira/browse/SYSTEMML-1129
>   ** This is an epic for the issue in which the `parfor` construct was broken 
> for remote Spark cases, and was one of the blockers for doing hyperparameter 
> tuning.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SYSTEMML-1194) Replace SQLContext with SparkSession

2017-01-24 Thread Deron Eriksson (JIRA)
Deron Eriksson created SYSTEMML-1194:


 Summary: Replace SQLContext with SparkSession
 Key: SYSTEMML-1194
 URL: https://issues.apache.org/jira/browse/SYSTEMML-1194
 Project: SystemML
  Issue Type: Task
  Components: APIs, Test
Affects Versions: SystemML 1.0
Reporter: Deron Eriksson
Assignee: Deron Eriksson


SQLContext has been deprecated in Spark 2 and has been replaced by SparkSession.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)