[jira] [Created] (SPARK-6486) Add BlockMatrix in PySpark

2015-03-23 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-6486:


 Summary: Add BlockMatrix in PySpark
 Key: SPARK-6486
 URL: https://issues.apache.org/jira/browse/SPARK-6486
 Project: Spark
  Issue Type: Sub-task
  Components: MLlib, PySpark
Reporter: Xiangrui Meng


We should add BlockMatrix to PySpark. Internally, we can use DataFrames and 
MatrixUDT for serialization. This JIRA does NOT cover linear algebra operations 
of block matrices.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2015-03-23 Thread Xiangrui Meng (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377223#comment-14377223
 ] 

Xiangrui Meng commented on SPARK-4036:
--

You don't have to use or change the Optimizer interface. It is okay to have an 
implementation of gradient descent that used by CRF. We want to refactor the 
optimization framework, but there is no ETA at this time. It shouldn't block 
this work. Before you start coding, please prepare a design doc with the 
following:

1. public interfaces
2. choices of CRF algorithms and their complexities
3. limitations
...

 Add Conditional Random Fields (CRF) algorithm to Spark MLlib
 

 Key: SPARK-4036
 URL: https://issues.apache.org/jira/browse/SPARK-4036
 Project: Spark
  Issue Type: New Feature
  Components: MLlib
Reporter: Guoqiang Li
Assignee: Kai Sasaki

 Conditional random fields (CRFs) are a class of statistical modelling method 
 often applied in pattern recognition and machine learning, where they are 
 used for structured prediction. 
 The paper: 
 http://www.seas.upenn.edu/~strctlrn/bib/PDF/crf.pdf



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



<    1   2   3