Re: [jira] [Commented] (MAHOUT-1464) Cooccurrence Analysis on Spark

[Pat Ferrel]

facepalm, missed that. Thanks.

On Jun 10, 2014, at 4:29 PM, Ted Dunning (JIRA) <j...@apache.org> wrote:


   [ 
https://issues.apache.org/jira/browse/MAHOUT-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14027208#comment-14027208
 ] 

Ted Dunning commented on MAHOUT-1464:
-------------------------------------

Matrix and Vector already have something that can be used:

{code}
   Vector counts = x.aggregateColumns(new VectorFunction() {
     @Override
     public double apply(Vector f) {
       return f.aggregate(Functions.PLUS, Functions.greater(0));
     }
   });
{code}

> Cooccurrence Analysis on Spark
> ------------------------------
> 
>                Key: MAHOUT-1464
>                URL: https://issues.apache.org/jira/browse/MAHOUT-1464
>            Project: Mahout
>         Issue Type: Improvement
>         Components: Collaborative Filtering
>        Environment: hadoop, spark
>           Reporter: Pat Ferrel
>           Assignee: Pat Ferrel
>            Fix For: 1.0
> 
>        Attachments: MAHOUT-1464.patch, MAHOUT-1464.patch, MAHOUT-1464.patch, 
> MAHOUT-1464.patch, MAHOUT-1464.patch, MAHOUT-1464.patch, run-spark-xrsj.sh
> 
> 
> Create a version of Cooccurrence Analysis (RowSimilarityJob with LLR) that 
> runs on Spark. This should be compatible with Mahout Spark DRM DSL so a DRM 
> can be used as input. 
> Ideally this would extend to cover MAHOUT-1422. This cross-cooccurrence has 
> several applications including cross-action recommendations. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)