Re: Market Basket Analysis by deploying FP Growth algorithm

2017-04-05 Thread Patrick Plaatje
Hi Arun, We have been running into the same issue (having only 1000 unique items, in 100MM transactions), but have not investigated the root cause of this. We decided to run this on a cluster instead (4*16 / 64GB Ram), after which the OOM issue went away. However, we ran into the issue that

Re: Market Basket Analysis

2014-12-05 Thread Sean Owen
Date: Thursday, December 4, 2014 at 7:20 PM To: Rohit Pujari rpuj...@hortonworks.com Cc: user@spark.apache.org user@spark.apache.org Subject: Re: Market Basket Analysis Hi, On Thu, Dec 4, 2014 at 11:58 PM, Rohit Pujari rpuj...@hortonworks.com wrote: I'd like to do market basket analysis

Re: Market Basket Analysis

2014-12-05 Thread Rohit Pujari
. Hopefully this provides some clarification. Thanks, Rohit From: Tobias Pfeiffer t...@preferred.jp Date: Thursday, December 4, 2014 at 7:20 PM To: Rohit Pujari rpuj...@hortonworks.com Cc: user@spark.apache.org user@spark.apache.org Subject: Re: Market Basket Analysis Hi, On Thu

Re: Market Basket Analysis

2014-12-05 Thread Debasish Das
itemsets implementations: http://infolab.stanford.edu/~ullman/mmds/ch6.pdf From: rpuj...@hortonworks.com Date: Fri, 5 Dec 2014 10:31:17 -0600 Subject: Re: Market Basket Analysis To: so...@cloudera.com CC: t...@preferred.jp; user@spark.apache.org

Re: Market Basket Analysis

2014-12-04 Thread Tobias Pfeiffer
Hi, On Thu, Dec 4, 2014 at 11:58 PM, Rohit Pujari rpuj...@hortonworks.com wrote: I'd like to do market basket analysis using spark, what're my options? To do it or not to do it ;-) Seriously, could you elaborate a bit on what you want to know? Tobias

Re: Market Basket Analysis

2014-12-04 Thread Rohit Pujari
...@hortonworks.commailto:rpuj...@hortonworks.com Cc: user@spark.apache.orgmailto:user@spark.apache.org user@spark.apache.orgmailto:user@spark.apache.org Subject: Re: Market Basket Analysis Hi, On Thu, Dec 4, 2014 at 11:58 PM, Rohit Pujari rpuj...@hortonworks.commailto:rpuj...@hortonworks.com wrote: I'd like