Hi Arun,
We have been running into the same issue (having only 1000 unique items, in
100MM transactions), but have not investigated the root cause of this. We
decided to run this on a cluster instead (4*16 / 64GB Ram), after which the OOM
issue went away. However, we ran into the issue that
Date: Thursday, December 4, 2014 at 7:20 PM
To: Rohit Pujari rpuj...@hortonworks.com
Cc: user@spark.apache.org user@spark.apache.org
Subject: Re: Market Basket Analysis
Hi,
On Thu, Dec 4, 2014 at 11:58 PM, Rohit Pujari rpuj...@hortonworks.com
wrote:
I'd like to do market basket analysis
.
Hopefully this provides some clarification.
Thanks,
Rohit
From: Tobias Pfeiffer t...@preferred.jp
Date: Thursday, December 4, 2014 at 7:20 PM
To: Rohit Pujari rpuj...@hortonworks.com
Cc: user@spark.apache.org user@spark.apache.org
Subject: Re: Market Basket Analysis
Hi,
On Thu
itemsets implementations:
http://infolab.stanford.edu/~ullman/mmds/ch6.pdf
From: rpuj...@hortonworks.com
Date: Fri, 5 Dec 2014 10:31:17 -0600
Subject: Re: Market Basket Analysis
To: so...@cloudera.com
CC: t...@preferred.jp; user@spark.apache.org
Hi,
On Thu, Dec 4, 2014 at 11:58 PM, Rohit Pujari rpuj...@hortonworks.com
wrote:
I'd like to do market basket analysis using spark, what're my options?
To do it or not to do it ;-)
Seriously, could you elaborate a bit on what you want to know?
Tobias
...@hortonworks.commailto:rpuj...@hortonworks.com
Cc: user@spark.apache.orgmailto:user@spark.apache.org
user@spark.apache.orgmailto:user@spark.apache.org
Subject: Re: Market Basket Analysis
Hi,
On Thu, Dec 4, 2014 at 11:58 PM, Rohit Pujari
rpuj...@hortonworks.commailto:rpuj...@hortonworks.com wrote:
I'd like