Re: spark.shuffle.memoryFraction

2016-04-20 Thread Dmitriy Lyubimov
i think in spark 1.6 this really became more flexible in terms of only specifying max/min thresholds. Yes shuffle spills in spark during multiplication are humongous, i tried a few hacks but that's spark. that's one of known bottlenecks unfortunately. You are welcome to try and hack A'B too. My

RE: Congratulations to our new Chair

2016-04-20 Thread Andrew Palumbo
Thanks you guys! Original message From: Andrew Musselman Date: 04/20/2016 8:14 PM (GMT-05:00) To: d...@mahout.apache.org, user@mahout.apache.org Subject: Re: Congratulations to our new Chair Suneel, thanks your great work as Chair and thank you Andy

Re: Congratulations to our new Chair

2016-04-20 Thread Andrew Musselman
Suneel, thanks your great work as Chair and thank you Andy for stepping in! On Wed, Apr 20, 2016 at 5:00 PM, Dmitriy Lyubimov wrote: > congrats! > > On Wed, Apr 20, 2016 at 4:55 PM, Suneel Marthi wrote: > > > Please join me in congratulating Andrew

Congratulations to our new Chair

2016-04-20 Thread Suneel Marthi
Please join me in congratulating Andrew Palumbo on becoming our new Project Chair. As for me, it was a pleasure to serve as Chair starting with the Mahout 0.10.0 release and ending with the recent 0.12.0 release, and perhaps we will do it again someday. ​Congrats again, Andy!​