Re: Does Spark support in-memory shuffling?

2016-03-11 Thread Ted Yu
Please take a look at SPARK-3376 and discussion on https://github.com/apache/spark/pull/5403 FYI On Fri, Mar 11, 2016 at 6:37 AM, Xudong Zheng <dong...@gmail.com> wrote: > Hi all, > > Does Spark support in-memory shuffling now? If not, is there any > consideration

Does Spark support in-memory shuffling?

2016-03-11 Thread Xudong Zheng
Hi all, Does Spark support in-memory shuffling now? If not, is there any consideration for it? Thanks! -- Xudong Zheng