Re: In-Memory Only Spark Shuffle

2016-04-15 Thread Hyukjin Kwon
gt; is ignored by the tungsten-sort shuffle manager; its optimized shuffles > will > continue to spill to disk when necessary.” > > If this is impossible via configuration changes what code changes would be > needed to accomplish this? > > > > -- > View this message in context:

In-Memory Only Spark Shuffle

2016-04-01 Thread slavitch
uffle manager; its optimized shuffles will continue to spill to disk when necessary.” If this is impossible via configuration changes what code changes would be needed to accomplish this? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/In-Memory-Only-