Ok, thanks Reynold. When I tested dynamic allocation with Spark 1.4, it complained saying that it was not tungsten compliant. Lets hope it works with 1.5 then!
On Tue, Sep 8, 2015 at 5:49 AM Reynold Xin <r...@databricks.com> wrote: > > On Wed, Sep 2, 2015 at 12:03 AM, Anders Arpteg <arp...@spotify.com> wrote: > >> >> BTW, is it possible (or will it be) to use Tungsten with dynamic >> allocation and the external shuffle manager? >> >> > Yes - I think this already works. There isn't anything specific here > related to Tungsten. > >
