Re: Re: how to tuning spark shuffle

leezy <lizhenm...@163.com> wrote: > hi: > i am run a join operation in the spark-sql, But when i increase the > executor-memory, the run time become long. In the spark UI, i can see that > the shuffle becomes slowly when the memory becomes big. How can i to tune > it? > > >

how to convert the RDD[Array[Double]] to RDD[Double]

it to RDD[Double]. Thanks. lizhenm...@163.com