Re: Number partitions after a join

> partition. > > > > Cheers, > > Ximo > > > > *De:* Guillermo Ortiz [mailto:konstt2...@gmail.com] > *Enviado el:* jueves, 25 de febrero de 2016 15:19 > *Para:* Takeshi Yamamuro <linguin@gmail.com> > *CC:* user <user@spark.apache.org> > *Asunto

RE: Number partitions after a join

<linguin@gmail.com> CC: user <user@spark.apache.org> Asunto: Re: Number partitions after a join thank you, I didn't see that option. 2016-02-25 14:51 GMT+01:00 Takeshi Yamamuro <linguin@gmail.com<mailto:linguin@gmail.com>>: Hi, The number depends on `spark.sql.

Re: Number partitions after a join

thank you, I didn't see that option. 2016-02-25 14:51 GMT+01:00 Takeshi Yamamuro : > Hi, > > The number depends on `spark.sql.shuffle.partitions`. > See: > http://spark.apache.org/docs/latest/sql-programming-guide.html#other-configuration-options > > On Thu, Feb 25, 2016

Re: Number partitions after a join

Hi, The number depends on `spark.sql.shuffle.partitions`. See: http://spark.apache.org/docs/latest/sql-programming-guide.html#other-configuration-options On Thu, Feb 25, 2016 at 7:42 PM, Guillermo Ortiz wrote: > When you do a join in Spark, how many partitions are as

Number partitions after a join

When you do a join in Spark, how many partitions are as result? is it a default number if you don't specify the number of partitions?