Re: how can evenly distribute my records in all partition

2015-11-18 Thread prateek arora
gt;> >>>>>> I have a RDD with 30 record ( Key/value pair ) and running 30 >>>>>> executor . i >>>>>> want to reparation this RDD in to 30 partition so every partition >>>>>> get one >>>>>> record and assigned

Re: how can evenly distribute my records in all partition

2015-11-17 Thread Sonal Goyal
;>> want to reparation this RDD in to 30 partition so every partition get >>>>> one >>>>> record and assigned to one executor . >>>>> >>>>> when i used rdd.repartition(30) its repartition my rdd in 30 partition >>>>>

Re: how can evenly distribute my records in all partition

2015-11-17 Thread prateek arora
>>>> but >>>> some partition get 2 record , some get 1 record and some not getting any >>>> record . >>>> >>>> is there any way in spark so i can evenly distribute my record in all >>>> partition . >>>> >>>

Re: how can evenly distribute my records in all partition

2015-11-17 Thread Ted Yu
;>> some partition get 2 record , some get 1 record and some not getting any >>> record . >>> >>> is there any way in spark so i can evenly distribute my record in all >>> partition . >>> >>> Regards >>> Prateek &

Re: how can evenly distribute my records in all partition

2015-11-17 Thread prateek arora
. >> >> is there any way in spark so i can evenly distribute my record in all >> partition . >> >> Regards >> Prateek >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.

Re: how can evenly distribute my records in all partition

2015-11-16 Thread Sabarish Sasidharan
in all > partition . > > Regards > Prateek > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/how-can-evenly-distribute-my-records-in-all-partition-tp25394.html

how can evenly distribute my records in all partition

2015-11-16 Thread prateek arora
, some get 1 record and some not getting any record . is there any way in spark so i can evenly distribute my record in all partition . Regards Prateek -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/how-can-evenly-distribute-my-records-in-all-partition