>From API docs: "Zips this RDD with another one, returning key-value pairs with the first element in each RDD, second element in each RDD, etc. Assumes that the two RDDs have the *same number of partitions* and the *same number of elements in each partition* (e.g. one was made through a map on the other)."
Basically, one RDD should be a mapped RDD of the other, or both RDDs are mapped RDDs of the same RDD. Btw, your message says "Dell - Internal Use - Confidential"... Best, Xiangrui On Tue, Apr 1, 2014 at 7:27 PM, <patrick_nico...@dell.com> wrote: > Dell - Internal Use - Confidential > > I got an exception "can't zip RDDs with unusual numbers of Partitions" when > I apply any action (reduce, collect) of dataset created by zipping two > dataset of 10 million entries each. The problem occurs independently of the > number of partitions or when I let Spark creates those partitions. > > > > Interestingly enough, I do not have problem zipping datasets of 1 and 2.5 > million entries..... > > A similar problem was reported on this board with 0.8 but remember if the > problem was fixed. > > > > Any idea? Any workaround? > > > > I appreciate.
