Re: partitioning RDD

2016-01-11 Thread Daniel Imberman
Hi Ted, Sorry about that. I will be more careful in future emails. So the values are representing buckets (so 1 would represent all values with key 1, 2 represents all values with key 2, etc.) The issue is that I would want to have all values of key 1 and key 2 in partition 1, while then

Re: partitioning RDD

2016-01-11 Thread Ted Yu
Hi, Please use proper subject when sending email to user@ In your example below, what do the values inside curly braces represent ? I assume not the keys since values for same key should go to the same partition. Cheers On Mon, Jan 11, 2016 at 10:51 AM, Daniel Imberman