Re: zip equal-length but unequally-partition

2014-09-02 Thread Kevin Jung
I just created it.
Here's ticket.
https://issues.apache.org/jira/browse/SPARK-3364

Thanks,
Kevin



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/zip-equal-length-but-unequally-partition-tp13246p13330.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org



Re: zip equal-length but unequally-partition

2014-09-02 Thread Matthew Farrellee

On 09/01/2014 11:39 PM, Kevin Jung wrote:

http://www.adamcrume.com/blog/archive/2014/02/19/fixing-sparks-rdd-zip


Please check this url .
I got same problem in v1.0.1
In some cases, RDD losts several elements after zip so that a total count of
ZippedRDD is less than source RDD.
will 1.1 version of Spark fix it?


will you file a jira for the issue?

if you do it can be verified and tracked as fixed / not fixed in future 
releases.


best,


matt


-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org



zip equal-length but unequally-partition

2014-09-01 Thread Kevin Jung
http://www.adamcrume.com/blog/archive/2014/02/19/fixing-sparks-rdd-zip
<http://www.adamcrume.com/blog/archive/2014/02/19/fixing-sparks-rdd-zip>  

Please check this url .
I got same problem in v1.0.1
In some cases, RDD losts several elements after zip so that a total count of
ZippedRDD is less than source RDD.
will 1.1 version of Spark fix it?



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/zip-equal-length-but-unequally-partition-tp13246.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org