[jira] [Commented] (SPARK-28854) Zipping iterators in mapPartitions will fail

2019-08-24 Thread Hao Yang Ang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16915162#comment-16915162 ] Hao Yang Ang commented on SPARK-28854: -- [~hyukjin.kwon] got it, my bad. > Zipping

[jira] [Commented] (SPARK-28854) Zipping iterators in mapPartitions will fail

2019-08-24 Thread Hao Yang Ang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16914981#comment-16914981 ] Hao Yang Ang commented on SPARK-28854: -- [~hyukjin.kwon] if xs is "consumed" at the

[jira] [Updated] (SPARK-28854) Zipping iterators in mapPartitions will fail

2019-08-22 Thread Hao Yang Ang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Yang Ang updated SPARK-28854: - Description: scala> sc.parallelize(Seq(1, 2, 3)).mapPartitions(xs => xs.map(2*).zip(xs)).collec

[jira] [Updated] (SPARK-28854) Zipping iterators in mapPartitions will fail

2019-08-22 Thread Hao Yang Ang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Yang Ang updated SPARK-28854: - Description: scala> sc.parallelize(Seq(1, 2, 3)).mapPartitions(xs => xs.map(2*).zip(xs)).foreac

[jira] [Created] (SPARK-28854) Zipping iterators in mapPartitions will fail

2019-08-22 Thread Hao Yang Ang (Jira)
Hao Yang Ang created SPARK-28854: Summary: Zipping iterators in mapPartitions will fail Key: SPARK-28854 URL: https://issues.apache.org/jira/browse/SPARK-28854 Project: Spark Issue Type: Bug