[jira] [Commented] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-27 Thread Frank Oosterhuis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17147012#comment-17147012 ] Frank Oosterhuis commented on SPARK-32051: -- Okay, thanks :) > Dataset.foreachP

[jira] [Commented] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-27 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146950#comment-17146950 ] Sean R. Owen commented on SPARK-32051: -- Oh, that's quite different. You can't call

[jira] [Commented] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-27 Thread Frank Oosterhuis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146866#comment-17146866 ] Frank Oosterhuis commented on SPARK-32051: -- How would you work around the .fore

[jira] [Commented] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146740#comment-17146740 ] Sean R. Owen commented on SPARK-32051: -- Yes, it's because of Scala 2.12 SAM support

[jira] [Commented] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146722#comment-17146722 ] Jungtaek Lim commented on SPARK-32051: -- OK so it needs to explicitly return Unit. T

[jira] [Commented] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-24 Thread Frank Oosterhuis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143875#comment-17143875 ] Frank Oosterhuis commented on SPARK-32051: -- This is fine:  {code:java} spark.ra

[jira] [Commented] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-23 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143271#comment-17143271 ] Jungtaek Lim commented on SPARK-32051: -- [~frankivo] Could you put full source code

[jira] [Commented] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-23 Thread Frank Oosterhuis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143001#comment-17143001 ] Frank Oosterhuis commented on SPARK-32051: -- Looks like a similar conflict happe

[jira] [Commented] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-22 Thread Frank Oosterhuis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142031#comment-17142031 ] Frank Oosterhuis commented on SPARK-32051: -- OK, disregard that comment then :)

[jira] [Commented] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-22 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142027#comment-17142027 ] Jungtaek Lim commented on SPARK-32051: -- SparkSession.range returns Dataset[java.lan

[jira] [Commented] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-22 Thread Frank Oosterhuis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142000#comment-17142000 ] Frank Oosterhuis commented on SPARK-32051: -- Thanks [~kabhwan], that is really h

[jira] [Commented] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-22 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17141980#comment-17141980 ] Jungtaek Lim commented on SPARK-32051: -- Looks like existing two methods (Scala spec