[jira] [Commented] (SPARK-2279) JavaSparkContext should allow creation of EmptyRDD
[ https://issues.apache.org/jira/browse/SPARK-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075162#comment-14075162 ] Apache Spark commented on SPARK-2279: - User 'bobpaulin' has created a pull request for this issue: https://github.com/apache/spark/pull/1597 > JavaSparkContext should allow creation of EmptyRDD > -- > > Key: SPARK-2279 > URL: https://issues.apache.org/jira/browse/SPARK-2279 > Project: Spark > Issue Type: New Feature > Components: Java API >Affects Versions: 1.0.0 >Reporter: Hans Uhlig > > Scala Implementation currently supports creation of EmptyRDD. Java does not. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (SPARK-2279) JavaSparkContext should allow creation of EmptyRDD
[ https://issues.apache.org/jira/browse/SPARK-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075163#comment-14075163 ] Bob Paulin commented on SPARK-2279: --- Added pull request: https://github.com/apache/spark/pull/1597 > JavaSparkContext should allow creation of EmptyRDD > -- > > Key: SPARK-2279 > URL: https://issues.apache.org/jira/browse/SPARK-2279 > Project: Spark > Issue Type: New Feature > Components: Java API >Affects Versions: 1.0.0 >Reporter: Hans Uhlig > > Scala Implementation currently supports creation of EmptyRDD. Java does not. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (SPARK-2279) JavaSparkContext should allow creation of EmptyRDD
[ https://issues.apache.org/jira/browse/SPARK-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14045517#comment-14045517 ] Patrick Wendell commented on SPARK-2279: Ah I see - I thought you meant the EmptyRDD class not the emptyRDD() method (which I forgot we even had!). It definitely makes sense to include the latter in the Java API. > JavaSparkContext should allow creation of EmptyRDD > -- > > Key: SPARK-2279 > URL: https://issues.apache.org/jira/browse/SPARK-2279 > Project: Spark > Issue Type: New Feature > Components: Java API >Affects Versions: 1.0.0 >Reporter: Hans Uhlig > > Scala Implementation currently supports creation of EmptyRDD. Java does not. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (SPARK-2279) JavaSparkContext should allow creation of EmptyRDD
[ https://issues.apache.org/jira/browse/SPARK-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14044734#comment-14044734 ] Hans Uhlig commented on SPARK-2279: --- You can, you can also read in an empty file. However the Scala API has emptyRDD as an option and Java should maintain parity. It provides better clarity in code. JavaSparkContext.emptyRDD() is a more descriptive of behavior. than JavaSparkContext.parrallelize(new ArrayList()) even if they have the same result. > JavaSparkContext should allow creation of EmptyRDD > -- > > Key: SPARK-2279 > URL: https://issues.apache.org/jira/browse/SPARK-2279 > Project: Spark > Issue Type: New Feature > Components: Java API >Affects Versions: 1.0.0 >Reporter: Hans Uhlig > > Scala Implementation currently supports creation of EmptyRDD. Java does not. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (SPARK-2279) JavaSparkContext should allow creation of EmptyRDD
[ https://issues.apache.org/jira/browse/SPARK-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14044063#comment-14044063 ] Patrick Wendell commented on SPARK-2279: I think `EmtpyRDD` is a mostly internal class. Can you just parallelize an empty collection? > JavaSparkContext should allow creation of EmptyRDD > -- > > Key: SPARK-2279 > URL: https://issues.apache.org/jira/browse/SPARK-2279 > Project: Spark > Issue Type: New Feature > Components: Java API >Affects Versions: 1.0.0 >Reporter: Hans Uhlig > > Scala Implementation currently supports creation of EmptyRDD. Java does not. -- This message was sent by Atlassian JIRA (v6.2#6252)
