[ https://issues.apache.org/jira/browse/SPARK-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132420#comment-14132420 ]
Josh Rosen commented on SPARK-3500: ----------------------------------- This feels like a bug, not a missing feature, since SchemaRDD instances have a public method that always throws an exception when called. It seems fair to include this fix in 1.1.1. > SchemaRDD from jsonRDD() has not coalesce() method > -------------------------------------------------- > > Key: SPARK-3500 > URL: https://issues.apache.org/jira/browse/SPARK-3500 > Project: Spark > Issue Type: Bug > Components: PySpark, SQL > Affects Versions: 1.1.0 > Reporter: Davies Liu > Assignee: Davies Liu > Priority: Critical > > {code} > >>> sqlCtx.jsonRDD(sc.parallelize(['{"foo":"bar"}', > >>> '{"foo":"baz"}'])).coalesce(1) > Py4JError: An error occurred while calling o94.coalesce. Trace: > py4j.Py4JException: Method coalesce([class java.lang.Integer, class > java.lang.Boolean]) does not exist > {code} > repartition() and distinct(N) are also missing too. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org