[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081932#comment-15081932 ]
Davies Liu commented on SPARK-12624: ------------------------------------ [~rxin] The RDD or list could be just tuple, how do we know which is the missing column, the last one(s)? > When schema is specified, we should treat undeclared fields as null (in > Python) > ------------------------------------------------------------------------------- > > Key: SPARK-12624 > URL: https://issues.apache.org/jira/browse/SPARK-12624 > Project: Spark > Issue Type: Bug > Components: PySpark, SQL > Reporter: Reynold Xin > Priority: Critical > > See https://github.com/apache/spark/pull/10564 > Basically that test case should pass without the above fix and just assume b > is null. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org