[jira] [Comment Edited] (SPARK-12624) When schema is specified, we should treat undeclared fields as null (in Python)

2016-01-15 Thread JIRA 

[ 
https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102473#comment-15102473
 ] 

Maciej Bryński edited comment on SPARK-12624 at 1/15/16 9:17 PM:
-

[~davies]
Isn't related to my comment here:
https://issues.apache.org/jira/browse/SPARK-11437?focusedCommentId=15068627&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15068627


was (Author: maver1ck):
[~davies]
Isn't related to my comment here:
https://issues.apache.org/jira/browse/SPARK-11437?focusedCommentId=15074733&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15074733

> When schema is specified, we should treat undeclared fields as null (in 
> Python)
> ---
>
> Key: SPARK-12624
> URL: https://issues.apache.org/jira/browse/SPARK-12624
> Project: Spark
>  Issue Type: Bug
>  Components: PySpark, SQL
>Reporter: Reynold Xin
>Priority: Critical
>
> See https://github.com/apache/spark/pull/10564
> Basically that test case should pass without the above fix and just assume b 
> is null.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Comment Edited] (SPARK-12624) When schema is specified, we should treat undeclared fields as null (in Python)

2016-01-04 Thread Reynold Xin (JIRA) 

[ 
https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15081935#comment-15081935
 ] 

Reynold Xin edited comment on SPARK-12624 at 1/4/16 10:43 PM:
--

Maybe do it for Row/dict only for now?



was (Author: rxin):
Maybe do it for Row only for now?


> When schema is specified, we should treat undeclared fields as null (in 
> Python)
> ---
>
> Key: SPARK-12624
> URL: https://issues.apache.org/jira/browse/SPARK-12624
> Project: Spark
>  Issue Type: Bug
>  Components: PySpark, SQL
>Reporter: Reynold Xin
>Priority: Critical
>
> See https://github.com/apache/spark/pull/10564
> Basically that test case should pass without the above fix and just assume b 
> is null.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org