[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021644#comment-15021644 ] Apache Spark commented on SPARK-11894: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020569#comment-15020569 ] Xiao Li commented on SPARK-11894: - The bug is now narrowed down to the function call of

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020586#comment-15020586 ] Xiao Li commented on SPARK-11894: - After reading the generated code. I suspect the bug is caused by the

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020601#comment-15020601 ] Xiao Li commented on SPARK-11894: - [~marmbrus] [~rxin] [~cloud_fan] I am stuck in this again. To be

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020603#comment-15020603 ] Xiao Li commented on SPARK-11894: - BTW, I also try the dataFrame on the above join statement. The result

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019186#comment-15019186 ] Xiao Li commented on SPARK-11894: - Sorry, unable to find the correct place to handle this issue. Any

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019199#comment-15019199 ] Xiao Li commented on SPARK-11894: - The plan of Dataset: == Parsed Logical Plan == Project

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019203#comment-15019203 ] Michael Armbrust commented on SPARK-11894: -- I meant if you call `toDF()` on the dataset and then

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019211#comment-15019211 ] Xiao Li commented on SPARK-11894: - The answer is correct. ++---+ | _1| _2| ++---+ |null| 1| |

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019213#comment-15019213 ] Xiao Li commented on SPARK-11894: - val ds1 = Seq((new java.lang.Integer(0), "1"), (new

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019215#comment-15019215 ] Xiao Li commented on SPARK-11894: - I see. The error should be from Projection. Let me check it >

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019191#comment-15019191 ] Michael Armbrust commented on SPARK-11894: -- What is the output as a DataFrame? > Incorrect

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019196#comment-15019196 ] Xiao Li commented on SPARK-11894: - The result of Dataframe is correct. > Incorrect results are returned

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019198#comment-15019198 ] Xiao Li commented on SPARK-11894: - The plan of Dataframe: == Parsed Logical Plan == Join Inner,

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15019263#comment-15019263 ] Xiao Li commented on SPARK-11894: - So far, I did not find obvious bugs in Projection. The logical plan is

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020273#comment-15020273 ] Xiao Li commented on SPARK-11894: - I believe I found the problem. It is not related to Catalyst. It is

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020253#comment-15020253 ] Xiao Li commented on SPARK-11894: - val ds1_show = Seq((null.asInstanceOf[java.lang.Integer], "1"),