[jira] [Commented] (SPARK-24760) Pandas UDF does not handle NaN correctly

[ https://issues.apache.org/jira/browse/SPARK-24760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541209#comment-16541209 ] Mortada Mehyar commented on SPARK-24760: [~bryanc] thanks for the example. It looks like

[jira] [Commented] (SPARK-24760) Pandas UDF does not handle NaN correctly

[ https://issues.apache.org/jira/browse/SPARK-24760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538234#comment-16538234 ] Mortada Mehyar commented on SPARK-24760: I still think something is not right here. It is true

[jira] [Commented] (SPARK-24760) Pandas UDF does not handle NaN correctly

[ https://issues.apache.org/jira/browse/SPARK-24760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537864#comment-16537864 ] Mortada Mehyar commented on SPARK-24760: Setting the "new" column to be nullable indeed makes it

[jira] [Commented] (SPARK-24760) Pandas UDF does not handle NaN correctly

[ https://issues.apache.org/jira/browse/SPARK-24760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537817#comment-16537817 ] Mortada Mehyar commented on SPARK-24760: [~icexelloss] but NaN is not really a "null" value

[jira] [Commented] (SPARK-24760) Pandas UDF does not handle NaN correctly

[ https://issues.apache.org/jira/browse/SPARK-24760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536540#comment-16536540 ] Mortada Mehyar commented on SPARK-24760: cc [~icexelloss] [~hyukjin.kwon] > Pandas UDF does not

[jira] [Created] (SPARK-24760) Pandas UDF does not handle NaN correctly

Mortada Mehyar created SPARK-24760: -- Summary: Pandas UDF does not handle NaN correctly Key: SPARK-24760 URL: https://issues.apache.org/jira/browse/SPARK-24760 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-18069) Many examples in Python docstrings are incomplete

Mortada Mehyar created SPARK-18069: -- Summary: Many examples in Python docstrings are incomplete Key: SPARK-18069 URL: https://issues.apache.org/jira/browse/SPARK-18069 Project: Spark Issue

[jira] [Commented] (SPARK-12760) inaccurate description for difference between local vs cluster mode in closure handling

[ https://issues.apache.org/jira/browse/SPARK-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096661#comment-15096661 ] Mortada Mehyar commented on SPARK-12760: Hi, sure definitely. I'll create a PR and link to this

[jira] [Created] (SPARK-12760) inaccurate description for difference between local vs cluster mode

Mortada Mehyar created SPARK-12760: -- Summary: inaccurate description for difference between local vs cluster mode Key: SPARK-12760 URL: https://issues.apache.org/jira/browse/SPARK-12760 Project:

[jira] [Created] (SPARK-11837) spark_ec2.py breaks with python3 and m3 instances

Mortada Mehyar created SPARK-11837: -- Summary: spark_ec2.py breaks with python3 and m3 instances Key: SPARK-11837 URL: https://issues.apache.org/jira/browse/SPARK-11837 Project: Spark Issue