[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148472#comment-15148472
]
Emlyn Corrin commented on SPARK-9740:
-
Thanks, the {{registerTempTable}} + {{sql}} workaround is fine
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148463#comment-15148463
]
Herman van Hovell commented on SPARK-9740:
--
[~emlyn] We have merged a patch for this, see:
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148458#comment-15148458
]
Emlyn Corrin commented on SPARK-9740:
-
Any update on this? Should I open a new issue for it so it
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119673#comment-15119673
]
Yin Huai commented on SPARK-9740:
-
Thank you!
> first/last aggregate NULL behavior
>
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119240#comment-15119240
]
Herman van Hovell commented on SPARK-9740:
--
[~yhuai] I'll have a look.
> first/last aggregate
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116977#comment-15116977
]
Emlyn Corrin commented on SPARK-9740:
-
I've put together a minimal example to demonstrate the problem:
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117651#comment-15117651
]
Yin Huai commented on SPARK-9740:
-
[~hvanhovell] Will you have time to take a look? Thanks :)
>
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115904#comment-15115904
]
Emlyn Corrin commented on SPARK-9740:
-
Thanks for the help. I've tried with {{callUDF}} and that gives
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115907#comment-15115907
]
Yin Huai commented on SPARK-9740:
-
Can you provide the full stack trace?
> first/last aggregate NULL
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115480#comment-15115480
]
Yin Huai commented on SPARK-9740:
-
Can you attach your code? Also, can you try to use
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115650#comment-15115650
]
Herman van Hovell commented on SPARK-9740:
--
We are probably resolving the Hive function by
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115659#comment-15115659
]
Herman van Hovell commented on SPARK-9740:
--
Hmmm... It does have a suitable constructor. Please
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116297#comment-15116297
]
Emlyn Corrin commented on SPARK-9740:
-
Here's the stack trace, it fails during compilation:
{code}
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116317#comment-15116317
]
Herman van Hovell commented on SPARK-9740:
--
[~emlyn] What version of Spark are you using?
>
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116329#comment-15116329
]
Emlyn Corrin commented on SPARK-9740:
-
Version 1.6.0
> first/last aggregate NULL behavior
>
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114935#comment-15114935
]
Emlyn Corrin commented on SPARK-9740:
-
Thanks [~yhuai], that's just what I was looking for!
>
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115115#comment-15115115
]
Emlyn Corrin commented on SPARK-9740:
-
[~yhuai] actually, that doesn't seem to work, when I try it, I
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114721#comment-15114721
]
Yin Huai commented on SPARK-9740:
-
[~emlyn] You can use {{expr}} function provided by
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110688#comment-15110688
]
Emlyn Corrin commented on SPARK-9740:
-
How do you use FIRST/LAST from the Java API with ignoreNulls
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692293#comment-14692293
]
Yin Huai commented on SPARK-9740:
-
Actually, seems our old first/last functions do not
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692392#comment-14692392
]
Apache Spark commented on SPARK-9740:
-
User 'yhuai' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682381#comment-14682381
]
Yin Huai commented on SPARK-9740:
-
[~hvanhovell] Does Hive have a flag for it? Or it take
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682390#comment-14682390
]
Yin Huai commented on SPARK-9740:
-
I think we should use {{RESPECT NULLS}} as the default
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682405#comment-14682405
]
Herman van Hovell commented on SPARK-9740:
--
I think Hive uses a Flag,
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682460#comment-14682460
]
Yin Huai commented on SPARK-9740:
-
Thanks. I will change the behavior to respecting nulls.
[
https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661859#comment-14661859
]
Herman van Hovell commented on SPARK-9740:
--
BTW: I encountered this while doing
26 matches
Mail list logo
