[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634455#comment-15634455
]
Nicholas Chammas commented on SPARK-18254:
--
So it was specifically some broken
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634432#comment-15634432
]
Herman van Hovell commented on SPARK-18254:
---
We 'accidentally' fixed this yesterday with
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634428#comment-15634428
]
Nicholas Chammas commented on SPARK-18254:
--
Just tried it. Seems like the fix is only available
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634416#comment-15634416
]
Davies Liu commented on SPARK-18254:
Could you also try 2.0.2?
> UDFs don't see aliased column names
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634391#comment-15634391
]
Nicholas Chammas commented on SPARK-18254:
--
If I try branch-2.1 on
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634333#comment-15634333
]
Davies Liu commented on SPARK-18254:
I tried the following in master (2.1), it works
{code}
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634228#comment-15634228
]
Davies Liu commented on SPARK-18254:
I doubt it's a bug in ExtractPythonUDFs, not operator push down,
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634122#comment-15634122
]
Michael Armbrust commented on SPARK-18254:
--
Is this yet another bug caused by the generic
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633744#comment-15633744
]
Nicholas Chammas commented on SPARK-18254:
--
Interestingly, if I add {{names_cleaned.persist()}}
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633446#comment-15633446
]
Nicholas Chammas commented on SPARK-18254:
--
Yes, if I don't alias the columns and/or update
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633436#comment-15633436
]
Herman van Hovell commented on SPARK-18254:
---
Oh, BatchEvalPython is pushed below the
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633429#comment-15633429
]
Herman van Hovell commented on SPARK-18254:
---
So FIRST and LAST work?
> UDFs don't see aliased
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633424#comment-15633424
]
Nicholas Chammas commented on SPARK-18254:
--
Yep, it works fine if the column names haven't been
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633379#comment-15633379
]
Herman van Hovell commented on SPARK-18254:
---
How can you take the length of a row? Do you
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633395#comment-15633395
]
Herman van Hovell commented on SPARK-18254:
---
H... I am not python expert. Is it normal that
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633220#comment-15633220
]
Nicholas Chammas commented on SPARK-18254:
--
[~marmbrus] / [~hvanhovell]: Is there a workaround
16 matches
Mail list logo
