[
https://issues.apache.org/jira/browse/SPARK-22641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Duffy updated SPARK-22641:
-
Description:
We seem to have found an issue with PySpark UDFs interacting with
{{withColumn}} wh
[
https://issues.apache.org/jira/browse/SPARK-22641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Duffy updated SPARK-22641:
-
Description:
We seem to have found an issue with PySpark UDFs interacting with
{{withColumn}} wh
[
https://issues.apache.org/jira/browse/SPARK-22641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16270132#comment-16270132
]
Andrew Duffy commented on SPARK-22641:
--
Query plan with the literal:
{code}
== Pars
[
https://issues.apache.org/jira/browse/SPARK-22641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16270128#comment-16270128
]
Andrew Duffy commented on SPARK-22641:
--
So it seems this is only a problem when usin
[
https://issues.apache.org/jira/browse/SPARK-22641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16270128#comment-16270128
]
Andrew Duffy edited comment on SPARK-22641 at 11/29/17 4:44 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-22641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Duffy updated SPARK-22641:
-
Description:
We seem to have found an issue with PySpark UDFs interacting with
{{withColumn}} wh
[
https://issues.apache.org/jira/browse/SPARK-22641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Duffy updated SPARK-22641:
-
Description:
We seem to have found an issue with PySpark UDFs interacting with
{{withColumn}} wh
[
https://issues.apache.org/jira/browse/SPARK-22641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Duffy updated SPARK-22641:
-
Description:
We seem to have found an issue with PySpark UDFs interacting with
{{withColumn}} wh
[
https://issues.apache.org/jira/browse/SPARK-22641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Duffy updated SPARK-22641:
-
Description:
We seem to have found an issue with PySpark UDFs interacting with
{{withColumn}} wh
Andrew Duffy created SPARK-22641:
Summary: Pyspark UDF relying on column added with withColumn after
distinct
Key: SPARK-22641
URL: https://issues.apache.org/jira/browse/SPARK-22641
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065177#comment-16065177
]
Andrew Duffy edited comment on SPARK-21218 at 6/27/17 5:39 PM:
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065177#comment-16065177
]
Andrew Duffy commented on SPARK-21218:
--
Curious, I wonder what the previous benchmar
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063981#comment-16063981
]
Andrew Duffy commented on SPARK-21218:
--
Good catch, looks like a dupe. [~hyukjin.kwo
[
https://issues.apache.org/jira/browse/SPARK-17091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Duffy resolved SPARK-17091.
--
Resolution: Won't Fix
Should've closed this last year, but at the time based on Hyukjin Kwon's
[
https://issues.apache.org/jira/browse/SPARK-17310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15448672#comment-15448672
]
Andrew Duffy commented on SPARK-17310:
--
+1 to this, see comments on https://github.c
[
https://issues.apache.org/jira/browse/SPARK-17213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Duffy updated SPARK-17213:
-
Description:
Spark defines ordering over strings based on comparison of UTF8 byte arrays,
which
[
https://issues.apache.org/jira/browse/SPARK-17213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Duffy updated SPARK-17213:
-
Description:
Spark defines ordering over strings based on comparison of UTF8 byte arrays,
which
Andrew Duffy created SPARK-17213:
Summary: Parquet String Pushdown for Non-Eq Comparisons Broken
Key: SPARK-17213
URL: https://issues.apache.org/jira/browse/SPARK-17213
Project: Spark
Issue T
Andrew Duffy created SPARK-17091:
Summary: ParquetFilters rewrite IN to OR of Eq
Key: SPARK-17091
URL: https://issues.apache.org/jira/browse/SPARK-17091
Project: Spark
Issue Type: Bug
Andrew Duffy created SPARK-17059:
Summary: Allow FileFormat to specify partition pruning strategy
Key: SPARK-17059
URL: https://issues.apache.org/jira/browse/SPARK-17059
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-16265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365998#comment-15365998
]
Andrew Duffy commented on SPARK-16265:
--
Hi Sean, yeah I can see where you're coming
Andrew Duffy created SPARK-16265:
Summary: Add option to SparkSubmit to ship driver JRE to YARN
Key: SPARK-16265
URL: https://issues.apache.org/jira/browse/SPARK-16265
Project: Spark
Issue Ty
22 matches
Mail list logo
