[
https://issues.apache.org/jira/browse/SPARK-39885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-39885:
--
Summary: Behavior differs between arrays_overlap and array_contains for
negative 0.0
[
https://issues.apache.org/jira/browse/SPARK-39885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-39885:
--
Description:
{{array_contains([0.0], -0.0)}} will return true. {{array_overlaps([0.0],
[
https://issues.apache.org/jira/browse/SPARK-39885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-39885:
--
Description:
{{array_contains([0.0], -0.0)}} will return true. {{array_overlaps([0.0],
[
https://issues.apache.org/jira/browse/SPARK-39885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-39885:
--
Description:
{{array_contains([0.0], -0.0)}} will return true. {{array_overlaps([0.0],
David Vogelbacher created SPARK-39885:
-
Summary: Behavior differs between array_overlap and array_contains
for negative 0.0
Key: SPARK-39885
URL: https://issues.apache.org/jira/browse/SPARK-39885
David Vogelbacher created SPARK-39746:
-
Summary: Binary array operations can be faster if one side is a
constant
Key: SPARK-39746
URL: https://issues.apache.org/jira/browse/SPARK-39746
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-28761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-28761:
--
Description:
Spark has a setting {{spark.driver.maxResultSize}}, see
https://spark.ap
[
https://issues.apache.org/jira/browse/SPARK-28761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-28761:
--
Description:
Spark has a setting {{spark.driver.maxResultSize}}, see
https://spark.ap
David Vogelbacher created SPARK-28761:
-
Summary: spark.driver.maxResultSize only applies to compressed data
Key: SPARK-28761
URL: https://issues.apache.org/jira/browse/SPARK-28761
Project: Spark
David Vogelbacher created SPARK-27805:
-
Summary: toPandas does not propagate SparkExceptions with arrow
enabled
Key: SPARK-27805
URL: https://issues.apache.org/jira/browse/SPARK-27805
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-27778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-27778:
--
Summary: toPandas with arrow enabled fails for DF with no partitions (was:
toPandas w
[
https://issues.apache.org/jira/browse/SPARK-27778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16843987#comment-16843987
]
David Vogelbacher commented on SPARK-27778:
---
I will make a pr for this shortly
David Vogelbacher created SPARK-27778:
-
Summary: toPandas with arrow enabled fails for DF with no partition
Key: SPARK-27778
URL: https://issues.apache.org/jira/browse/SPARK-27778
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16750674#comment-16750674
]
David Vogelbacher commented on SPARK-24437:
---
[~DaveDeCaprio] I have not tested
[
https://issues.apache.org/jira/browse/SPARK-26423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-26423:
--
Description:
If an executor disconnects we currently only disable it in the
{{Kuberne
David Vogelbacher created SPARK-26423:
-
Summary: [K8s] Make sure that disconnected executors eventually
get deleted
Key: SPARK-26423
URL: https://issues.apache.org/jira/browse/SPARK-26423
Project:
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679768#comment-16679768
]
David Vogelbacher commented on SPARK-24437:
---
Thanks for the explanations! I wi
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679253#comment-16679253
]
David Vogelbacher commented on SPARK-24437:
---
[~eyalfa] There might be hundred
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675690#comment-16675690
]
David Vogelbacher commented on SPARK-24437:
---
[~eyalfa] the cached relations on
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16671686#comment-16671686
]
David Vogelbacher edited comment on SPARK-24437 at 11/1/18 2:43 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16671686#comment-16671686
]
David Vogelbacher commented on SPARK-24437:
---
Hey [~mgaido], I am seeing someth
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-24437:
--
Attachment: Screen Shot 2018-11-01 at 10.38.30 AM.png
> Memory leak in UnsafeHashedRel
[
https://issues.apache.org/jira/browse/SPARK-24983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-24983:
--
Description:
I noticed that writing a spark job that includes many sequential
{{when-
David Vogelbacher created SPARK-24983:
-
Summary: Collapsing multiple project statements with dependent
When-Otherwise statements on the same column can OOM the driver
Key: SPARK-24983
URL: https://issues.apach
[
https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16561277#comment-16561277
]
David Vogelbacher edited comment on SPARK-24957 at 7/29/18 9:55 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16561277#comment-16561277
]
David Vogelbacher commented on SPARK-24957:
---
[~mgaido] I wasn't able to reprod
[
https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-24957:
--
Description:
I noticed a bug when doing arithmetic on a dataframe containing decimal v
David Vogelbacher created SPARK-24957:
-
Summary: Decimal arithmetic can lead to wrong values using codegen
Key: SPARK-24957
URL: https://issues.apache.org/jira/browse/SPARK-24957
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16558360#comment-16558360
]
David Vogelbacher commented on SPARK-24934:
---
Thanks for opening and making the
[
https://issues.apache.org/jira/browse/SPARK-12911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16556470#comment-16556470
]
David Vogelbacher commented on SPARK-12911:
---
Hey [~hyukjin.kwon] [~sdicocco][~
[
https://issues.apache.org/jira/browse/SPARK-23825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419950#comment-16419950
]
David Vogelbacher commented on SPARK-23825:
---
addressed by https://github.com/ap
[
https://issues.apache.org/jira/browse/SPARK-23825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419857#comment-16419857
]
David Vogelbacher commented on SPARK-23825:
---
Will make a PR shortly, cc [~mchea
[
https://issues.apache.org/jira/browse/SPARK-23825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23825:
--
Description:
We currently request {{spark.[driver,executor].memory}} as memory from
K
[
https://issues.apache.org/jira/browse/SPARK-23825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23825:
--
Description:
We currently request {{spark.{driver,executor}.memory}} as memory from
K
David Vogelbacher created SPARK-23825:
-
Summary: [K8s] Spark pods should request memory + memoryOverhead
as resources
Key: SPARK-23825
URL: https://issues.apache.org/jira/browse/SPARK-23825
Projec
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391709#comment-16391709
]
David Vogelbacher edited comment on SPARK-23598 at 3/8/18 6:41 PM:
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391709#comment-16391709
]
David Vogelbacher commented on SPARK-23598:
---
[~mgaido] {{HashAggregateExec}} ca
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389745#comment-16389745
]
David Vogelbacher commented on SPARK-23598:
---
[~hvanhovell] unfortunately, I can
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23598:
--
Description:
Got the following stacktrace for a large QueryPlan using WholeStageCodeGen
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23598:
--
Description:
Got the following stacktrace for a large QueryPlan using WholeStageCodeGen
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23598:
--
Description:
Got the following stacktrace for a large QueryPlan using WholeStageCodeGen
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23598:
--
Description:
Got the following stacktrace for a large QueryPlan using WholeStageCodeGen
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23598:
--
Description:
Got the following stacktrace for a large QueryPlan using WholeStageCodeGen
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23598:
--
Description:
Got the following stacktrace for a large QueryPlan using WholeStageCodeGen
David Vogelbacher created SPARK-23598:
-
Summary: WholeStageCodegen can lead to IllegalAccessError calling
append for HashAggregateExec
Key: SPARK-23598
URL: https://issues.apache.org/jira/browse/SPARK-23598
45 matches
Mail list logo
