[jira] [Commented] (SPARK-31612) SQL Reference clean up

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097196#comment-17097196 ] Apache Spark commented on SPARK-31612: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-31612) SQL Reference clean up

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097195#comment-17097195 ] Apache Spark commented on SPARK-31612: -- User 'huaxingao' has created a pull request

[jira] [Created] (SPARK-31620) TreeNodeException: Binding attribute, tree: sum#19L

2020-04-30 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-31620: --- Summary: TreeNodeException: Binding attribute, tree: sum#19L Key: SPARK-31620 URL: https://issues.apache.org/jira/browse/SPARK-31620 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-29701) Different answers when empty input given in GROUPING SETS

2020-04-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29701. - Resolution: Won't Fix > Different answers when empty input given in GROUPING SETS >

[jira] [Assigned] (SPARK-31447) DATE_PART functions produces incorrect result

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31447: Assignee: (was: Apache Spark) > DATE_PART functions produces incorrect result > -

[jira] [Assigned] (SPARK-31447) DATE_PART functions produces incorrect result

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31447: Assignee: Apache Spark > DATE_PART functions produces incorrect result >

[jira] [Commented] (SPARK-31372) Display expression schema for double checkout alias

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097140#comment-17097140 ] Apache Spark commented on SPARK-31372: -- User 'maropu' has created a pull request fo

[jira] [Resolved] (SPARK-31619) Rename config name "spark.dynamicAllocation.shuffleTimeout" to "spark.dynamicAllocation.shuffleTracking.timeout"

2020-04-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31619. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28426 [https://gi

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-04-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097132#comment-17097132 ] Sean R. Owen commented on SPARK-29292: -- Yep it is going to be a quite large interna

[jira] [Reopened] (SPARK-23172) Expand the ReorderJoin rule to handle Project nodes

2020-04-30 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reopened SPARK-23172: -- > Expand the ReorderJoin rule to handle Project nodes > --

[jira] [Resolved] (SPARK-23172) Expand the ReorderJoin rule to handle Project nodes

2020-04-30 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-23172. -- Resolution: Won't Fix > Expand the ReorderJoin rule to handle Project nodes >

[jira] [Assigned] (SPARK-20629) Copy shuffle data when nodes are being shut down

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20629: Assignee: Apache Spark > Copy shuffle data when nodes are being shut down > -

[jira] [Assigned] (SPARK-20629) Copy shuffle data when nodes are being shut down

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20629: Assignee: (was: Apache Spark) > Copy shuffle data when nodes are being shut down > --

[jira] [Commented] (SPARK-20629) Copy shuffle data when nodes are being shut down

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097103#comment-17097103 ] Apache Spark commented on SPARK-20629: -- User 'holdenk' has created a pull request f

[jira] [Resolved] (SPARK-31549) Pyspark SparkContext.cancelJobGroup do not work correctly

2020-04-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31549. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28395 [https://gi

[jira] [Assigned] (SPARK-31549) Pyspark SparkContext.cancelJobGroup do not work correctly

2020-04-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31549: Assignee: Weichen Xu > Pyspark SparkContext.cancelJobGroup do not work correctly > --

[jira] [Commented] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097073#comment-17097073 ] Dongjoon Hyun commented on SPARK-31500: --- I checked the following code snippet from

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31500: -- Labels: correctness (was: ) > collect_set() of BinaryType returns duplicate elements > --

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31500: -- Affects Version/s: 2.1.3 > collect_set() of BinaryType returns duplicate elements > --

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31500: -- Affects Version/s: 2.0.2 > collect_set() of BinaryType returns duplicate elements > --

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31500: -- Affects Version/s: 2.2.3 > collect_set() of BinaryType returns duplicate elements > --

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31500: -- Affects Version/s: 2.3.4 > collect_set() of BinaryType returns duplicate elements > --

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31500: -- Affects Version/s: (was: 2.4.4) > collect_set() of BinaryType returns duplicate elements >

[jira] [Resolved] (SPARK-31616) Add partition event listener in ExternalCatalogWithListener

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31616. --- Resolution: Duplicate > Add partition event listener in ExternalCatalogWithListener > --

[jira] [Assigned] (SPARK-31619) Rename config name "spark.dynamicAllocation.shuffleTimeout" to "spark.dynamicAllocation.shuffleTracking.timeout"

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31619: Assignee: Apache Spark (was: Xingbo Jiang) > Rename config name "spark.dynamicAllocation

[jira] [Commented] (SPARK-31619) Rename config name "spark.dynamicAllocation.shuffleTimeout" to "spark.dynamicAllocation.shuffleTracking.timeout"

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097046#comment-17097046 ] Apache Spark commented on SPARK-31619: -- User 'jiangxb1987' has created a pull reque

[jira] [Assigned] (SPARK-31619) Rename config name "spark.dynamicAllocation.shuffleTimeout" to "spark.dynamicAllocation.shuffleTracking.timeout"

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31619: Assignee: Xingbo Jiang (was: Apache Spark) > Rename config name "spark.dynamicAllocation

[jira] [Created] (SPARK-31619) Rename config name "spark.dynamicAllocation.shuffleTimeout" to "spark.dynamicAllocation.shuffleTracking.timeout"

2020-04-30 Thread Xingbo Jiang (Jira)
Xingbo Jiang created SPARK-31619: Summary: Rename config name "spark.dynamicAllocation.shuffleTimeout" to "spark.dynamicAllocation.shuffleTracking.timeout" Key: SPARK-31619 URL: https://issues.apache.org/jira/bro

[jira] [Commented] (SPARK-31612) SQL Reference clean up

2020-04-30 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097013#comment-17097013 ] Huaxin Gao commented on SPARK-31612: Check the following things in SQL Reference and

[jira] [Resolved] (SPARK-31612) SQL Reference clean up

2020-04-30 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31612. -- Fix Version/s: 3.0.0 Assignee: Huaxin Gao Resolution: Fixed Resolved b

[jira] [Commented] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096939#comment-17096939 ] Dongjoon Hyun commented on SPARK-29048: --- BTW, this was merged and reverted for `3.

[jira] [Commented] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096935#comment-17096935 ] Dongjoon Hyun commented on SPARK-29048: --- This caused a correctness issue, SPARK-31

[jira] [Updated] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29048: -- Target Version/s: (was: 2.4.6) > Query optimizer slow when using Column.isInCollection() wit

[jira] [Commented] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096930#comment-17096930 ] Apache Spark commented on SPARK-31480: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31480: Assignee: (was: Apache Spark) > Improve the EXPLAIN FORMATTED's output for DSV2's Sca

[jira] [Commented] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096928#comment-17096928 ] Apache Spark commented on SPARK-31480: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31480: Assignee: Apache Spark > Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node > --

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-04-30 Thread Guillaume Martres (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096893#comment-17096893 ] Guillaume Martres commented on SPARK-29292: --- If it's immutable it's fine yeah,

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-04-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096879#comment-17096879 ] Sean R. Owen commented on SPARK-29292: -- Heh, congratulations, it is going to be a h

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-04-30 Thread Guillaume Martres (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096876#comment-17096876 ] Guillaume Martres commented on SPARK-29292: --- Thanks [~srowen], I got spark to

[jira] [Comment Edited] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-04-30 Thread Guillaume Martres (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096876#comment-17096876 ] Guillaume Martres edited comment on SPARK-29292 at 4/30/20, 6:47 PM: -

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

2020-04-30 Thread Guillaume Martres (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096870#comment-17096870 ] Guillaume Martres commented on SPARK-25075: --- Based on [~srowen]'s branch from

[jira] [Updated] (SPARK-31608) Add a hybrid KVStore to make UI loading faster

2020-04-30 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-31608: Description: This is a follow-up for the work done by Hieu Huynh in 2019. Add a new class HybridK

[jira] [Assigned] (SPARK-30865) Refactor DateTimeUtils

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30865: Assignee: (was: Apache Spark) > Refactor DateTimeUtils > -- > >

[jira] [Assigned] (SPARK-30865) Refactor DateTimeUtils

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30865: Assignee: Apache Spark > Refactor DateTimeUtils > -- > >

[jira] [Commented] (SPARK-31574) Schema evolution in spark while using the storage format as parquet

2020-04-30 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096805#comment-17096805 ] Pablo Langa Blanco commented on SPARK-31574: Spark have a functionality to r

[jira] [Assigned] (SPARK-31357) SPIP: Catalog API for view metadata

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31357: Assignee: Apache Spark > SPIP: Catalog API for view metadata > --

[jira] [Commented] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096755#comment-17096755 ] Apache Spark commented on SPARK-31517: -- User 'MichaelChirico' has created a pull re

[jira] [Assigned] (SPARK-31590) The filter used by Metadata-only queries should not have Unevaluable

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31590: Assignee: (was: Apache Spark) > The filter used by Metadata-only queries should not h

[jira] [Assigned] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31517: Assignee: Apache Spark > SparkR::orderBy with multiple columns descending produces error

[jira] [Assigned] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31517: Assignee: (was: Apache Spark) > SparkR::orderBy with multiple columns descending prod

[jira] [Commented] (SPARK-31593) Remove unnecessary streaming query progress update

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096745#comment-17096745 ] Apache Spark commented on SPARK-31593: -- User 'uncleGen' has created a pull request

[jira] [Assigned] (SPARK-31571) don't use stop(paste to build R errors

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31571: Assignee: Apache Spark > don't use stop(paste to build R errors > ---

[jira] [Commented] (SPARK-31609) Add VarianceThresholdSelector to PySpark

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096744#comment-17096744 ] Apache Spark commented on SPARK-31609: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-31603) AFT uses common functions in RDDLossFunction

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31603: Assignee: Apache Spark > AFT uses common functions in RDDLossFunction > -

[jira] [Commented] (SPARK-31571) don't use stop(paste to build R errors

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096748#comment-17096748 ] Apache Spark commented on SPARK-31571: -- User 'MichaelChirico' has created a pull re

[jira] [Assigned] (SPARK-31571) don't use stop(paste to build R errors

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31571: Assignee: (was: Apache Spark) > don't use stop(paste to build R errors >

[jira] [Assigned] (SPARK-31603) AFT uses common functions in RDDLossFunction

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31603: Assignee: (was: Apache Spark) > AFT uses common functions in RDDLossFunction > --

[jira] [Assigned] (SPARK-31609) Add VarianceThresholdSelector to PySpark

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31609: Assignee: (was: Apache Spark) > Add VarianceThresholdSelector to PySpark > --

[jira] [Commented] (SPARK-31603) AFT uses common functions in RDDLossFunction

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096751#comment-17096751 ] Apache Spark commented on SPARK-31603: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-31609) Add VarianceThresholdSelector to PySpark

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31609: Assignee: Apache Spark > Add VarianceThresholdSelector to PySpark > -

[jira] [Commented] (SPARK-31570) gapply and dapply docs should be more aligned, possibly combined

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096750#comment-17096750 ] Apache Spark commented on SPARK-31570: -- User 'MichaelChirico' has created a pull re

[jira] [Commented] (SPARK-27188) FileStreamSink: provide a new option to have retention on output files

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096746#comment-17096746 ] Apache Spark commented on SPARK-27188: -- User 'HeartSaVioR' has created a pull reque

[jira] [Assigned] (SPARK-31593) Remove unnecessary streaming query progress update

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31593: Assignee: Apache Spark > Remove unnecessary streaming query progress update > ---

[jira] [Commented] (SPARK-31590) The filter used by Metadata-only queries should not have Unevaluable

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096752#comment-17096752 ] Apache Spark commented on SPARK-31590: -- User 'cxzl25' has created a pull request fo

[jira] [Assigned] (SPARK-31570) gapply and dapply docs should be more aligned, possibly combined

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31570: Assignee: Apache Spark > gapply and dapply docs should be more aligned, possibly combined

[jira] [Assigned] (SPARK-31566) Add SQL Rest API Documentation

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31566: Assignee: Apache Spark > Add SQL Rest API Documentation > --

[jira] [Assigned] (SPARK-31566) Add SQL Rest API Documentation

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31566: Assignee: (was: Apache Spark) > Add SQL Rest API Documentation >

[jira] [Commented] (SPARK-31566) Add SQL Rest API Documentation

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096747#comment-17096747 ] Apache Spark commented on SPARK-31566: -- User 'erenavsarogullari' has created a pull

[jira] [Commented] (SPARK-26199) Long expressions cause mutate to fail

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096749#comment-17096749 ] Apache Spark commented on SPARK-26199: -- User 'MichaelChirico' has created a pull re

[jira] [Assigned] (SPARK-31570) gapply and dapply docs should be more aligned, possibly combined

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31570: Assignee: (was: Apache Spark) > gapply and dapply docs should be more aligned, possib

[jira] [Assigned] (SPARK-31590) The filter used by Metadata-only queries should not have Unevaluable

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31590: Assignee: Apache Spark > The filter used by Metadata-only queries should not have Unevalu

[jira] [Assigned] (SPARK-31593) Remove unnecessary streaming query progress update

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31593: Assignee: (was: Apache Spark) > Remove unnecessary streaming query progress update >

[jira] [Assigned] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31592: Assignee: Apache Spark > bufferPoolsBySize in HeapMemoryAllocator should be thread safe >

[jira] [Assigned] (SPARK-31575) Synchronise global JVM security configuration modification

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31575: Assignee: (was: Apache Spark) > Synchronise global JVM security configuration modific

[jira] [Assigned] (SPARK-31365) Enable nested predicate pushdown per data sources

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31365: Assignee: (was: Apache Spark) > Enable nested predicate pushdown per data sources > -

[jira] [Commented] (SPARK-31575) Synchronise global JVM security configuration modification

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096742#comment-17096742 ] Apache Spark commented on SPARK-31575: -- User 'gaborgsomogyi' has created a pull req

[jira] [Commented] (SPARK-31365) Enable nested predicate pushdown per data sources

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096740#comment-17096740 ] Apache Spark commented on SPARK-31365: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096743#comment-17096743 ] Apache Spark commented on SPARK-31592: -- User 'fanyunbojerry' has created a pull req

[jira] [Assigned] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31592: Assignee: (was: Apache Spark) > bufferPoolsBySize in HeapMemoryAllocator should be th

[jira] [Assigned] (SPARK-31365) Enable nested predicate pushdown per data sources

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31365: Assignee: Apache Spark > Enable nested predicate pushdown per data sources >

[jira] [Assigned] (SPARK-31575) Synchronise global JVM security configuration modification

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31575: Assignee: Apache Spark > Synchronise global JVM security configuration modification > ---

[jira] [Assigned] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31268: Assignee: Apache Spark > TaskEnd event with zero Executor Metrics when task duration less

[jira] [Assigned] (SPARK-31334) Use agg column in Having clause behave different with column type

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31334: Assignee: Apache Spark > Use agg column in Having clause behave different with column typ

[jira] [Assigned] (SPARK-31226) SizeBasedCoalesce logic error

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31226: Assignee: (was: Apache Spark) > SizeBasedCoalesce logic error > -

[jira] [Assigned] (SPARK-31106) Support is_json function

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31106: Assignee: Apache Spark > Support is_json function > > >

[jira] [Assigned] (SPARK-31220) repartition obeys spark.sql.adaptive.coalescePartitions.initialPartitionNum when spark.sql.adaptive.enabled

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31220: Assignee: (was: Apache Spark) > repartition obeys spark.sql.adaptive.coalescePartitio

[jira] [Assigned] (SPARK-31154) Expose basic write metrics for InsertIntoDataSourceCommand

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31154: Assignee: Apache Spark > Expose basic write metrics for InsertIntoDataSourceCommand > ---

[jira] [Assigned] (SPARK-31335) Add try function support

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31335: Assignee: (was: Apache Spark) > Add try function support > >

[jira] [Assigned] (SPARK-31154) Expose basic write metrics for InsertIntoDataSourceCommand

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31154: Assignee: (was: Apache Spark) > Expose basic write metrics for InsertIntoDataSourceCo

[jira] [Assigned] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31268: Assignee: (was: Apache Spark) > TaskEnd event with zero Executor Metrics when task du

[jira] [Assigned] (SPARK-31363) Improve DataSourceRegister interface

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31363: Assignee: (was: Apache Spark) > Improve DataSourceRegister interface > --

[jira] [Assigned] (SPARK-31255) DataSourceV2: Add metadata columns

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31255: Assignee: Apache Spark > DataSourceV2: Add metadata columns > ---

[jira] [Assigned] (SPARK-31334) Use agg column in Having clause behave different with column type

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31334: Assignee: (was: Apache Spark) > Use agg column in Having clause behave different with

[jira] [Assigned] (SPARK-31255) DataSourceV2: Add metadata columns

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31255: Assignee: (was: Apache Spark) > DataSourceV2: Add metadata columns >

[jira] [Assigned] (SPARK-30996) Able to write parquet file subsequently unable to read

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30996: Assignee: Apache Spark > Able to write parquet file subsequently unable to read > ---

[jira] [Assigned] (SPARK-31289) Flaky test: org.apache.spark.sql.hive.thriftserver.CliSuite

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31289: Assignee: (was: Apache Spark) > Flaky test: org.apache.spark.sql.hive.thriftserver.Cl

[jira] [Assigned] (SPARK-31220) repartition obeys spark.sql.adaptive.coalescePartitions.initialPartitionNum when spark.sql.adaptive.enabled

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31220: Assignee: Apache Spark > repartition obeys spark.sql.adaptive.coalescePartitions.initialP

[jira] [Assigned] (SPARK-26341) Expose executor memory metrics at the stage level, in the Stages tab

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26341: Assignee: Apache Spark > Expose executor memory metrics at the stage level, in the Stages

[jira] [Assigned] (SPARK-31354) SparkSession Lifecycle methods to fix memory leak

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31354: Assignee: Apache Spark > SparkSession Lifecycle methods to fix memory leak >

  1   2   3   4   >