[jira] [Assigned] (SPARK-31447) DATE_PART functions produces incorrect result

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31447: Assignee: (was: Apache Spark) > DATE_PART functions produces incorrect result >

[jira] [Assigned] (SPARK-31447) DATE_PART functions produces incorrect result

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31447: Assignee: Apache Spark > DATE_PART functions produces incorrect result >

[jira] [Commented] (SPARK-31372) Display expression schema for double checkout alias

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097140#comment-17097140 ] Apache Spark commented on SPARK-31372: -- User 'maropu' has created a pull request for this issue:

[jira] [Resolved] (SPARK-31619) Rename config name "spark.dynamicAllocation.shuffleTimeout" to "spark.dynamicAllocation.shuffleTracking.timeout"

2020-04-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31619. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28426

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-04-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097132#comment-17097132 ] Sean R. Owen commented on SPARK-29292: -- Yep it is going to be a quite large internal change to even

[jira] [Reopened] (SPARK-23172) Expand the ReorderJoin rule to handle Project nodes

2020-04-30 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reopened SPARK-23172: -- > Expand the ReorderJoin rule to handle Project nodes >

[jira] [Resolved] (SPARK-23172) Expand the ReorderJoin rule to handle Project nodes

2020-04-30 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-23172. -- Resolution: Won't Fix > Expand the ReorderJoin rule to handle Project nodes >

[jira] [Assigned] (SPARK-20629) Copy shuffle data when nodes are being shut down

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20629: Assignee: Apache Spark > Copy shuffle data when nodes are being shut down >

[jira] [Assigned] (SPARK-20629) Copy shuffle data when nodes are being shut down

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20629: Assignee: (was: Apache Spark) > Copy shuffle data when nodes are being shut down >

[jira] [Commented] (SPARK-20629) Copy shuffle data when nodes are being shut down

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097103#comment-17097103 ] Apache Spark commented on SPARK-20629: -- User 'holdenk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-31549) Pyspark SparkContext.cancelJobGroup do not work correctly

2020-04-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31549. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28395

[jira] [Assigned] (SPARK-31549) Pyspark SparkContext.cancelJobGroup do not work correctly

2020-04-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31549: Assignee: Weichen Xu > Pyspark SparkContext.cancelJobGroup do not work correctly >

[jira] [Commented] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097073#comment-17097073 ] Dongjoon Hyun commented on SPARK-31500: --- I checked the following code snippet from the PR unit

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31500: -- Labels: correctness (was: ) > collect_set() of BinaryType returns duplicate elements >

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31500: -- Affects Version/s: 2.1.3 > collect_set() of BinaryType returns duplicate elements >

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31500: -- Affects Version/s: 2.0.2 > collect_set() of BinaryType returns duplicate elements >

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31500: -- Affects Version/s: 2.2.3 > collect_set() of BinaryType returns duplicate elements >

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31500: -- Affects Version/s: 2.3.4 > collect_set() of BinaryType returns duplicate elements >

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31500: -- Affects Version/s: (was: 2.4.4) > collect_set() of BinaryType returns duplicate elements

[jira] [Resolved] (SPARK-31616) Add partition event listener in ExternalCatalogWithListener

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31616. --- Resolution: Duplicate > Add partition event listener in ExternalCatalogWithListener >

[jira] [Assigned] (SPARK-31619) Rename config name "spark.dynamicAllocation.shuffleTimeout" to "spark.dynamicAllocation.shuffleTracking.timeout"

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31619: Assignee: Apache Spark (was: Xingbo Jiang) > Rename config name

[jira] [Commented] (SPARK-31619) Rename config name "spark.dynamicAllocation.shuffleTimeout" to "spark.dynamicAllocation.shuffleTracking.timeout"

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097046#comment-17097046 ] Apache Spark commented on SPARK-31619: -- User 'jiangxb1987' has created a pull request for this

[jira] [Assigned] (SPARK-31619) Rename config name "spark.dynamicAllocation.shuffleTimeout" to "spark.dynamicAllocation.shuffleTracking.timeout"

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31619: Assignee: Xingbo Jiang (was: Apache Spark) > Rename config name

[jira] [Created] (SPARK-31619) Rename config name "spark.dynamicAllocation.shuffleTimeout" to "spark.dynamicAllocation.shuffleTracking.timeout"

2020-04-30 Thread Xingbo Jiang (Jira)
Xingbo Jiang created SPARK-31619: Summary: Rename config name "spark.dynamicAllocation.shuffleTimeout" to "spark.dynamicAllocation.shuffleTracking.timeout" Key: SPARK-31619 URL:

[jira] [Commented] (SPARK-31612) SQL Reference clean up

2020-04-30 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097013#comment-17097013 ] Huaxin Gao commented on SPARK-31612: Check the following things in SQL Reference and fix if problems

[jira] [Resolved] (SPARK-31612) SQL Reference clean up

2020-04-30 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31612. -- Fix Version/s: 3.0.0 Assignee: Huaxin Gao Resolution: Fixed Resolved

[jira] [Commented] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096939#comment-17096939 ] Dongjoon Hyun commented on SPARK-29048: --- BTW, this was merged and reverted for `3.0.0` only. This

[jira] [Commented] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096935#comment-17096935 ] Dongjoon Hyun commented on SPARK-29048: --- This caused a correctness issue, SPARK-31553, which is

[jira] [Updated] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29048: -- Target Version/s: (was: 2.4.6) > Query optimizer slow when using Column.isInCollection()

[jira] [Commented] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096930#comment-17096930 ] Apache Spark commented on SPARK-31480: -- User 'dilipbiswal' has created a pull request for this

[jira] [Commented] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096928#comment-17096928 ] Apache Spark commented on SPARK-31480: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31480: Assignee: Apache Spark > Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node >

[jira] [Assigned] (SPARK-31480) Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31480: Assignee: (was: Apache Spark) > Improve the EXPLAIN FORMATTED's output for DSV2's

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-04-30 Thread Guillaume Martres (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096893#comment-17096893 ] Guillaume Martres commented on SPARK-29292: --- If it's immutable it's fine yeah, but it seems

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-04-30 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096879#comment-17096879 ] Sean R. Owen commented on SPARK-29292: -- Heh, congratulations, it is going to be a huge change. Why

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-04-30 Thread Guillaume Martres (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096876#comment-17096876 ] Guillaume Martres commented on SPARK-29292: --- Thanks [~srowen], I got spark to compile with

[jira] [Comment Edited] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-04-30 Thread Guillaume Martres (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096876#comment-17096876 ] Guillaume Martres edited comment on SPARK-29292 at 4/30/20, 6:47 PM: -

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

2020-04-30 Thread Guillaume Martres (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096870#comment-17096870 ] Guillaume Martres commented on SPARK-25075: --- Based on [~srowen]'s branch from SPARK-29292, I

[jira] [Updated] (SPARK-31608) Add a hybrid KVStore to make UI loading faster

2020-04-30 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-31608: Description: This is a follow-up for the work done by Hieu Huynh in 2019. Add a new class

[jira] [Assigned] (SPARK-30865) Refactor DateTimeUtils

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30865: Assignee: (was: Apache Spark) > Refactor DateTimeUtils > -- > >

[jira] [Assigned] (SPARK-30865) Refactor DateTimeUtils

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30865: Assignee: Apache Spark > Refactor DateTimeUtils > -- > >

[jira] [Commented] (SPARK-31574) Schema evolution in spark while using the storage format as parquet

2020-04-30 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096805#comment-17096805 ] Pablo Langa Blanco commented on SPARK-31574: Spark have a functionality to read multiple

[jira] [Assigned] (SPARK-31357) SPIP: Catalog API for view metadata

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31357: Assignee: Apache Spark > SPIP: Catalog API for view metadata >

[jira] [Assigned] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31517: Assignee: Apache Spark > SparkR::orderBy with multiple columns descending produces error

[jira] [Commented] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096755#comment-17096755 ] Apache Spark commented on SPARK-31517: -- User 'MichaelChirico' has created a pull request for this

[jira] [Assigned] (SPARK-31590) The filter used by Metadata-only queries should not have Unevaluable

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31590: Assignee: (was: Apache Spark) > The filter used by Metadata-only queries should not

[jira] [Assigned] (SPARK-31517) SparkR::orderBy with multiple columns descending produces error

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31517: Assignee: (was: Apache Spark) > SparkR::orderBy with multiple columns descending

[jira] [Commented] (SPARK-31593) Remove unnecessary streaming query progress update

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096745#comment-17096745 ] Apache Spark commented on SPARK-31593: -- User 'uncleGen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31571) don't use stop(paste to build R errors

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31571: Assignee: Apache Spark > don't use stop(paste to build R errors >

[jira] [Commented] (SPARK-31609) Add VarianceThresholdSelector to PySpark

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096744#comment-17096744 ] Apache Spark commented on SPARK-31609: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31603) AFT uses common functions in RDDLossFunction

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31603: Assignee: Apache Spark > AFT uses common functions in RDDLossFunction >

[jira] [Commented] (SPARK-31603) AFT uses common functions in RDDLossFunction

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096751#comment-17096751 ] Apache Spark commented on SPARK-31603: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-31571) don't use stop(paste to build R errors

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096748#comment-17096748 ] Apache Spark commented on SPARK-31571: -- User 'MichaelChirico' has created a pull request for this

[jira] [Assigned] (SPARK-31571) don't use stop(paste to build R errors

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31571: Assignee: (was: Apache Spark) > don't use stop(paste to build R errors >

[jira] [Assigned] (SPARK-31603) AFT uses common functions in RDDLossFunction

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31603: Assignee: (was: Apache Spark) > AFT uses common functions in RDDLossFunction >

[jira] [Assigned] (SPARK-31609) Add VarianceThresholdSelector to PySpark

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31609: Assignee: (was: Apache Spark) > Add VarianceThresholdSelector to PySpark >

[jira] [Assigned] (SPARK-31609) Add VarianceThresholdSelector to PySpark

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31609: Assignee: Apache Spark > Add VarianceThresholdSelector to PySpark >

[jira] [Commented] (SPARK-31570) gapply and dapply docs should be more aligned, possibly combined

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096750#comment-17096750 ] Apache Spark commented on SPARK-31570: -- User 'MichaelChirico' has created a pull request for this

[jira] [Commented] (SPARK-27188) FileStreamSink: provide a new option to have retention on output files

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096746#comment-17096746 ] Apache Spark commented on SPARK-27188: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-31593) Remove unnecessary streaming query progress update

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31593: Assignee: Apache Spark > Remove unnecessary streaming query progress update >

[jira] [Assigned] (SPARK-31566) Add SQL Rest API Documentation

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31566: Assignee: (was: Apache Spark) > Add SQL Rest API Documentation >

[jira] [Commented] (SPARK-31590) The filter used by Metadata-only queries should not have Unevaluable

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096752#comment-17096752 ] Apache Spark commented on SPARK-31590: -- User 'cxzl25' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31570) gapply and dapply docs should be more aligned, possibly combined

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31570: Assignee: Apache Spark > gapply and dapply docs should be more aligned, possibly

[jira] [Assigned] (SPARK-31566) Add SQL Rest API Documentation

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31566: Assignee: Apache Spark > Add SQL Rest API Documentation > --

[jira] [Commented] (SPARK-31566) Add SQL Rest API Documentation

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096747#comment-17096747 ] Apache Spark commented on SPARK-31566: -- User 'erenavsarogullari' has created a pull request for

[jira] [Commented] (SPARK-26199) Long expressions cause mutate to fail

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096749#comment-17096749 ] Apache Spark commented on SPARK-26199: -- User 'MichaelChirico' has created a pull request for this

[jira] [Assigned] (SPARK-31570) gapply and dapply docs should be more aligned, possibly combined

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31570: Assignee: (was: Apache Spark) > gapply and dapply docs should be more aligned,

[jira] [Assigned] (SPARK-31590) The filter used by Metadata-only queries should not have Unevaluable

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31590: Assignee: Apache Spark > The filter used by Metadata-only queries should not have

[jira] [Assigned] (SPARK-31593) Remove unnecessary streaming query progress update

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31593: Assignee: (was: Apache Spark) > Remove unnecessary streaming query progress update >

[jira] [Assigned] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31592: Assignee: Apache Spark > bufferPoolsBySize in HeapMemoryAllocator should be thread safe

[jira] [Assigned] (SPARK-31575) Synchronise global JVM security configuration modification

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31575: Assignee: (was: Apache Spark) > Synchronise global JVM security configuration

[jira] [Assigned] (SPARK-31365) Enable nested predicate pushdown per data sources

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31365: Assignee: (was: Apache Spark) > Enable nested predicate pushdown per data sources >

[jira] [Commented] (SPARK-31575) Synchronise global JVM security configuration modification

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096742#comment-17096742 ] Apache Spark commented on SPARK-31575: -- User 'gaborgsomogyi' has created a pull request for this

[jira] [Commented] (SPARK-31365) Enable nested predicate pushdown per data sources

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096740#comment-17096740 ] Apache Spark commented on SPARK-31365: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096743#comment-17096743 ] Apache Spark commented on SPARK-31592: -- User 'fanyunbojerry' has created a pull request for this

[jira] [Assigned] (SPARK-31592) bufferPoolsBySize in HeapMemoryAllocator should be thread safe

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31592: Assignee: (was: Apache Spark) > bufferPoolsBySize in HeapMemoryAllocator should be

[jira] [Assigned] (SPARK-31365) Enable nested predicate pushdown per data sources

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31365: Assignee: Apache Spark > Enable nested predicate pushdown per data sources >

[jira] [Assigned] (SPARK-31575) Synchronise global JVM security configuration modification

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31575: Assignee: Apache Spark > Synchronise global JVM security configuration modification >

[jira] [Assigned] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31268: Assignee: Apache Spark > TaskEnd event with zero Executor Metrics when task duration

[jira] [Assigned] (SPARK-31334) Use agg column in Having clause behave different with column type

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31334: Assignee: Apache Spark > Use agg column in Having clause behave different with column

[jira] [Assigned] (SPARK-31154) Expose basic write metrics for InsertIntoDataSourceCommand

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31154: Assignee: Apache Spark > Expose basic write metrics for InsertIntoDataSourceCommand >

[jira] [Assigned] (SPARK-31335) Add try function support

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31335: Assignee: (was: Apache Spark) > Add try function support >

[jira] [Assigned] (SPARK-31154) Expose basic write metrics for InsertIntoDataSourceCommand

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31154: Assignee: (was: Apache Spark) > Expose basic write metrics for

[jira] [Assigned] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31268: Assignee: (was: Apache Spark) > TaskEnd event with zero Executor Metrics when task

[jira] [Assigned] (SPARK-31363) Improve DataSourceRegister interface

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31363: Assignee: (was: Apache Spark) > Improve DataSourceRegister interface >

[jira] [Assigned] (SPARK-31226) SizeBasedCoalesce logic error

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31226: Assignee: (was: Apache Spark) > SizeBasedCoalesce logic error >

[jira] [Assigned] (SPARK-31106) Support is_json function

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31106: Assignee: Apache Spark > Support is_json function > > >

[jira] [Assigned] (SPARK-31220) repartition obeys spark.sql.adaptive.coalescePartitions.initialPartitionNum when spark.sql.adaptive.enabled

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31220: Assignee: (was: Apache Spark) > repartition obeys

[jira] [Assigned] (SPARK-31106) Support is_json function

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31106: Assignee: (was: Apache Spark) > Support is_json function >

[jira] [Assigned] (SPARK-31214) Upgrade Janino to 3.1.2

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31214: Assignee: Apache Spark > Upgrade Janino to 3.1.2 > --- > >

[jira] [Assigned] (SPARK-31107) Extend FairScheduler to support pool level resource isolation

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31107: Assignee: Apache Spark > Extend FairScheduler to support pool level resource isolation >

[jira] [Assigned] (SPARK-31346) Add new configuration to make sure temporary directory cleaned

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31346: Assignee: Apache Spark > Add new configuration to make sure temporary directory cleaned

[jira] [Assigned] (SPARK-31206) AQE will use the same SubqueryExec even if subqueryReuseEnabled=false

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31206: Assignee: (was: Apache Spark) > AQE will use the same SubqueryExec even if

[jira] [Assigned] (SPARK-31357) SPIP: Catalog API for view metadata

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31357: Assignee: (was: Apache Spark) > SPIP: Catalog API for view metadata >

[jira] [Assigned] (SPARK-31264) Repartition by dynamic partition columns before insert table

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31264: Assignee: (was: Apache Spark) > Repartition by dynamic partition columns before

[jira] [Assigned] (SPARK-31366) Document aggregation in the sql reference doc

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31366: Assignee: Apache Spark > Document aggregation in the sql reference doc >

[jira] [Assigned] (SPARK-30707) Lead/Lag window function throws AnalysisException without ORDER BY clause

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30707: Assignee: (was: Apache Spark) > Lead/Lag window function throws AnalysisException

[jira] [Assigned] (SPARK-31346) Add new configuration to make sure temporary directory cleaned

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31346: Assignee: (was: Apache Spark) > Add new configuration to make sure temporary

[jira] [Assigned] (SPARK-31180) Implement PowerTransform

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31180: Assignee: (was: Apache Spark) > Implement PowerTransform >

[jira] [Assigned] (SPARK-31264) Repartition by dynamic partition columns before insert table

2020-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31264: Assignee: Apache Spark > Repartition by dynamic partition columns before insert table >

  1   2   3   4   >