[jira] [Updated] (SPARK-32623) Set the downloaded artifact location to explicitly glob test reports

2020-08-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32623: - Summary: Set the downloaded artifact location to explicitly glob test reports (was: Set the

[jira] [Created] (SPARK-32623) Set the downloaded artifact location to explicitly glob test reportss

2020-08-14 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32623: Summary: Set the downloaded artifact location to explicitly glob test reportss Key: SPARK-32623 URL: https://issues.apache.org/jira/browse/SPARK-32623 Project: Spark

[jira] [Commented] (SPARK-32606) Remove the fork of action-download-artifact in test_report.yml

2020-08-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178162#comment-17178162 ] Hyukjin Kwon commented on SPARK-32606: -- Here I raised the PR

[jira] [Commented] (SPARK-32605) Remove the fork of action-surefire-report in test_report.yml

2020-08-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178160#comment-17178160 ] Hyukjin Kwon commented on SPARK-32605: -- Here I raised the PR

[jira] [Commented] (SPARK-32622) Add case-sensitivity test for ORC predicate pushdown

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178157#comment-17178157 ] Apache Spark commented on SPARK-32622: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32622) Add case-sensitivity test for ORC predicate pushdown

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32622: Assignee: L. C. Hsieh (was: Apache Spark) > Add case-sensitivity test for ORC predicate

[jira] [Assigned] (SPARK-32622) Add case-sensitivity test for ORC predicate pushdown

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32622: Assignee: Apache Spark (was: L. C. Hsieh) > Add case-sensitivity test for ORC predicate

[jira] [Created] (SPARK-32622) Add case-sensitivity test for ORC predicate pushdown

2020-08-14 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-32622: --- Summary: Add case-sensitivity test for ORC predicate pushdown Key: SPARK-32622 URL: https://issues.apache.org/jira/browse/SPARK-32622 Project: Spark Issue

[jira] [Updated] (SPARK-32542) add a batch for optimizing logicalPlan

2020-08-14 Thread karl wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] karl wang updated SPARK-32542: -- Description: Split an expand into several small Expand, which contains the Specified number of

[jira] [Updated] (SPARK-32542) Add an optimizer rule to split an Expand into multiple Expands for aggregates

2020-08-14 Thread karl wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] karl wang updated SPARK-32542: -- Summary: Add an optimizer rule to split an Expand into multiple Expands for aggregates (was: add a

[jira] [Updated] (SPARK-32542) add a batch for optimizing logicalPlan

2020-08-14 Thread karl wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] karl wang updated SPARK-32542: -- Description: Split an expand into several small Expand, which contains the Specified number of

[jira] [Updated] (SPARK-32542) add a batch for optimizing logicalPlan

2020-08-14 Thread karl wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] karl wang updated SPARK-32542: -- Priority: Major (was: Minor) > add a batch for optimizing logicalPlan >

[jira] [Commented] (SPARK-32613) DecommissionWorkerSuite has started failing sporadically again

2020-08-14 Thread Rohit Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178148#comment-17178148 ] Rohit Mishra commented on SPARK-32613: -- [~dagrawal3409], Please avoid populating Fix version/s as

[jira] [Updated] (SPARK-32613) DecommissionWorkerSuite has started failing sporadically again

2020-08-14 Thread Rohit Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Mishra updated SPARK-32613: - Fix Version/s: (was: 3.1.0) > DecommissionWorkerSuite has started failing sporadically

[jira] [Commented] (SPARK-32619) converting dataframe to dataset for the json schema

2020-08-14 Thread Rohit Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178147#comment-17178147 ] Rohit Mishra commented on SPARK-32619: -- [~Manjay7869], Can you please update- Environment detail &

[jira] [Assigned] (SPARK-32621) "path" option is added again to input paths during infer()

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32621: Assignee: Apache Spark > "path" option is added again to input paths during infer() >

[jira] [Commented] (SPARK-32621) "path" option is added again to input paths during infer()

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178125#comment-17178125 ] Apache Spark commented on SPARK-32621: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32621) "path" option is added again to input paths during infer()

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32621: Assignee: (was: Apache Spark) > "path" option is added again to input paths during

[jira] [Updated] (SPARK-32621) "path" option is added again to input paths during infer()

2020-08-14 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-32621: -- Priority: Minor (was: Major) > "path" option is added again to input paths during infer() >

[jira] [Updated] (SPARK-32620) Reset the numPartitions metric when DPP is enabled

2020-08-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32620: Summary: Reset the numPartitions metric when DPP is enabled (was: Fix number of partitions read

[jira] [Created] (SPARK-32621) "path" option is added again to input paths during infer()

2020-08-14 Thread Terry Kim (Jira)
Terry Kim created SPARK-32621: - Summary: "path" option is added again to input paths during infer() Key: SPARK-32621 URL: https://issues.apache.org/jira/browse/SPARK-32621 Project: Spark Issue

[jira] [Assigned] (SPARK-32620) Fix number of partitions read metric when DPP enabled

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32620: Assignee: (was: Apache Spark) > Fix number of partitions read metric when DPP

[jira] [Assigned] (SPARK-32620) Fix number of partitions read metric when DPP enabled

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32620: Assignee: Apache Spark > Fix number of partitions read metric when DPP enabled >

[jira] [Commented] (SPARK-32620) Fix number of partitions read metric when DPP enabled

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178118#comment-17178118 ] Apache Spark commented on SPARK-32620: -- User 'wangyum' has created a pull request for this issue:

[jira] [Updated] (SPARK-32620) Fix number of partitions read metric when DPP enabled

2020-08-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32620: Summary: Fix number of partitions read metric when DPP enabled (was: Fix number of partitions

[jira] [Created] (SPARK-32620) Fix number of partitions read when DPP enabled

2020-08-14 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-32620: --- Summary: Fix number of partitions read when DPP enabled Key: SPARK-32620 URL: https://issues.apache.org/jira/browse/SPARK-32620 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32092) CrossvalidatorModel does not save all submodels (it saves only 3)

2020-08-14 Thread Zirui Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178101#comment-17178101 ] Zirui Xu commented on SPARK-32092: -- I think CrossValidatorModel.copy() is affected by a similar issue

[jira] [Resolved] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

2020-08-14 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-32119. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request

[jira] [Comment Edited] (SPARK-25390) Data source V2 API refactoring

2020-08-14 Thread Rafael (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178052#comment-17178052 ] Rafael edited comment on SPARK-25390 at 8/14/20, 8:45 PM: -- Hey guys

[jira] [Comment Edited] (SPARK-25390) Data source V2 API refactoring

2020-08-14 Thread Rafael (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178052#comment-17178052 ] Rafael edited comment on SPARK-25390 at 8/14/20, 8:44 PM: -- Hey guys

[jira] [Commented] (SPARK-25390) Data source V2 API refactoring

2020-08-14 Thread Rafael (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178052#comment-17178052 ] Rafael commented on SPARK-25390: Hey guys,  I'm trying to migrate the package where I was using *import

[jira] [Comment Edited] (SPARK-25390) Data source V2 API refactoring

2020-08-14 Thread Rafael (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178052#comment-17178052 ] Rafael edited comment on SPARK-25390 at 8/14/20, 8:42 PM: -- Hey guys,  I'm

[jira] [Commented] (SPARK-26132) Remove support for Scala 2.11 in Spark 3.0.0

2020-08-14 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178042#comment-17178042 ] Sean R. Owen commented on SPARK-26132: -- Yes exactly. Unfortunately you have to do that. What that

[jira] [Commented] (SPARK-26132) Remove support for Scala 2.11 in Spark 3.0.0

2020-08-14 Thread Rafael (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178035#comment-17178035 ] Rafael commented on SPARK-26132: Thank you [~srowen] yes it works. {code:java} val f: Iterator[Row] =>

[jira] [Commented] (SPARK-32609) Incorrect exchange reuse with DataSourceV2

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178032#comment-17178032 ] Apache Spark commented on SPARK-32609: -- User 'mingjialiu' has created a pull request for this

[jira] [Commented] (SPARK-32609) Incorrect exchange reuse with DataSourceV2

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178031#comment-17178031 ] Apache Spark commented on SPARK-32609: -- User 'mingjialiu' has created a pull request for this

[jira] [Commented] (SPARK-26132) Remove support for Scala 2.11 in Spark 3.0.0

2020-08-14 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178024#comment-17178024 ] Sean R. Owen commented on SPARK-26132: -- I think you need to cast your whole lambda function

[jira] [Commented] (SPARK-26132) Remove support for Scala 2.11 in Spark 3.0.0

2020-08-14 Thread Rafael (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17178019#comment-17178019 ] Rafael commented on SPARK-26132: [~srowen] In release notes for Spark 3.0.0 they mentioned your ticket

[jira] [Updated] (SPARK-32618) ORC writer doesn't support colon in column names

2020-08-14 Thread Pierre Gramme (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Gramme updated SPARK-32618: -- Description: Hi, I'm getting an {{IllegalArgumentException: Can't parse category at

[jira] [Updated] (SPARK-32618) ORC writer doesn't support colon in column names

2020-08-14 Thread Pierre Gramme (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Gramme updated SPARK-32618: -- Description: Hi, I'm getting an {{IllegalArgumentException: Can't parse category at

[jira] [Updated] (SPARK-32618) ORC writer doesn't support colon in column names

2020-08-14 Thread Pierre Gramme (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pierre Gramme updated SPARK-32618: -- Description: Hi, I'm getting an {{IllegalArgumentException: Can't parse category at

[jira] [Created] (SPARK-32619) converting dataframe to dataset for the json schema

2020-08-14 Thread Manjay Kumar (Jira)
Manjay Kumar created SPARK-32619: Summary: converting dataframe to dataset for the json schema Key: SPARK-32619 URL: https://issues.apache.org/jira/browse/SPARK-32619 Project: Spark Issue

[jira] [Created] (SPARK-32618) ORC writer doesn't support colon in column names

2020-08-14 Thread Pierre Gramme (Jira)
Pierre Gramme created SPARK-32618: - Summary: ORC writer doesn't support colon in column names Key: SPARK-32618 URL: https://issues.apache.org/jira/browse/SPARK-32618 Project: Spark Issue

[jira] [Commented] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177820#comment-17177820 ] Apache Spark commented on SPARK-32526: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-32615) Fix AQE aggregateMetrics java.util.NoSuchElementException

2020-08-14 Thread Leanken.Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin updated SPARK-32615: Description: {code:java} // Reproduce Step sql/test-only

[jira] [Updated] (SPARK-32616) Window operators should be added determinedly

2020-08-14 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32616: - Issue Type: Improvement (was: Bug) > Window operators should be added determinedly >

[jira] [Assigned] (SPARK-32616) Window operators should be added determinedly

2020-08-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32616: --- Assignee: wuyi > Window operators should be added determinedly >

[jira] [Resolved] (SPARK-32616) Window operators should be added determinedly

2020-08-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32616. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29432

[jira] [Comment Edited] (SPARK-32187) User Guide - Shipping Python Package

2020-08-14 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-32187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177765#comment-17177765 ] Fabian Höring edited comment on SPARK-32187 at 8/14/20, 1:24 PM: - About

[jira] [Comment Edited] (SPARK-32187) User Guide - Shipping Python Package

2020-08-14 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-32187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177765#comment-17177765 ] Fabian Höring edited comment on SPARK-32187 at 8/14/20, 1:23 PM: - About

[jira] [Commented] (SPARK-32187) User Guide - Shipping Python Package

2020-08-14 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-32187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177765#comment-17177765 ] Fabian Höring commented on SPARK-32187: --- About this ticket: 

[jira] [Comment Edited] (SPARK-32187) User Guide - Shipping Python Package

2020-08-14 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-32187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177760#comment-17177760 ] Fabian Höring edited comment on SPARK-32187 at 8/14/20, 1:10 PM: -

[jira] [Comment Edited] (SPARK-32187) User Guide - Shipping Python Package

2020-08-14 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-32187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177760#comment-17177760 ] Fabian Höring edited comment on SPARK-32187 at 8/14/20, 1:08 PM: -

[jira] [Commented] (SPARK-32187) User Guide - Shipping Python Package

2020-08-14 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-32187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177760#comment-17177760 ] Fabian Höring commented on SPARK-32187: --- [~hyukjin.kwon] I started working on it. The new doc

[jira] [Commented] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177749#comment-17177749 ] Apache Spark commented on SPARK-32526: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177748#comment-17177748 ] Apache Spark commented on SPARK-32526: -- User 'LuciferYang' has created a pull request for this

[jira] [Comment Edited] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

2020-08-14 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177708#comment-17177708 ] Ramakrishna Prasad K S edited comment on SPARK-32234 at 8/14/20, 11:22 AM:

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

2020-08-14 Thread Ramakrishna Prasad K S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177708#comment-17177708 ] Ramakrishna Prasad K S commented on SPARK-32234: Thanks [~saurabhc100] I am going ahead

[jira] [Created] (SPARK-32617) Upgrade kubernetes client version to support latest minikube version.

2020-08-14 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-32617: --- Summary: Upgrade kubernetes client version to support latest minikube version. Key: SPARK-32617 URL: https://issues.apache.org/jira/browse/SPARK-32617 Project:

[jira] [Commented] (SPARK-32616) Window operators should be added determinedly

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177663#comment-17177663 ] Apache Spark commented on SPARK-32616: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32616) Window operators should be added determinedly

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32616: Assignee: Apache Spark > Window operators should be added determinedly >

[jira] [Assigned] (SPARK-32616) Window operators should be added determinedly

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32616: Assignee: (was: Apache Spark) > Window operators should be added determinedly >

[jira] [Updated] (SPARK-32616) Window operators should be added determinedly

2020-08-14 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-32616: - Issue Type: Bug (was: Improvement) > Window operators should be added determinedly >

[jira] [Created] (SPARK-32616) Window operators should be added determinedly

2020-08-14 Thread wuyi (Jira)
wuyi created SPARK-32616: Summary: Window operators should be added determinedly Key: SPARK-32616 URL: https://issues.apache.org/jira/browse/SPARK-32616 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

2020-08-14 Thread Dustin Smith (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177584#comment-17177584 ] Dustin Smith commented on SPARK-32046: -- [~maropu] yes one would expect the current timestamp to be

[jira] [Assigned] (SPARK-32590) Remove fullOutput from RowDataSourceScanExec

2020-08-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32590: --- Assignee: Huaxin Gao > Remove fullOutput from RowDataSourceScanExec >

[jira] [Resolved] (SPARK-32590) Remove fullOutput from RowDataSourceScanExec

2020-08-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32590. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29415

[jira] [Updated] (SPARK-32615) Fix AQE aggregateMetrics java.util.NoSuchElementException

2020-08-14 Thread Leanken.Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin updated SPARK-32615: Description: {code:java} // Reproduce Step sql/test-only

[jira] [Updated] (SPARK-32615) Fix AQE aggregateMetrics java.util.NoSuchElementException

2020-08-14 Thread Leanken.Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin updated SPARK-32615: Description: {code:java} // Reproduce Step sql/test-only

[jira] [Comment Edited] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

2020-08-14 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177398#comment-17177398 ] Takeshi Yamamuro edited comment on SPARK-32046 at 8/14/20, 7:28 AM:

[jira] [Comment Edited] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

2020-08-14 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177562#comment-17177562 ] Takeshi Yamamuro edited comment on SPARK-32046 at 8/14/20, 7:28 AM:

[jira] [Comment Edited] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

2020-08-14 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177398#comment-17177398 ] Takeshi Yamamuro edited comment on SPARK-32046 at 8/14/20, 7:25 AM:

[jira] [Commented] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

2020-08-14 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177562#comment-17177562 ] Takeshi Yamamuro commented on SPARK-32046: -- >> The question when does a query evaluation start

[jira] [Assigned] (SPARK-32615) Fix AQE aggregateMetrics java.util.NoSuchElementException

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32615: Assignee: (was: Apache Spark) > Fix AQE aggregateMetrics

[jira] [Assigned] (SPARK-32615) Fix AQE aggregateMetrics java.util.NoSuchElementException

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32615: Assignee: Apache Spark > Fix AQE aggregateMetrics java.util.NoSuchElementException >

[jira] [Commented] (SPARK-32615) Fix AQE aggregateMetrics java.util.NoSuchElementException

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177551#comment-17177551 ] Apache Spark commented on SPARK-32615: -- User 'leanken' has created a pull request for this issue:

[jira] [Updated] (SPARK-32615) Fix AQE aggregateMetrics java.util.NoSuchElementException

2020-08-14 Thread Leanken.Lin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leanken.Lin updated SPARK-32615: Summary: Fix AQE aggregateMetrics java.util.NoSuchElementException (was: AQE aggregateMetrics

[jira] [Created] (SPARK-32615) AQE aggregateMetrics java.util.NoSuchElementException

2020-08-14 Thread Leanken.Lin (Jira)
Leanken.Lin created SPARK-32615: --- Summary: AQE aggregateMetrics java.util.NoSuchElementException Key: SPARK-32615 URL: https://issues.apache.org/jira/browse/SPARK-32615 Project: Spark Issue

[jira] [Assigned] (SPARK-32609) Incorrect exchange reuse with DataSourceV2

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32609: Assignee: Apache Spark > Incorrect exchange reuse with DataSourceV2 >

[jira] [Commented] (SPARK-32609) Incorrect exchange reuse with DataSourceV2

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177528#comment-17177528 ] Apache Spark commented on SPARK-32609: -- User 'mingjialiu' has created a pull request for this

[jira] [Assigned] (SPARK-32609) Incorrect exchange reuse with DataSourceV2

2020-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32609: Assignee: (was: Apache Spark) > Incorrect exchange reuse with DataSourceV2 >