[jira] [Resolved] (SPARK-27782) Use '#' to mark expression id embedded in the subquery name in the SubqueryExec operator.

[ https://issues.apache.org/jira/browse/SPARK-27782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27782. --- Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 3.0.0 This is

[jira] [Assigned] (SPARK-27847) One-Pass MultilabelMetrics & MulticlassMetrics

[ https://issues.apache.org/jira/browse/SPARK-27847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27847: Assignee: (was: Apache Spark) > One-Pass MultilabelMetrics & MulticlassMetrics >

[jira] [Assigned] (SPARK-27847) One-Pass MultilabelMetrics & MulticlassMetrics

[ https://issues.apache.org/jira/browse/SPARK-27847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27847: Assignee: Apache Spark > One-Pass MultilabelMetrics & MulticlassMetrics >

[jira] [Resolved] (SPARK-24766) CreateHiveTableAsSelect and InsertIntoHiveDir won't generate decimal column stats in parquet

[ https://issues.apache.org/jira/browse/SPARK-24766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-24766. - Resolution: Fixed Fix Version/s: 3.0.0 Fixed by

[jira] [Created] (SPARK-27848) AppVeyor change to latest R version (3.6.0)

Hyukjin Kwon created SPARK-27848: Summary: AppVeyor change to latest R version (3.6.0) Key: SPARK-27848 URL: https://issues.apache.org/jira/browse/SPARK-27848 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-27848) AppVeyor change to latest R version (3.6.0)

[ https://issues.apache.org/jira/browse/SPARK-27848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-27848: - Description: R 3.6.0 is released last month. We better test higher versions of R in AppVeyor.

[jira] [Created] (SPARK-27847) One-Pass MultilabelMetrics & MulticlassMetrics

zhengruifeng created SPARK-27847: Summary: One-Pass MultilabelMetrics & MulticlassMetrics Key: SPARK-27847 URL: https://issues.apache.org/jira/browse/SPARK-27847 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-27648) In Spark2.4 Structured Streaming：The executor storage memory increasing over time

[ https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847182#comment-16847182 ] tommy duan edited comment on SPARK-27648 at 5/27/19 2:10 AM: - [~gsomogyi]

[jira] [Created] (SPARK-27846) Eagerly compute Configuration.properties in sc.hadoopConfiguration

Josh Rosen created SPARK-27846: -- Summary: Eagerly compute Configuration.properties in sc.hadoopConfiguration Key: SPARK-27846 URL: https://issues.apache.org/jira/browse/SPARK-27846 Project: Spark

[jira] [Commented] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848522#comment-16848522 ] Apache Spark commented on SPARK-26192: -- User 'mwlon' has created a pull request for this issue:

[jira] [Commented] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848516#comment-16848516 ] Martin Loncaric commented on SPARK-26192: - [~dongjoon] I made a PR:

[jira] [Commented] (SPARK-27768) Infinity, -Infinity, NaN should be recognized in a case insensitive manner

[ https://issues.apache.org/jira/browse/SPARK-27768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848510#comment-16848510 ] Dongjoon Hyun commented on SPARK-27768: --- In addition to [~dkbiswal]'s investigation, I want to add

[jira] [Created] (SPARK-27845) DataSourceV2: InsertInto multiple catalogs

John Zhuge created SPARK-27845: -- Summary: DataSourceV2: InsertInto multiple catalogs Key: SPARK-27845 URL: https://issues.apache.org/jira/browse/SPARK-27845 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-27844) Avoid hard-coded config: spark.rdd.parallelListingThreshold in SQL module

[ https://issues.apache.org/jira/browse/SPARK-27844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27844. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 This is

[jira] [Commented] (SPARK-27844) Avoid hard-coded config: spark.rdd.parallelListingThreshold in SQL module

[ https://issues.apache.org/jira/browse/SPARK-27844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848472#comment-16848472 ] Apache Spark commented on SPARK-27844: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-27844) Avoid hard-coded config: spark.rdd.parallelListingThreshold in SQL module

[ https://issues.apache.org/jira/browse/SPARK-27844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848473#comment-16848473 ] Apache Spark commented on SPARK-27844: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-27844) Avoid hard-coded config: spark.rdd.parallelListingThreshold in SQL module

[ https://issues.apache.org/jira/browse/SPARK-27844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27844: Assignee: Apache Spark > Avoid hard-coded config: spark.rdd.parallelListingThreshold in

[jira] [Assigned] (SPARK-27844) Avoid hard-coded config: spark.rdd.parallelListingThreshold in SQL module

[ https://issues.apache.org/jira/browse/SPARK-27844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27844: Assignee: (was: Apache Spark) > Avoid hard-coded config:

[jira] [Created] (SPARK-27844) Avoid hard-coded config: spark.rdd.parallelListingThreshold in SQL module

Dongjoon Hyun created SPARK-27844: - Summary: Avoid hard-coded config: spark.rdd.parallelListingThreshold in SQL module Key: SPARK-27844 URL: https://issues.apache.org/jira/browse/SPARK-27844 Project:

[jira] [Resolved] (SPARK-27074) Hive 3.1 metastore support HiveClientImpl.runHive

[ https://issues.apache.org/jira/browse/SPARK-27074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27074. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 This is

[jira] [Updated] (SPARK-27843) Remove duplicate logic of calculate table size

[ https://issues.apache.org/jira/browse/SPARK-27843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27843: Description: {code:scala} class DetermineTableStats(session: SparkSession) extends

[jira] [Assigned] (SPARK-27843) Remove duplicate logic of calculate table size

[ https://issues.apache.org/jira/browse/SPARK-27843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27843: Assignee: (was: Apache Spark) > Remove duplicate logic of calculate table size >

[jira] [Assigned] (SPARK-27843) Remove duplicate logic of calculate table size

[ https://issues.apache.org/jira/browse/SPARK-27843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27843: Assignee: Apache Spark > Remove duplicate logic of calculate table size >

[jira] [Created] (SPARK-27843) Remove duplicate logic of calculate table size

Yuming Wang created SPARK-27843: --- Summary: Remove duplicate logic of calculate table size Key: SPARK-27843 URL: https://issues.apache.org/jira/browse/SPARK-27843 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-27614) Executor shuffle fetch hang

[ https://issues.apache.org/jira/browse/SPARK-27614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-27614: Comment: was deleted (was: You can propose a PR to spark. It seems meaningful.) > Executor shuffle fetch

[jira] [Updated] (SPARK-27787) Eliminate uncessary job to compute SSreg

[ https://issues.apache.org/jira/browse/SPARK-27787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27787: -- Fix Version/s: (was: 3.1.0) 3.0.0 > Eliminate uncessary job to compute SSreg >

[jira] [Resolved] (SPARK-27787) Eliminate uncessary job to compute SSreg

[ https://issues.apache.org/jira/browse/SPARK-27787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27787. --- Resolution: Fixed Fix Version/s: 3.1.0 Issue resolved by pull request 24656

[jira] [Assigned] (SPARK-27787) Eliminate uncessary job to compute SSreg

[ https://issues.apache.org/jira/browse/SPARK-27787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27787: - Assignee: zhengruifeng > Eliminate uncessary job to compute SSreg >

[jira] [Resolved] (SPARK-27114) SQL Tab shows duplicate executions for some commands

[ https://issues.apache.org/jira/browse/SPARK-27114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-27114. - Resolution: Duplicate > SQL Tab shows duplicate executions for some commands >

[jira] [Commented] (SPARK-27614) Executor shuffle fetch hang

[ https://issues.apache.org/jira/browse/SPARK-27614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16848388#comment-16848388 ] feiwang commented on SPARK-27614: - You can propose a PR to spark. It seems meaningful. > Executor

[jira] [Updated] (SPARK-27322) DataSourceV2: Select from multiple catalogs

[ https://issues.apache.org/jira/browse/SPARK-27322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated SPARK-27322: --- Summary: DataSourceV2: Select from multiple catalogs (was: DataSourceV2: Logical relation in