[jira] [Resolved] (SPARK-25523) Multi thread execute sparkSession.read().jdbc(url, table, properties) problem

[ https://issues.apache.org/jira/browse/SPARK-25523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huanghuai resolved SPARK-25523. --- Resolution: Cannot Reproduce Fix Version/s: 2.3.0 The program can not exactly reproduce every

[jira] [Created] (SPARK-25577) Add an on-off switch to display the executor additional columns

Lantao Jin created SPARK-25577: -- Summary: Add an on-off switch to display the executor additional columns Key: SPARK-25577 URL: https://issues.apache.org/jira/browse/SPARK-25577 Project: Spark

[jira] [Updated] (SPARK-25577) Add an on-off switch to display the executor additional columns

[ https://issues.apache.org/jira/browse/SPARK-25577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-25577: --- Attachment: Screen Shot 2018-09-30 at 5.46.06 PM.png > Add an on-off switch to display the executor

[jira] [Updated] (SPARK-25577) Add an on-off switch to display the executor additional columns

[ https://issues.apache.org/jira/browse/SPARK-25577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-25577: --- Attachment: Screen Shot 2018-09-30 at 5.45.56 PM.png > Add an on-off switch to display the executor

[jira] [Assigned] (SPARK-25577) Add an on-off switch to display the executor additional columns

[ https://issues.apache.org/jira/browse/SPARK-25577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25577: Assignee: Apache Spark > Add an on-off switch to display the executor additional columns

[jira] [Assigned] (SPARK-25577) Add an on-off switch to display the executor additional columns

[ https://issues.apache.org/jira/browse/SPARK-25577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25577: Assignee: (was: Apache Spark) > Add an on-off switch to display the executor addition

[jira] [Commented] (SPARK-25577) Add an on-off switch to display the executor additional columns

[ https://issues.apache.org/jira/browse/SPARK-25577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1669#comment-1669 ] Apache Spark commented on SPARK-25577: -- User 'LantaoJin' has created a pull request

[jira] [Updated] (SPARK-23429) Add executor memory metrics to heartbeat and expose in executors REST API

[ https://issues.apache.org/jira/browse/SPARK-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edwina Lu updated SPARK-23429: -- Fix Version/s: 3.0.0 > Add executor memory metrics to heartbeat and expose in executors REST API > ---

[jira] [Created] (SPARK-25578) Update to Scala 2.12.7

Sean Owen created SPARK-25578: - Summary: Update to Scala 2.12.7 Key: SPARK-25578 URL: https://issues.apache.org/jira/browse/SPARK-25578 Project: Spark Issue Type: Improvement Components

[jira] [Assigned] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode.

[ https://issues.apache.org/jira/browse/SPARK-25543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25543: - Assignee: Prashant Sharma > Confusing log messages at DEBUG level, in K8s mode. > -

[jira] [Resolved] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode.

[ https://issues.apache.org/jira/browse/SPARK-25543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25543. --- Resolution: Fixed Fix Version/s: 2.4.1 2.5.0 Issue resolved by pul

[jira] [Updated] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode.

[ https://issues.apache.org/jira/browse/SPARK-25543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25543: -- Affects Version/s: (was: 2.5.0) 2.4.0 > Confusing log messages at D

[jira] [Resolved] (SPARK-25554) Avro logical types get ignored in SchemaConverters.toSqlType

[ https://issues.apache.org/jira/browse/SPARK-25554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25554. -- Resolution: Invalid > Avro logical types get ignored in SchemaConverters.toSqlType > -

[jira] [Commented] (SPARK-25538) incorrect row counts after distinct()

[ https://issues.apache.org/jira/browse/SPARK-25538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16633568#comment-16633568 ] Kazuaki Ishizaki commented on SPARK-25538: -- Thank you. I will check it tonight

[jira] [Updated] (SPARK-25563) Spark application hangs If container allocate on lost Nodemanager

[ https://issues.apache.org/jira/browse/SPARK-25563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25563: - Target Version/s: (was: 2.3.1) > Spark application hangs If container allocate on lost Nodeman

[jira] [Commented] (SPARK-25563) Spark application hangs If container allocate on lost Nodemanager

[ https://issues.apache.org/jira/browse/SPARK-25563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16633575#comment-16633575 ] Hyukjin Kwon commented on SPARK-25563: -- Please avoid to set the target version whic

[jira] [Assigned] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25579: - Assignee: Dongjoon Hyun > Use quoted attribute names if needed in pushed ORC predicates

[jira] [Created] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

Dongjoon Hyun created SPARK-25579: - Summary: Use quoted attribute names if needed in pushed ORC predicates Key: SPARK-25579 URL: https://issues.apache.org/jira/browse/SPARK-25579 Project: Spark

[jira] [Updated] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25579: -- Priority: Critical (was: Major) > Use quoted attribute names if needed in pushed ORC predicat

[jira] [Updated] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25579: -- Description: This issue aims to fix an ORC performance regression at Spark 2.4.0 RCs from Spa

[jira] [Updated] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25579: -- Description: This issue aims to fix an ORC performance regression at Spark 2.4.0 RCs from Spa

[jira] [Updated] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25579: -- Description: This issue aims to fix an ORC performance regression at Spark 2.4.0 RCs from Spa

[jira] [Assigned] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25579: Assignee: Dongjoon Hyun (was: Apache Spark) > Use quoted attribute names if needed in pu

[jira] [Commented] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16633613#comment-16633613 ] Apache Spark commented on SPARK-25579: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25579: Assignee: Apache Spark (was: Dongjoon Hyun) > Use quoted attribute names if needed in pu

[jira] [Commented] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16633612#comment-16633612 ] Apache Spark commented on SPARK-25579: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-25453) OracleIntegrationSuite IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]

[ https://issues.apache.org/jira/browse/SPARK-25453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25453: --- Assignee: Chenxiao Mao > OracleIntegrationSuite IllegalArgumentException: Timestamp format must be

[jira] [Resolved] (SPARK-25453) OracleIntegrationSuite IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]

[ https://issues.apache.org/jira/browse/SPARK-25453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25453. - Resolution: Fixed Fix Version/s: 2.4.0 > OracleIntegrationSuite IllegalArgumentException: Timesta

[jira] [Updated] (SPARK-23210) Introduce the concept of default value to schema

[ https://issues.apache.org/jira/browse/SPARK-23210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23210: Target Version/s: 3.0.0 > Introduce the concept of default value to schema > -