[jira] [Resolved] (SPARK-25453) OracleIntegrationSuite IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]

2018-09-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25453. - Resolution: Fixed Fix Version/s: 2.4.0 > OracleIntegrationSuite IllegalArgumentException:

[jira] [Assigned] (SPARK-25453) OracleIntegrationSuite IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]

2018-09-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25453: --- Assignee: Chenxiao Mao > OracleIntegrationSuite IllegalArgumentException: Timestamp format must be

[jira] [Assigned] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

2018-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25579: Assignee: Apache Spark (was: Dongjoon Hyun) > Use quoted attribute names if needed in

[jira] [Commented] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

2018-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633612#comment-16633612 ] Apache Spark commented on SPARK-25579: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

2018-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25579: Assignee: Dongjoon Hyun (was: Apache Spark) > Use quoted attribute names if needed in

[jira] [Commented] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

2018-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633613#comment-16633613 ] Apache Spark commented on SPARK-25579: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

2018-09-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25579: -- Description: This issue aims to fix an ORC performance regression at Spark 2.4.0 RCs from

[jira] [Updated] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

2018-09-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25579: -- Description: This issue aims to fix an ORC performance regression at Spark 2.4.0 RCs from

[jira] [Updated] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

2018-09-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25579: -- Description: This issue aims to fix an ORC performance regression at Spark 2.4.0 RCs from

[jira] [Updated] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

2018-09-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25579: -- Priority: Critical (was: Major) > Use quoted attribute names if needed in pushed ORC

[jira] [Created] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

2018-09-30 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-25579: - Summary: Use quoted attribute names if needed in pushed ORC predicates Key: SPARK-25579 URL: https://issues.apache.org/jira/browse/SPARK-25579 Project: Spark

[jira] [Assigned] (SPARK-25579) Use quoted attribute names if needed in pushed ORC predicates

2018-09-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25579: - Assignee: Dongjoon Hyun > Use quoted attribute names if needed in pushed ORC

[jira] [Commented] (SPARK-25563) Spark application hangs If container allocate on lost Nodemanager

2018-09-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633575#comment-16633575 ] Hyukjin Kwon commented on SPARK-25563: -- Please avoid to set the target version which is usually

[jira] [Updated] (SPARK-25563) Spark application hangs If container allocate on lost Nodemanager

2018-09-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25563: - Target Version/s: (was: 2.3.1) > Spark application hangs If container allocate on lost

[jira] [Commented] (SPARK-25538) incorrect row counts after distinct()

2018-09-30 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633568#comment-16633568 ] Kazuaki Ishizaki commented on SPARK-25538: -- Thank you. I will check it tonight in Japan. >

[jira] [Resolved] (SPARK-25554) Avro logical types get ignored in SchemaConverters.toSqlType

2018-09-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25554. -- Resolution: Invalid > Avro logical types get ignored in SchemaConverters.toSqlType >

[jira] [Updated] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode.

2018-09-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25543: -- Affects Version/s: (was: 2.5.0) 2.4.0 > Confusing log messages at

[jira] [Assigned] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode.

2018-09-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25543: - Assignee: Prashant Sharma > Confusing log messages at DEBUG level, in K8s mode. >

[jira] [Resolved] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode.

2018-09-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25543. --- Resolution: Fixed Fix Version/s: 2.4.1 2.5.0 Issue resolved by

[jira] [Created] (SPARK-25578) Update to Scala 2.12.7

2018-09-30 Thread Sean Owen (JIRA)
Sean Owen created SPARK-25578: - Summary: Update to Scala 2.12.7 Key: SPARK-25578 URL: https://issues.apache.org/jira/browse/SPARK-25578 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-23429) Add executor memory metrics to heartbeat and expose in executors REST API

2018-09-30 Thread Edwina Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edwina Lu updated SPARK-23429: -- Fix Version/s: 3.0.0 > Add executor memory metrics to heartbeat and expose in executors REST API >

[jira] [Commented] (SPARK-25577) Add an on-off switch to display the executor additional columns

2018-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1669#comment-1669 ] Apache Spark commented on SPARK-25577: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25577) Add an on-off switch to display the executor additional columns

2018-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25577: Assignee: (was: Apache Spark) > Add an on-off switch to display the executor

[jira] [Assigned] (SPARK-25577) Add an on-off switch to display the executor additional columns

2018-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25577: Assignee: Apache Spark > Add an on-off switch to display the executor additional columns

[jira] [Updated] (SPARK-25577) Add an on-off switch to display the executor additional columns

2018-09-30 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-25577: --- Attachment: Screen Shot 2018-09-30 at 5.45.56 PM.png > Add an on-off switch to display the executor

[jira] [Updated] (SPARK-25577) Add an on-off switch to display the executor additional columns

2018-09-30 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-25577: --- Attachment: Screen Shot 2018-09-30 at 5.46.06 PM.png > Add an on-off switch to display the executor

[jira] [Created] (SPARK-25577) Add an on-off switch to display the executor additional columns

2018-09-30 Thread Lantao Jin (JIRA)
Lantao Jin created SPARK-25577: -- Summary: Add an on-off switch to display the executor additional columns Key: SPARK-25577 URL: https://issues.apache.org/jira/browse/SPARK-25577 Project: Spark

[jira] [Resolved] (SPARK-25523) Multi thread execute sparkSession.read().jdbc(url, table, properties) problem

2018-09-30 Thread huanghuai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huanghuai resolved SPARK-25523. --- Resolution: Cannot Reproduce Fix Version/s: 2.3.0 The program can not exactly reproduce

[jira] [Commented] (SPARK-21569) Internal Spark class needs to be kryo-registered

2018-09-30 Thread Shaofeng SHI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633265#comment-16633265 ] Shaofeng SHI commented on SPARK-21569: -- Can I ask to prioritize this issue? It has blocked our plan

[jira] [Resolved] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls

2018-09-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25565. -- Resolution: Fixed Fix Version/s: 2.5.0 Issue resolved by pull request 22581

[jira] [Assigned] (SPARK-25565) Add scala style checker to check add Locale.ROOT to .toLowerCase and .toUpperCase for internal calls

2018-09-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25565: Assignee: Hyukjin Kwon > Add scala style checker to check add Locale.ROOT to