[jira] [Updated] (SPARK-29861) Reduce downtime in Spark standalone HA master switch

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29861: -- Affects Version/s: (was: 2.2.1) 3.0.0 > Reduce downtime in Spark st

[jira] [Updated] (SPARK-25392) [Spark Job History]Inconsistent behaviour for pool details in spark web UI and history server page

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25392: -- Affects Version/s: (was: 2.3.1) 3.0.0 > [Spark Job History]Inconsis

[jira] [Updated] (SPARK-25392) [Spark Job History]Inconsistent behaviour for pool details in spark web UI and history server page

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25392: -- Component/s: (was: SQL) Spark Core > [Spark Job History]Inconsistent beha

[jira] [Comment Edited] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996613#comment-16996613 ] Dongjoon Hyun edited comment on SPARK-30262 at 12/15/19 3:33 AM: -

[jira] [Comment Edited] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996613#comment-16996613 ] Dongjoon Hyun edited comment on SPARK-30262 at 12/15/19 3:33 AM: -

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30262: -- Description: We could get the Partitions Statistics Info.But in some specail case, The Info 

[jira] [Commented] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996613#comment-16996613 ] Dongjoon Hyun commented on SPARK-30262: --- Hi, @chenliang . Thank you for filing Jir

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30262: -- Fix Version/s: (was: 2.4.3) (was: 2.3.2) > Fix NumberFormatExcepti

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30262: -- Target Version/s: (was: 2.3.2, 2.4.3) > Fix NumberFormatException when totalSize is empty >

[jira] [Updated] (SPARK-30212) COUNT(DISTINCT) window function should be supported

2019-12-14 Thread Kernel Force (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kernel Force updated SPARK-30212: - Description: Suppose we have a typical table in Hive like below: {code:sql} CREATE TABLE DEMO_C

[jira] [Resolved] (SPARK-30240) Spark UI redirects do not always work behind (dumb) proxies

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30240. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26873 [https://

[jira] [Assigned] (SPARK-30240) Spark UI redirects do not always work behind (dumb) proxies

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30240: - Assignee: Marcelo Masiero Vanzin > Spark UI redirects do not always work behind (dumb)

[jira] [Resolved] (SPARK-25100) Using KryoSerializer and setting registrationRequired true can lead job failed

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25100. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26714 [https://

[jira] [Assigned] (SPARK-25100) Using KryoSerializer and setting registrationRequired true can lead job failed

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25100: - Assignee: deshanxiao > Using KryoSerializer and setting registrationRequired true can l

[jira] [Assigned] (SPARK-30259) CREATE TABLE throw error when session catalog specified

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30259: - Assignee: Hu Fuwang > CREATE TABLE throw error when session catalog specified > ---

[jira] [Resolved] (SPARK-30259) CREATE TABLE throw error when session catalog specified

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30259. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26887 [https://

[jira] [Commented] (SPARK-27021) Leaking Netty event loop group for shuffle chunk fetch requests

2019-12-14 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996571#comment-16996571 ] Attila Zsolt Piros commented on SPARK-27021: [~roncenzhao] it seems to me yo

[jira] [Resolved] (SPARK-30263) Don't log values of ignored non-Spark properties

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30263. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-30066) Columnar execution support for interval types

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30066: - Assignee: Kent Yao > Columnar execution support for interval types > --

[jira] [Resolved] (SPARK-30066) Columnar execution support for interval types

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30066. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26699 [https://

[jira] [Assigned] (SPARK-30236) Clarify date and time patterns supported by date_format

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30236: - Assignee: John Ayad > Clarify date and time patterns supported by date_format > ---

[jira] [Resolved] (SPARK-30236) Clarify date and time patterns supported by date_format

2019-12-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30236. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26864 [https://

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-12-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29245: Target Version/s: 3.0.0 > CCE during creating HiveMetaStoreClient > -

[jira] [Commented] (SPARK-27021) Leaking Netty event loop group for shuffle chunk fetch requests

2019-12-14 Thread roncenzhao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16996445#comment-16996445 ] roncenzhao commented on SPARK-27021: [~attilapiros] Thank you. We have one problem

[jira] [Updated] (SPARK-27021) Leaking Netty event loop group for shuffle chunk fetch requests

2019-12-14 Thread roncenzhao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] roncenzhao updated SPARK-27021: --- Attachment: image-2019-12-14-23-23-50-384.png > Leaking Netty event loop group for shuffle chunk fet

[jira] [Created] (SPARK-30263) Don't log values of ignored non-Spark properties

2019-12-14 Thread Sean R. Owen (Jira)
Sean R. Owen created SPARK-30263: Summary: Don't log values of ignored non-Spark properties Key: SPARK-30263 URL: https://issues.apache.org/jira/browse/SPARK-30263 Project: Spark Issue Type:

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30262: -- Attachment: screenshot-1.png > Fix NumberFormatException when totalSize is empty > --

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30262: -- Description: For Spark2.3.0+, we could get the Partitions Statistics Info.But in some specail case, T

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30262: -- Description: For Spark2.3.0+, we could get the Partitions Statistics Info.But in some specail case, T

[jira] [Updated] (SPARK-30262) Fix NumberFormatException when totalSize is empty

2019-12-14 Thread chenliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-30262: -- Description: For Spark2.3.0+, we could get the Partitions Statistics Info.But in some specail case, T