[jira] [Resolved] (SPARK-32090) UserDefinedType.equal() does not have symmetry

[ https://issues.apache.org/jira/browse/SPARK-32090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32090. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28923

[jira] [Assigned] (SPARK-32090) UserDefinedType.equal() does not have symmetry

[ https://issues.apache.org/jira/browse/SPARK-32090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32090: - Assignee: wuyi > UserDefinedType.equal() does not have symmetry >

[jira] [Comment Edited] (SPARK-32096) Support top-N sort for Spark SQL rank window function

[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147548#comment-17147548 ] Zikun edited comment on SPARK-32096 at 6/29/20, 4:44 AM: - Yes, we need to do

[jira] [Commented] (SPARK-32096) Support top-N sort for Spark SQL rank window function

[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147548#comment-17147548 ] Zikun commented on SPARK-32096: --- Yes, we need to do top-N sort for each window partition in each physical

[jira] [Assigned] (SPARK-32126) Scope Session.active in IncrementalExecution

[ https://issues.apache.org/jira/browse/SPARK-32126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32126: - Assignee: Yuanjian Li > Scope Session.active in IncrementalExecution >

[jira] [Commented] (SPARK-32096) Support top-N sort for Spark SQL rank window function

[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147542#comment-17147542 ] L. C. Hsieh commented on SPARK-32096: - Then I think it is not a simply top-N sort... You need to do

[jira] [Resolved] (SPARK-32126) Scope Session.active in IncrementalExecution

[ https://issues.apache.org/jira/browse/SPARK-32126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32126. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-32126) Scope Session.active in IncrementalExecution

[ https://issues.apache.org/jira/browse/SPARK-32126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32126: Assignee: (was: Apache Spark) > Scope Session.active in IncrementalExecution >

[jira] [Commented] (SPARK-32126) Scope Session.active in IncrementalExecution

[ https://issues.apache.org/jira/browse/SPARK-32126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147539#comment-17147539 ] Apache Spark commented on SPARK-32126: -- User 'xuanyuanking' has created a pull request for this

[jira] [Assigned] (SPARK-32126) Scope Session.active in IncrementalExecution

[ https://issues.apache.org/jira/browse/SPARK-32126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32126: Assignee: Apache Spark > Scope Session.active in IncrementalExecution >

[jira] [Created] (SPARK-32126) Scope Session.active in IncrementalExecution

Dongjoon Hyun created SPARK-32126: - Summary: Scope Session.active in IncrementalExecution Key: SPARK-32126 URL: https://issues.apache.org/jira/browse/SPARK-32126 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32126) Scope Session.active in IncrementalExecution

[ https://issues.apache.org/jira/browse/SPARK-32126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32126: -- Component/s: (was: SQL) > Scope Session.active in IncrementalExecution >

[jira] [Commented] (SPARK-32096) Support top-N sort for Spark SQL rank window function

[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147538#comment-17147538 ] Zikun commented on SPARK-32096: --- [~viirya] Yes, a filter of window rank <= 100 means a top-100 sort. And

[jira] [Resolved] (SPARK-32124) [SHS] Failed to parse FetchFailed TaskEndReason from event log produce by Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-32124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32124. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-32124) [SHS] Failed to parse FetchFailed TaskEndReason from event log produce by Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-32124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32124: - Assignee: Zhongwei Zhu > [SHS] Failed to parse FetchFailed TaskEndReason from event

[jira] [Commented] (SPARK-32096) Support top-N sort for Spark SQL rank window function

[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147504#comment-17147504 ] L. C. Hsieh commented on SPARK-32096: - Does a filter of the window rank (e.g. rank <= 100) mean

[jira] [Commented] (SPARK-32125) [UI] Support get taskList by status in Web UI and SHS Rest API

[ https://issues.apache.org/jira/browse/SPARK-32125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147469#comment-17147469 ] Apache Spark commented on SPARK-32125: -- User 'warrenzhu25' has created a pull request for this

[jira] [Commented] (SPARK-32125) [UI] Support get taskList by status in Web UI and SHS Rest API

[ https://issues.apache.org/jira/browse/SPARK-32125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147470#comment-17147470 ] Apache Spark commented on SPARK-32125: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-32125) [UI] Support get taskList by status in Web UI and SHS Rest API

[ https://issues.apache.org/jira/browse/SPARK-32125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32125: Assignee: (was: Apache Spark) > [UI] Support get taskList by status in Web UI and

[jira] [Assigned] (SPARK-32125) [UI] Support get taskList by status in Web UI and SHS Rest API

[ https://issues.apache.org/jira/browse/SPARK-32125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32125: Assignee: Apache Spark > [UI] Support get taskList by status in Web UI and SHS Rest API

[jira] [Created] (SPARK-32125) [UI] Support get taskList by status in Web UI and SHS Rest API

Zhongwei Zhu created SPARK-32125: Summary: [UI] Support get taskList by status in Web UI and SHS Rest API Key: SPARK-32125 URL: https://issues.apache.org/jira/browse/SPARK-32125 Project: Spark

[jira] [Assigned] (SPARK-32124) [SHS] Failed to parse FetchFailed TaskEndReason from event log produce by Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-32124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32124: Assignee: Apache Spark > [SHS] Failed to parse FetchFailed TaskEndReason from event log

[jira] [Assigned] (SPARK-32124) [SHS] Failed to parse FetchFailed TaskEndReason from event log produce by Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-32124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32124: Assignee: (was: Apache Spark) > [SHS] Failed to parse FetchFailed TaskEndReason from

[jira] [Commented] (SPARK-32124) [SHS] Failed to parse FetchFailed TaskEndReason from event log produce by Spark 2.4

[ https://issues.apache.org/jira/browse/SPARK-32124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147465#comment-17147465 ] Apache Spark commented on SPARK-32124: -- User 'warrenzhu25' has created a pull request for this

[jira] [Created] (SPARK-32124) [SHS] Failed to parse FetchFailed TaskEndReason from event log produce by Spark 2.4

Zhongwei Zhu created SPARK-32124: Summary: [SHS] Failed to parse FetchFailed TaskEndReason from event log produce by Spark 2.4 Key: SPARK-32124 URL: https://issues.apache.org/jira/browse/SPARK-32124

[jira] [Comment Edited] (SPARK-25244) [Python] Setting `spark.sql.session.timeZone` only partially respected

[ https://issues.apache.org/jira/browse/SPARK-25244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147464#comment-17147464 ] Toby Harradine edited comment on SPARK-25244 at 6/28/20, 10:44 PM: ---

[jira] [Commented] (SPARK-25244) [Python] Setting `spark.sql.session.timeZone` only partially respected

[ https://issues.apache.org/jira/browse/SPARK-25244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147464#comment-17147464 ] Toby Harradine commented on SPARK-25244: Thanks for letting me know. I've just created

[jira] [Updated] (SPARK-32123) [Python] Setting `spark.sql.session.timeZone` only partially respected

[ https://issues.apache.org/jira/browse/SPARK-32123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Toby Harradine updated SPARK-32123: --- Description: Reopening SPARK-25244 as it is unresolved as of versions 2.4.6 and 3.0.0. The

[jira] [Updated] (SPARK-32123) [Python] Setting `spark.sql.session.timeZone` only partially respected

[ https://issues.apache.org/jira/browse/SPARK-32123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Toby Harradine updated SPARK-32123: --- Description: Reopening SPARK-25244 as it is unresolved as of versions 2.4.6 and 3.0.0. The

[jira] [Updated] (SPARK-32123) [Python] Setting `spark.sql.session.timeZone` only partially respected

[ https://issues.apache.org/jira/browse/SPARK-32123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Toby Harradine updated SPARK-32123: --- Description: Reopening SPARK-25244 as it is unresolved as of versions 2.4.6 and 3.0.0. The

[jira] [Updated] (SPARK-32123) [Python] Setting `spark.sql.session.timeZone` only partially respected

[ https://issues.apache.org/jira/browse/SPARK-32123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Toby Harradine updated SPARK-32123: --- Labels: (was: bulk-closed) > [Python] Setting `spark.sql.session.timeZone` only partially

[jira] [Updated] (SPARK-32123) [Python] Setting `spark.sql.session.timeZone` only partially respected

[ https://issues.apache.org/jira/browse/SPARK-32123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Toby Harradine updated SPARK-32123: --- Affects Version/s: (was: 2.3.1) 3.0.0 > [Python] Setting

[jira] [Created] (SPARK-32123) [Python] Setting `spark.sql.session.timeZone` only partially respected

Toby Harradine created SPARK-32123: -- Summary: [Python] Setting `spark.sql.session.timeZone` only partially respected Key: SPARK-32123 URL: https://issues.apache.org/jira/browse/SPARK-32123 Project:

[jira] [Created] (SPARK-32122) Exception while writing dataframe with enum fields

Sai kiran Krishna murthy created SPARK-32122: Summary: Exception while writing dataframe with enum fields Key: SPARK-32122 URL: https://issues.apache.org/jira/browse/SPARK-32122 Project:

[jira] [Commented] (SPARK-25341) Support rolling back a shuffle map stage and re-generate the shuffle files

[ https://issues.apache.org/jira/browse/SPARK-25341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147435#comment-17147435 ] Apache Spark commented on SPARK-25341: -- User 'warrenzhu25' has created a pull request for this

[jira] [Commented] (SPARK-25341) Support rolling back a shuffle map stage and re-generate the shuffle files

[ https://issues.apache.org/jira/browse/SPARK-25341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147434#comment-17147434 ] Apache Spark commented on SPARK-25341: -- User 'warrenzhu25' has created a pull request for this

[jira] [Commented] (SPARK-32121) ExternalShuffleBlockResolverSuite failed on Windows

[ https://issues.apache.org/jira/browse/SPARK-32121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147424#comment-17147424 ] Apache Spark commented on SPARK-32121: -- User 'pan3793' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32121) ExternalShuffleBlockResolverSuite failed on Windows

[ https://issues.apache.org/jira/browse/SPARK-32121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32121: Assignee: Apache Spark > ExternalShuffleBlockResolverSuite failed on Windows >

[jira] [Assigned] (SPARK-32121) ExternalShuffleBlockResolverSuite failed on Windows

[ https://issues.apache.org/jira/browse/SPARK-32121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32121: Assignee: (was: Apache Spark) > ExternalShuffleBlockResolverSuite failed on Windows

[jira] [Updated] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32119: --- Affects Version/s: 3.0.1 > ExecutorPlugin doesn't work with Standalone Cluster >

[jira] [Commented] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147427#comment-17147427 ] Kousuke Saruta commented on SPARK-32119: Sorry, it's just a mistake. I've modified it. >

[jira] [Updated] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32119: --- Issue Type: Bug (was: Improvement) > ExecutorPlugin doesn't work with Standalone Cluster >

[jira] [Updated] (SPARK-32121) ExternalShuffleBlockResolverSuite failed on Windows

[ https://issues.apache.org/jira/browse/SPARK-32121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan updated SPARK-32121: -- Summary: ExternalShuffleBlockResolverSuite failed on Windows (was: ExternalShuffleBlockResolverSuite

[jira] [Commented] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147422#comment-17147422 ] Dongjoon Hyun commented on SPARK-32119: --- Hi, [~sarutak]. This sounds like a bug for `Standalone

[jira] [Resolved] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32115. --- Fix Version/s: 3.1.0 2.4.7 3.0.1 Resolution:

[jira] [Assigned] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32115: - Assignee: Yuanjian Li > Incorrect results for SUBSTRING when overflow >

[jira] [Created] (SPARK-32121) ExternalShuffleBlockResolverSuite failed on windows

Cheng Pan created SPARK-32121: - Summary: ExternalShuffleBlockResolverSuite failed on windows Key: SPARK-32121 URL: https://issues.apache.org/jira/browse/SPARK-32121 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32115: -- Target Version/s: 2.4.7, 3.0.1 > Incorrect results for SUBSTRING when overflow >

[jira] [Commented] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147417#comment-17147417 ] Dongjoon Hyun commented on SPARK-32115: --- Although this might be a rare case, but I raise this

[jira] [Updated] (SPARK-32120) Single GPU is allocated multiple times

[ https://issues.apache.org/jira/browse/SPARK-32120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-32120: -- Description: I am running Spark in a {{local-cluster[2,1,1024]}} with one GPU per worker,

[jira] [Updated] (SPARK-32120) Single GPU is allocated multiple times

[ https://issues.apache.org/jira/browse/SPARK-32120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-32120: -- Attachment: (was: screenshot-1.png) > Single GPU is allocated multiple times >

[jira] [Updated] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32115: -- Priority: Blocker (was: Major) > Incorrect results for SUBSTRING when overflow >

[jira] [Commented] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147416#comment-17147416 ] Dongjoon Hyun commented on SPARK-32115: --- I also verified that this is a long standing bug at 1.6.3

[jira] [Updated] (SPARK-32120) Single GPU is allocated multiple times

[ https://issues.apache.org/jira/browse/SPARK-32120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-32120: -- Attachment: screenshot-3.png > Single GPU is allocated multiple times >

[jira] [Updated] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32115: -- Affects Version/s: 1.6.3 > Incorrect results for SUBSTRING when overflow >

[jira] [Updated] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32115: -- Affects Version/s: 2.0.2 > Incorrect results for SUBSTRING when overflow >

[jira] [Updated] (SPARK-32120) Single GPU is allocated multiple times

[ https://issues.apache.org/jira/browse/SPARK-32120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-32120: -- Attachment: screenshot-2.png > Single GPU is allocated multiple times >

[jira] [Updated] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32115: -- Labels: correctness (was: ) > Incorrect results for SUBSTRING when overflow >

[jira] [Updated] (SPARK-32120) Single GPU is allocated multiple times

[ https://issues.apache.org/jira/browse/SPARK-32120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-32120: -- Attachment: screenshot-1.png > Single GPU is allocated multiple times >

[jira] [Updated] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32115: -- Affects Version/s: 2.1.3 > Incorrect results for SUBSTRING when overflow >

[jira] [Assigned] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32119: Assignee: Kousuke Saruta (was: Apache Spark) > ExecutorPlugin doesn't work with

[jira] [Updated] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32115: -- Affects Version/s: 2.2.3 > Incorrect results for SUBSTRING when overflow >

[jira] [Assigned] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32119: Assignee: Apache Spark (was: Kousuke Saruta) > ExecutorPlugin doesn't work with

[jira] [Created] (SPARK-32120) Single GPU is allocated multiple times

Enrico Minack created SPARK-32120: - Summary: Single GPU is allocated multiple times Key: SPARK-32120 URL: https://issues.apache.org/jira/browse/SPARK-32120 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32115: -- Affects Version/s: 2.3.4 > Incorrect results for SUBSTRING when overflow >

[jira] [Updated] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32115: -- Affects Version/s: 2.4.6 > Incorrect results for SUBSTRING when overflow >

[jira] [Commented] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147414#comment-17147414 ] Apache Spark commented on SPARK-32119: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-32115) Incorrect results for SUBSTRING when overflow

[ https://issues.apache.org/jira/browse/SPARK-32115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147413#comment-17147413 ] Dongjoon Hyun commented on SPARK-32115: --- Thank you, @Yuanjian Li . > Incorrect results for

[jira] [Updated] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

[ https://issues.apache.org/jira/browse/SPARK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32119: --- Description: ExecutorPlugin can't work with Standalone Cluster (maybe with other cluster

[jira] [Created] (SPARK-32119) ExecutorPlugin doesn't work with Standalone Cluster

Kousuke Saruta created SPARK-32119: -- Summary: ExecutorPlugin doesn't work with Standalone Cluster Key: SPARK-32119 URL: https://issues.apache.org/jira/browse/SPARK-32119 Project: Spark

[jira] [Commented] (SPARK-32109) SQL hash function handling of nulls makes collision too likely

[ https://issues.apache.org/jira/browse/SPARK-32109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147358#comment-17147358 ] koert kuipers commented on SPARK-32109: --- the issue is that Row here isnt really a sequence. it

[jira] [Comment Edited] (SPARK-32109) SQL hash function handling of nulls makes collision too likely

[ https://issues.apache.org/jira/browse/SPARK-32109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147358#comment-17147358 ] koert kuipers edited comment on SPARK-32109 at 6/28/20, 2:58 PM: - the

[jira] [Assigned] (SPARK-32118) Use fine-grained read write lock for each database in HiveExternalCatalog

[ https://issues.apache.org/jira/browse/SPARK-32118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32118: Assignee: Apache Spark > Use fine-grained read write lock for each database in

[jira] [Commented] (SPARK-32118) Use fine-grained read write lock for each database in HiveExternalCatalog

[ https://issues.apache.org/jira/browse/SPARK-32118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147353#comment-17147353 ] Apache Spark commented on SPARK-32118: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32118) Use fine-grained read write lock for each database in HiveExternalCatalog

[ https://issues.apache.org/jira/browse/SPARK-32118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32118: Assignee: (was: Apache Spark) > Use fine-grained read write lock for each database

[jira] [Created] (SPARK-32118) Use fine-grained read write lock for each database in HiveExternalCatalog

Lantao Jin created SPARK-32118: -- Summary: Use fine-grained read write lock for each database in HiveExternalCatalog Key: SPARK-32118 URL: https://issues.apache.org/jira/browse/SPARK-32118 Project: Spark

[jira] [Commented] (SPARK-32109) SQL hash function handling of nulls makes collision too likely

[ https://issues.apache.org/jira/browse/SPARK-32109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147328#comment-17147328 ] Chen Zhang commented on SPARK-32109: The logic in the source code can be represented by the

[jira] [Commented] (SPARK-32018) Fix UnsafeRow set overflowed decimal

[ https://issues.apache.org/jira/browse/SPARK-32018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147313#comment-17147313 ] angerszhu commented on SPARK-32018: --- [~allisonwang-db]  Can you show a test case to reproduce this?

[jira] [Commented] (SPARK-32060) Huber loss Convergence

[ https://issues.apache.org/jira/browse/SPARK-32060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147295#comment-17147295 ] zhengruifeng commented on SPARK-32060: -- According to the convergence curves of different blockSize,

[jira] [Updated] (SPARK-32060) Huber loss Convergence

[ https://issues.apache.org/jira/browse/SPARK-32060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-32060: - Attachment: image-2020-06-28-18-05-28-867.png > Huber loss Convergence > --

[jira] [Updated] (SPARK-32060) Huber loss Convergence

[ https://issues.apache.org/jira/browse/SPARK-32060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-32060: - Attachment: huber.xlsx > Huber loss Convergence > -- > >

[jira] [Updated] (SPARK-32060) Huber loss Convergence

[ https://issues.apache.org/jira/browse/SPARK-32060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-32060: - Attachment: (was: huber.xlsx) > Huber loss Convergence > -- > >

[jira] [Resolved] (SPARK-32117) Thread spark-listener-group-streams is cpu costing

[ https://issues.apache.org/jira/browse/SPARK-32117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin resolved SPARK-32117. Resolution: Won't Fix > Thread spark-listener-group-streams is cpu costing >

[jira] [Commented] (SPARK-32117) Thread spark-listener-group-streams is cpu costing

[ https://issues.apache.org/jira/browse/SPARK-32117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147278#comment-17147278 ] Lantao Jin commented on SPARK-32117: I think it might be fixed by SPARK-29423 > Thread

[jira] [Created] (SPARK-32117) Thread spark-listener-group-streams is cpu costing

Lantao Jin created SPARK-32117: -- Summary: Thread spark-listener-group-streams is cpu costing Key: SPARK-32117 URL: https://issues.apache.org/jira/browse/SPARK-32117 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31851) Redesign PySpark documentation

[ https://issues.apache.org/jira/browse/SPARK-31851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147271#comment-17147271 ] Manish Khobragade commented on SPARK-31851: --- I would also like to help with this.  > Redesign

[jira] [Commented] (SPARK-32108) Silent mode of spark-sql is broken

[ https://issues.apache.org/jira/browse/SPARK-32108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147264#comment-17147264 ] Lantao Jin commented on SPARK-32108: [~maxgekk] I think it works. The INFO logs only print in

[jira] [Comment Edited] (SPARK-32060) Huber loss Convergence

[ https://issues.apache.org/jira/browse/SPARK-32060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147261#comment-17147261 ] zhengruifeng edited comment on SPARK-32060 at 6/28/20, 8:34 AM:

[jira] [Comment Edited] (SPARK-32060) Huber loss Convergence

[ https://issues.apache.org/jira/browse/SPARK-32060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147261#comment-17147261 ] zhengruifeng edited comment on SPARK-32060 at 6/28/20, 8:34 AM:

[jira] [Updated] (SPARK-32060) Huber loss Convergence

[ https://issues.apache.org/jira/browse/SPARK-32060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-32060: - Attachment: huber.xlsx > Huber loss Convergence > -- > >

[jira] [Commented] (SPARK-32060) Huber loss Convergence

[ https://issues.apache.org/jira/browse/SPARK-32060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147261#comment-17147261 ] zhengruifeng commented on SPARK-32060: -- {code:java} import org.apache.spark.ml.regression._ import

[jira] [Updated] (SPARK-32060) Huber loss Convergence

[ https://issues.apache.org/jira/browse/SPARK-32060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-32060: - Description: |performace test in https://issues.apache.org/jira/browse/SPARK-31783, Huber loss

[jira] [Updated] (SPARK-32060) Huber loss Convergence

[ https://issues.apache.org/jira/browse/SPARK-32060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-32060: - Attachment: (was: huber.xlsx) > Huber loss Convergence > -- > >

[jira] [Updated] (SPARK-32060) Huber loss Convergence

[ https://issues.apache.org/jira/browse/SPARK-32060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-32060: - Attachment: huber.xlsx > Huber loss Convergence > -- > >

[jira] [Updated] (SPARK-32112) Easier way to repartition/coalesce DataFrames based on the number of parallel tasks that Spark can process at the same time

[ https://issues.apache.org/jira/browse/SPARK-32112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noritaka Sekiyama updated SPARK-32112: -- Description: Repartition/coalesce is very important to optimize Spark application's

[jira] [Commented] (SPARK-31095) Upgrade netty-all to 4.1.47.Final

[ https://issues.apache.org/jira/browse/SPARK-31095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147241#comment-17147241 ] Xiaochen Ouyang commented on SPARK-31095: - Hello  [~dongjoon], Can netty-all upgrade solve

[jira] [Commented] (SPARK-32114) Change name of the slaves file, to something more acceptable

[ https://issues.apache.org/jira/browse/SPARK-32114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147227#comment-17147227 ] L. C. Hsieh commented on SPARK-32114: - I think this might be duplicate to SPARK-32004. > Change

[jira] [Commented] (SPARK-31823) Improve the current Spark Scheduler test framework

[ https://issues.apache.org/jira/browse/SPARK-31823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147224#comment-17147224 ] jiaan.geng commented on SPARK-31823: This ticket just used to improve test framework of Spark