[jira] [Commented] (SPARK-32182) Getting Started - Quickstart

[ https://issues.apache.org/jira/browse/SPARK-32182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151794#comment-17151794 ] Hyukjin Kwon commented on SPARK-32182: -- Should also link back https://spark.apache

[jira] [Created] (SPARK-32183) User Guide - PySpark Usage Guide for Pandas with Apache Arrow

Hyukjin Kwon created SPARK-32183: Summary: User Guide - PySpark Usage Guide for Pandas with Apache Arrow Key: SPARK-32183 URL: https://issues.apache.org/jira/browse/SPARK-32183 Project: Spark

[jira] [Created] (SPARK-32182) Getting Started - Quickstart

Hyukjin Kwon created SPARK-32182: Summary: Getting Started - Quickstart Key: SPARK-32182 URL: https://issues.apache.org/jira/browse/SPARK-32182 Project: Spark Issue Type: Sub-task C

[jira] [Created] (SPARK-32181) Getting Started - Package Overview

Hyukjin Kwon created SPARK-32181: Summary: Getting Started - Package Overview Key: SPARK-32181 URL: https://issues.apache.org/jira/browse/SPARK-32181 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-32180) Getting Started - Installation

[ https://issues.apache.org/jira/browse/SPARK-32180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32180: - Summary: Getting Started - Installation (was: Getting Started - Installation page) > Getting S

[jira] [Created] (SPARK-32180) Getting Started - Installation page

Hyukjin Kwon created SPARK-32180: Summary: Getting Started - Installation page Key: SPARK-32180 URL: https://issues.apache.org/jira/browse/SPARK-32180 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-32179) Replace and redesign the documentation base

[ https://issues.apache.org/jira/browse/SPARK-32179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32179: - Description: I have a demo site for this task. See https://hyukjin-spark.readthedocs.io/en/late

[jira] [Assigned] (SPARK-32179) Replace and redesign the documentation base

[ https://issues.apache.org/jira/browse/SPARK-32179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32179: Assignee: Hyukjin Kwon > Replace and redesign the documentation base > --

[jira] [Created] (SPARK-32179) Replace and redesign the documentation base

Hyukjin Kwon created SPARK-32179: Summary: Replace and redesign the documentation base Key: SPARK-32179 URL: https://issues.apache.org/jira/browse/SPARK-32179 Project: Spark Issue Type: Sub-t

[jira] [Commented] (SPARK-31579) Replace floorDiv by / in localRebaseGregorianToJulianDays()

[ https://issues.apache.org/jira/browse/SPARK-31579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151786#comment-17151786 ] Apache Spark commented on SPARK-31579: -- User 'Sudhar287' has created a pull request

[jira] [Commented] (SPARK-31579) Replace floorDiv by / in localRebaseGregorianToJulianDays()

[ https://issues.apache.org/jira/browse/SPARK-31579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151787#comment-17151787 ] Apache Spark commented on SPARK-31579: -- User 'Sudhar287' has created a pull request

[jira] [Commented] (SPARK-31579) Replace floorDiv by / in localRebaseGregorianToJulianDays()

[ https://issues.apache.org/jira/browse/SPARK-31579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151784#comment-17151784 ] Sudharshann D. commented on SPARK-31579: here you go! https://github.com/apache/

[jira] [Updated] (SPARK-32089) Upgrade R version to 4.0.2 in the release DockerFiile

[ https://issues.apache.org/jira/browse/SPARK-32089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32089: -- Fix Version/s: 2.4.7 > Upgrade R version to 4.0.2 in the release DockerFiile > ---

[jira] [Updated] (SPARK-32089) Upgrade R version to 4.0.2 in the release DockerFile

[ https://issues.apache.org/jira/browse/SPARK-32089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32089: -- Summary: Upgrade R version to 4.0.2 in the release DockerFile (was: Upgrade R version to 4.0.

[jira] [Commented] (SPARK-32089) Upgrade R version to 4.0.2 in the release DockerFile

[ https://issues.apache.org/jira/browse/SPARK-32089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151776#comment-17151776 ] Hyukjin Kwon commented on SPARK-32089: -- Thanks [~dongjoon]. > Upgrade R version to

[jira] [Commented] (SPARK-32089) Upgrade R version to 4.0.2 in the release DockerFiile

[ https://issues.apache.org/jira/browse/SPARK-32089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151775#comment-17151775 ] Dongjoon Hyun commented on SPARK-32089: --- This is also backported to `branch-2.4` v

[jira] [Updated] (SPARK-32098) Use iloc for positional slicing instead of direct slicing in createDataFrame with Arrow

[ https://issues.apache.org/jira/browse/SPARK-32098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32098: -- Issue Type: Bug (was: Improvement) > Use iloc for positional slicing instead of direct slicin

[jira] [Commented] (SPARK-32098) Use iloc for positional slicing instead of direct slicing in createDataFrame with Arrow

[ https://issues.apache.org/jira/browse/SPARK-32098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151773#comment-17151773 ] Dongjoon Hyun commented on SPARK-32098: --- Hi, [~hyukjin.kwon] and [~bryanc]. I'm tr

[jira] [Updated] (SPARK-31954) delete duplicate test cases in hivequerysuite

[ https://issues.apache.org/jira/browse/SPARK-31954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31954: -- Component/s: Tests > delete duplicate test cases in hivequerysuite > -

[jira] [Assigned] (SPARK-32171) change file locations for use db and refresh table

[ https://issues.apache.org/jira/browse/SPARK-32171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-32171: -- Assignee: Huaxin Gao > change file locations for use db and refresh table > -

[jira] [Commented] (SPARK-32058) Use Apache Hadoop 3.2.0 dependency by default

[ https://issues.apache.org/jira/browse/SPARK-32058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151734#comment-17151734 ] Apache Spark commented on SPARK-32058: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-31842) DAGSchedulerSuite: For the pattern of runevent + assert, extract the general method

[ https://issues.apache.org/jira/browse/SPARK-31842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151731#comment-17151731 ] Apache Spark commented on SPARK-31842: -- User 'warrenzhu25' has created a pull reque

[jira] [Assigned] (SPARK-31842) DAGSchedulerSuite: For the pattern of runevent + assert, extract the general method

[ https://issues.apache.org/jira/browse/SPARK-31842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31842: Assignee: Apache Spark > DAGSchedulerSuite: For the pattern of runevent + assert, extract

[jira] [Assigned] (SPARK-31842) DAGSchedulerSuite: For the pattern of runevent + assert, extract the general method

[ https://issues.apache.org/jira/browse/SPARK-31842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31842: Assignee: (was: Apache Spark) > DAGSchedulerSuite: For the pattern of runevent + asse

[jira] [Assigned] (SPARK-32178) Disable test-dependencies.sh from Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-32178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32178: Assignee: Dongjoon Hyun > Disable test-dependencies.sh from Jenkins jobs > --

[jira] [Resolved] (SPARK-32178) Disable test-dependencies.sh from Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-32178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32178. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29004 [https://gi

[jira] [Commented] (SPARK-32178) Disable test-dependencies.sh from Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-32178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151710#comment-17151710 ] Apache Spark commented on SPARK-32178: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-32178) Disable test-dependencies.sh from Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-32178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32178: Assignee: (was: Apache Spark) > Disable test-dependencies.sh from Jenkins jobs >

[jira] [Assigned] (SPARK-32178) Disable test-dependencies.sh from Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-32178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32178: Assignee: Apache Spark > Disable test-dependencies.sh from Jenkins jobs > ---

[jira] [Updated] (SPARK-32178) Disable test-dependencies.sh from Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-32178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32178: -- Description: This issue aims to disable dependency tests(test-dependencies.sh) from Jenkins.

[jira] [Updated] (SPARK-32178) Disable test-dependencies.sh from Jenkins jobs

[ https://issues.apache.org/jira/browse/SPARK-32178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32178: -- Description: This issue aims to disable dependency tests(test-dependencies.sh) from Jenkins.

[jira] [Updated] (SPARK-32171) change file locations for use db and refresh table

[ https://issues.apache.org/jira/browse/SPARK-32171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-32171: --- Fix Version/s: 3.1.0 3.0.1 > change file locations for use db and refresh table >

[jira] [Created] (SPARK-32178) Disable test-dependencies.sh from Jenkins jobs

Dongjoon Hyun created SPARK-32178: - Summary: Disable test-dependencies.sh from Jenkins jobs Key: SPARK-32178 URL: https://issues.apache.org/jira/browse/SPARK-32178 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-32177) Remove the weird line from near the Spark logo on mouseover in the WebUI

[ https://issues.apache.org/jira/browse/SPARK-32177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32177. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29003 [https://

[jira] [Updated] (SPARK-32177) Remove the weird line from near the Spark logo on mouseover in the WebUI

[ https://issues.apache.org/jira/browse/SPARK-32177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-32177: --- Affects Version/s: (was: 3.0.0) > Remove the weird line from near the Spark logo on mous

[jira] [Comment Edited] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151682#comment-17151682 ] JinxinTang edited comment on SPARK-32176 at 7/6/20, 12:47 AM:

[jira] [Comment Edited] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151682#comment-17151682 ] JinxinTang edited comment on SPARK-32176 at 7/6/20, 12:43 AM:

[jira] [Comment Edited] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151682#comment-17151682 ] JinxinTang edited comment on SPARK-32176 at 7/6/20, 12:43 AM:

[jira] [Comment Edited] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151682#comment-17151682 ] JinxinTang edited comment on SPARK-32176 at 7/6/20, 12:42 AM:

[jira] [Comment Edited] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151682#comment-17151682 ] JinxinTang edited comment on SPARK-32176 at 7/6/20, 12:41 AM:

[jira] [Comment Edited] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151682#comment-17151682 ] JinxinTang edited comment on SPARK-32176 at 7/6/20, 12:40 AM:

[jira] [Comment Edited] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151682#comment-17151682 ] JinxinTang edited comment on SPARK-32176 at 7/6/20, 12:40 AM:

[jira] [Comment Edited] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151682#comment-17151682 ] JinxinTang edited comment on SPARK-32176 at 7/6/20, 12:40 AM:

[jira] [Commented] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151682#comment-17151682 ] JinxinTang commented on SPARK-32176: cc [~abhi92544] Seems can not reproduce： [https

[jira] [Updated] (SPARK-32172) Use createDirectory instead of mkdir

[ https://issues.apache.org/jira/browse/SPARK-32172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32172: -- Affects Version/s: (was: 2.4.0) (was: 2.3.0) > Use createDirect

[jira] [Issue Comment Deleted] (SPARK-32172) Use createDirectory instead of mkdir

[ https://issues.apache.org/jira/browse/SPARK-32172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32172: -- Comment: was deleted (was: User 'sidedoorleftroad' has created a pull request for this issue:

[jira] [Updated] (SPARK-32172) Use createDirectory instead of mkdir

[ https://issues.apache.org/jira/browse/SPARK-32172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32172: -- Priority: Minor (was: Major) > Use createDirectory instead of mkdir > ---

[jira] [Updated] (SPARK-32172) Use createDirectory instead of mkdir

[ https://issues.apache.org/jira/browse/SPARK-32172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32172: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Use createDirectory instead

[jira] [Commented] (SPARK-32172) Use createDirectory instead of mkdir

[ https://issues.apache.org/jira/browse/SPARK-32172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151679#comment-17151679 ] Dongjoon Hyun commented on SPARK-32172: --- Hi, [~ZuoDao]. Thank you for filing a JIR

[jira] [Assigned] (SPARK-32177) Remove the weird line from near the Spark logo on mouseover in the WebUI

[ https://issues.apache.org/jira/browse/SPARK-32177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32177: Assignee: Apache Spark (was: Kousuke Saruta) > Remove the weird line from near the Spark

[jira] [Assigned] (SPARK-32177) Remove the weird line from near the Spark logo on mouseover in the WebUI

[ https://issues.apache.org/jira/browse/SPARK-32177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32177: Assignee: Kousuke Saruta (was: Apache Spark) > Remove the weird line from near the Spark

[jira] [Commented] (SPARK-32177) Remove the weird line from near the Spark logo on mouseover in the WebUI

[ https://issues.apache.org/jira/browse/SPARK-32177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151671#comment-17151671 ] Apache Spark commented on SPARK-32177: -- User 'sarutak' has created a pull request f

[jira] [Created] (SPARK-32177) Remove the weird line from near the Spark logo on mouseover in the WebUI

Kousuke Saruta created SPARK-32177: -- Summary: Remove the weird line from near the Spark logo on mouseover in the WebUI Key: SPARK-32177 URL: https://issues.apache.org/jira/browse/SPARK-32177 Project:

[jira] [Updated] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Adhikari updated SPARK-32176: -- Description:   In spark 2.4, I'm able to read data where I have data in mixed types,

[jira] [Updated] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Adhikari updated SPARK-32176: -- Description:   In spark 2.4, I'm able to read data where I have data in mixed types,

[jira] [Updated] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Adhikari updated SPARK-32176: -- Description:   In spark 2.4, I'm able to read data where I have data in mixed types,

[jira] [Updated] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Adhikari updated SPARK-32176: -- Description:   In spark 2.4, I'm able to read data where I have data in mixed types,

[jira] [Commented] (SPARK-32175) Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

[ https://issues.apache.org/jira/browse/SPARK-32175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151667#comment-17151667 ] Apache Spark commented on SPARK-32175: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-32175) Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

[ https://issues.apache.org/jira/browse/SPARK-32175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32175: Assignee: Kousuke Saruta (was: Apache Spark) > Fix the order between initialization for

[jira] [Assigned] (SPARK-32175) Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

[ https://issues.apache.org/jira/browse/SPARK-32175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32175: Assignee: Apache Spark (was: Kousuke Saruta) > Fix the order between initialization for

[jira] [Commented] (SPARK-32175) Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

[ https://issues.apache.org/jira/browse/SPARK-32175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151666#comment-17151666 ] Apache Spark commented on SPARK-32175: -- User 'sarutak' has created a pull request f

[jira] [Updated] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Adhikari updated SPARK-32176: -- Description: In spark 2.4, I'm able to read data where I have data in mixed types, by

[jira] [Updated] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Adhikari updated SPARK-32176: -- Description: In spark 2.4, I'm able to read data where I have data in mixed types, by

[jira] [Updated] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

[ https://issues.apache.org/jira/browse/SPARK-32176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Adhikari updated SPARK-32176: -- Description: In spark 2.4, I'm able to read data where I have data in mixed types, by

[jira] [Created] (SPARK-32176) Automatic type promotion to ArrayType in defined schema in from_json is broken

Abhishek Adhikari created SPARK-32176: - Summary: Automatic type promotion to ArrayType in defined schema in from_json is broken Key: SPARK-32176 URL: https://issues.apache.org/jira/browse/SPARK-32176

[jira] [Created] (SPARK-32175) Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

Kousuke Saruta created SPARK-32175: -- Summary: Fix the order between initialization for ExecutorPlugin and starting heartbeat thread Key: SPARK-32175 URL: https://issues.apache.org/jira/browse/SPARK-32175

[jira] [Commented] (SPARK-32100) Add WorkerDecommissionExtendedSuite

[ https://issues.apache.org/jira/browse/SPARK-32100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151655#comment-17151655 ] Apache Spark commented on SPARK-32100: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151651#comment-17151651 ] Apache Spark commented on SPARK-29302: -- User 'WinkerDu' has created a pull request

[jira] [Commented] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151649#comment-17151649 ] Apache Spark commented on SPARK-27194: -- User 'WinkerDu' has created a pull request

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151650#comment-17151650 ] Apache Spark commented on SPARK-29302: -- User 'WinkerDu' has created a pull request

[jira] [Updated] (SPARK-32174) toPandas attempted Arrow optimization but has reached an error and can not continue

[ https://issues.apache.org/jira/browse/SPARK-32174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramin Hazegh updated SPARK-32174: - Description: h4. Converting a dataframe to Panda data frame using toPandas() fails.   *Spark 3

[jira] [Updated] (SPARK-32174) toPandas attempted Arrow optimization but has reached an error and can not continue

[ https://issues.apache.org/jira/browse/SPARK-32174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramin Hazegh updated SPARK-32174: - Environment: Spark 3.0.0, running in *stand-alone* mode (was: Spark 3.0.0, running in *stand-al

[jira] [Updated] (SPARK-32174) toPandas attempted Arrow optimization but has reached an error and can not continue

[ https://issues.apache.org/jira/browse/SPARK-32174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramin Hazegh updated SPARK-32174: - Description: h4. Converting a dataframe to Panda data frame using toPandas() fails.   *Spark 3

[jira] [Updated] (SPARK-32174) toPandas attempted Arrow optimization but has reached an error and can not continue

[ https://issues.apache.org/jira/browse/SPARK-32174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramin Hazegh updated SPARK-32174: - Description: h4. Converting a dataframe to Panda data frame using toPandas() fails.   *Spark 3

[jira] [Updated] (SPARK-32174) toPandas attempted Arrow optimization but has reached an error and can not continue

[ https://issues.apache.org/jira/browse/SPARK-32174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramin Hazegh updated SPARK-32174: - Description: h4. Converting a dataframe to Panda data frame using toPandas() fails.   *Spark 3

[jira] [Updated] (SPARK-32174) toPandas attempted Arrow optimization but has reached an error and can not continue

[ https://issues.apache.org/jira/browse/SPARK-32174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramin Hazegh updated SPARK-32174: - Description: h4. Converting a dataframe to Panda data frame using toPandas() fails.   *Spark 3

[jira] [Created] (SPARK-32174) toPandas attempted Arrow optimization but has reached an error and can not continue

Ramin Hazegh created SPARK-32174: Summary: toPandas attempted Arrow optimization but has reached an error and can not continue Key: SPARK-32174 URL: https://issues.apache.org/jira/browse/SPARK-32174 P

[jira] [Updated] (SPARK-32163) Nested pruning should still work for nested column extractors of attributes with cosmetic variations

[ https://issues.apache.org/jira/browse/SPARK-32163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32163: Affects Version/s: (was: 3.1.0) 3.0.0 > Nested pruning should still wor

[jira] [Updated] (SPARK-32163) Nested pruning should still work for nested column extractors of attributes with cosmetic variations

[ https://issues.apache.org/jira/browse/SPARK-32163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32163: Affects Version/s: (was: 3.0.0) 3.1.0 > Nested pruning should still wor

[jira] [Commented] (SPARK-32120) Single GPU is allocated multiple times

[ https://issues.apache.org/jira/browse/SPARK-32120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151555#comment-17151555 ] wuyi commented on SPARK-32120: -- We've removed coordination logic in SPARK-30969. It should

[jira] [Commented] (SPARK-32120) Single GPU is allocated multiple times

[ https://issues.apache.org/jira/browse/SPARK-32120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151550#comment-17151550 ] wuyi commented on SPARK-32120: -- [~EnricoMi] Thanks for reporting! I am looking into this.

[jira] [Updated] (SPARK-32172) Use createDirectory instead of mkdir

[ https://issues.apache.org/jira/browse/SPARK-32172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zuo Dao updated SPARK-32172: Description: Use Files.createDirectory() to create local directory instead of File.mkdir() in DiskBlockMa

[jira] [Assigned] (SPARK-32173) Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

[ https://issues.apache.org/jira/browse/SPARK-32173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32173: Assignee: Apache Spark > Deduplicate code in FromUTCTimestamp and ToUTCTimestamp > --

[jira] [Commented] (SPARK-32173) Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

[ https://issues.apache.org/jira/browse/SPARK-32173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151526#comment-17151526 ] Apache Spark commented on SPARK-32173: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-32173) Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

[ https://issues.apache.org/jira/browse/SPARK-32173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151525#comment-17151525 ] Apache Spark commented on SPARK-32173: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-32173) Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

[ https://issues.apache.org/jira/browse/SPARK-32173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32173: Assignee: (was: Apache Spark) > Deduplicate code in FromUTCTimestamp and ToUTCTimesta

[jira] [Created] (SPARK-32173) Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

Maxim Gekk created SPARK-32173: -- Summary: Deduplicate code in FromUTCTimestamp and ToUTCTimestamp Key: SPARK-32173 URL: https://issues.apache.org/jira/browse/SPARK-32173 Project: Spark Issue Typ

[jira] [Commented] (SPARK-31562) Update ExpressionDescription for substring, current_date, and current_timestamp

[ https://issues.apache.org/jira/browse/SPARK-31562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151518#comment-17151518 ] Apache Spark commented on SPARK-31562: -- User 'maropu' has created a pull request fo