[jira] [Closed] (SPARK-3493) Unrolling behavior is too aggressive in dropping blocks

[ https://issues.apache.org/jira/browse/SPARK-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3493. Resolution: Won't Fix False alarm. We only ever call `ensureFreeSpace` if we can't reserve more memory. [~t

[jira] [Commented] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161372#comment-14161372 ] Andrew Or commented on SPARK-3174: -- @[~sandyr] Replying inline: bq. I would expect prope

[jira] [Comment Edited] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161372#comment-14161372 ] Andrew Or edited comment on SPARK-3174 at 10/7/14 2:20 AM: --- @[~s

[jira] [Commented] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161378#comment-14161378 ] Andrew Or commented on SPARK-3174: -- @[~tgraves] Replying inline: bq. Just to make sure,

[jira] [Commented] (SPARK-3797) Run the shuffle service inside the YARN NodeManager as an AuxiliaryService

[ https://issues.apache.org/jira/browse/SPARK-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14162254#comment-14162254 ] Andrew Or commented on SPARK-3797: -- Thanks for detailing the considerations Sandy. I agre

[jira] [Updated] (SPARK-3808) PySpark fails to start in Windows

[ https://issues.apache.org/jira/browse/SPARK-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3808: - Affects Version/s: (was: 1.1.0) 1.2.0 > PySpark fails to start in Windows > ---

[jira] [Closed] (SPARK-3808) PySpark fails to start in Windows

[ https://issues.apache.org/jira/browse/SPARK-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3808. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Masayoshi TSUZUKI Target Versio

[jira] [Commented] (SPARK-3808) PySpark fails to start in Windows

[ https://issues.apache.org/jira/browse/SPARK-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14162310#comment-14162310 ] Andrew Or commented on SPARK-3808: -- Hey [~tsudukim] can you verify that pyspark, spark-sh

[jira] [Closed] (SPARK-3825) Log more information when unrolling a block fails

[ https://issues.apache.org/jira/browse/SPARK-3825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3825. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 > Log more information when unrolling

[jira] [Updated] (SPARK-3661) spark.*.memory is ignored in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3661: - Summary: spark.*.memory is ignored in cluster mode (was: spark.driver.memory is ignored in cluster mode)

[jira] [Updated] (SPARK-3661) spark.*.memory is ignored in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3661: - Description: This is related to https://issues.apache.org/jira/browse/SPARK-3653, but for the config. Note

[jira] [Updated] (SPARK-3661) spark.*.memory is ignored in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3661: - Description: This is related to https://issues.apache.org/jira/browse/SPARK-3653, but for the config. Note

[jira] [Updated] (SPARK-3777) Display "Executor ID" for Tasks in Stage page

[ https://issues.apache.org/jira/browse/SPARK-3777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3777: - Assignee: Shixiong Zhu > Display "Executor ID" for Tasks in Stage page > -

[jira] [Closed] (SPARK-3777) Display "Executor ID" for Tasks in Stage page

[ https://issues.apache.org/jira/browse/SPARK-3777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3777. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Target Version/s: 1.1.1,

[jira] [Closed] (SPARK-3829) Make Spark logo image on the header of HistoryPage as a link to HistoryPage's page #1

[ https://issues.apache.org/jira/browse/SPARK-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3829. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Assignee: Kousuke Saruta > M

[jira] [Created] (SPARK-3852) Document spark.driver.extra* configs

Andrew Or created SPARK-3852: Summary: Document spark.driver.extra* configs Key: SPARK-3852 URL: https://issues.apache.org/jira/browse/SPARK-3852 Project: Spark Issue Type: Bug Componen

[jira] [Created] (SPARK-3859) Use consistent config names for duration (with units!)

Andrew Or created SPARK-3859: Summary: Use consistent config names for duration (with units!) Key: SPARK-3859 URL: https://issues.apache.org/jira/browse/SPARK-3859 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-3859) Use consistent config names for duration (with units!)

[ https://issues.apache.org/jira/browse/SPARK-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3859: - Description: There are many configs in Spark that refer to some unit of time. However, from the first glan

[jira] [Closed] (SPARK-3844) Truncate appName in WebUI if it is too long

[ https://issues.apache.org/jira/browse/SPARK-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3844. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Target Version/s: 1.1.1,

[jira] [Updated] (SPARK-3795) Add scheduler hooks/heuristics for adding and removing executors

[ https://issues.apache.org/jira/browse/SPARK-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3795: - Affects Version/s: 1.1.0 > Add scheduler hooks/heuristics for adding and removing executors >

[jira] [Commented] (SPARK-3795) Add scheduler hooks/heuristics for adding and removing executors

[ https://issues.apache.org/jira/browse/SPARK-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167457#comment-14167457 ] Andrew Or commented on SPARK-3795: -- It's agnostic to the cluster manager, but for now we

[jira] [Commented] (SPARK-3445) Deprecate and later remove YARN alpha support

[ https://issues.apache.org/jira/browse/SPARK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14168753#comment-14168753 ] Andrew Or commented on SPARK-3445: -- Yes I have opened a PR to fix this: https://github.co

[jira] [Comment Edited] (SPARK-3445) Deprecate and later remove YARN alpha support

[ https://issues.apache.org/jira/browse/SPARK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14168754#comment-14168754 ] Andrew Or edited comment on SPARK-3445 at 10/12/14 7:17 PM: Lo

[jira] [Issue Comment Deleted] (SPARK-3445) Deprecate and later remove YARN alpha support

[ https://issues.apache.org/jira/browse/SPARK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3445: - Comment: was deleted (was: Looks like there are a few API difference across the different alpha branches

[jira] [Commented] (SPARK-3445) Deprecate and later remove YARN alpha support

[ https://issues.apache.org/jira/browse/SPARK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14168754#comment-14168754 ] Andrew Or commented on SPARK-3445: -- Looks like there are a few API difference across the

[jira] [Comment Edited] (SPARK-3445) Deprecate and later remove YARN alpha support

[ https://issues.apache.org/jira/browse/SPARK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14168753#comment-14168753 ] Andrew Or edited comment on SPARK-3445 at 10/12/14 7:17 PM: Ye

[jira] [Commented] (SPARK-3921) WorkerWatcher in Standalone mode fail to come up due to invalid workerUrl

[ https://issues.apache.org/jira/browse/SPARK-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169039#comment-14169039 ] Andrew Or commented on SPARK-3921: -- https://github.com/apache/spark/pull/2779 > WorkerWa

[jira] [Updated] (SPARK-3921) WorkerWatcher in Standalone mode fail to come up due to invalid workerUrl

[ https://issues.apache.org/jira/browse/SPARK-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3921: - Target Version/s: 1.2.0 Affects Version/s: 1.2.0 > WorkerWatcher in Standalone mode fail to come up d

[jira] [Issue Comment Deleted] (SPARK-3921) WorkerWatcher in Standalone mode fail to come up due to invalid workerUrl

[ https://issues.apache.org/jira/browse/SPARK-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3921: - Comment: was deleted (was: https://github.com/apache/spark/pull/2779) > WorkerWatcher in Standalone mode

[jira] [Comment Edited] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169830#comment-14169830 ] Andrew Or edited comment on SPARK-3174 at 10/13/14 7:45 PM: [~

[jira] [Comment Edited] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169830#comment-14169830 ] Andrew Or edited comment on SPARK-3174 at 10/13/14 7:45 PM: [~

[jira] [Comment Edited] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169830#comment-14169830 ] Andrew Or edited comment on SPARK-3174 at 10/13/14 7:45 PM: [~

[jira] [Commented] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169830#comment-14169830 ] Andrew Or commented on SPARK-3174: -- [~vanzin] bq. My first question I think is similar t

[jira] [Comment Edited] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169830#comment-14169830 ] Andrew Or edited comment on SPARK-3174 at 10/13/14 7:45 PM: [~

[jira] [Commented] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169856#comment-14169856 ] Andrew Or commented on SPARK-3174: -- [~sandyr] bq. Consider the (common) case of a user ke

[jira] [Commented] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14170244#comment-14170244 ] Andrew Or commented on SPARK-3174: -- @[~sandyr] by quick-start do you mean adding all exec

[jira] [Closed] (SPARK-3921) WorkerWatcher in Standalone mode fail to come up due to invalid workerUrl

[ https://issues.apache.org/jira/browse/SPARK-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3921. Resolution: Fixed Fix Version/s: 1.2.0 > WorkerWatcher in Standalone mode fail to come up due to inva

[jira] [Commented] (SPARK-3822) Expose a mechanism for SparkContext to ask for / remove Yarn containers

[ https://issues.apache.org/jira/browse/SPARK-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171221#comment-14171221 ] Andrew Or commented on SPARK-3822: -- Hey [~praveenseluka] thanks for your work on this. Ho

[jira] [Closed] (SPARK-3946) .gitignore in /python includes wrong directory.

[ https://issues.apache.org/jira/browse/SPARK-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3946. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Masayoshi TSUZUKI Target Versio

[jira] [Updated] (SPARK-3944) Utils.resolveURI fails on upgrading scalaVersion to 2.11.2

[ https://issues.apache.org/jira/browse/SPARK-3944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3944: - Component/s: Spark Core Target Version/s: 1.2.0 Affects Version/s: 1.1.0 Fix Version

[jira] [Closed] (SPARK-3944) Utils.resolveURI fails on upgrading scalaVersion to 2.11.2

[ https://issues.apache.org/jira/browse/SPARK-3944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3944. Resolution: Fixed > Utils.resolveURI fails on upgrading scalaVersion to 2.11.2 > ---

[jira] [Closed] (SPARK-3943) Some scripts bin\*.cmd pollutes environment variables in Windows.

[ https://issues.apache.org/jira/browse/SPARK-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3943. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Masayoshi TSUZUKI Target Versio

[jira] [Closed] (SPARK-2098) All Spark processes should support spark-defaults.conf, config file

[ https://issues.apache.org/jira/browse/SPARK-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2098. Resolution: Fixed Fix Version/s: 1.2.0 Target Version/s: 1.2.0 > All Spark processes should

[jira] [Commented] (SPARK-3957) Broadcast variable memory usage not reflected in UI

[ https://issues.apache.org/jira/browse/SPARK-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174019#comment-14174019 ] Andrew Or commented on SPARK-3957: -- Yeah my understanding is that broadcast blocks aren't

[jira] [Closed] (SPARK-1761) Add broadcast information on SparkUI storage tab

[ https://issues.apache.org/jira/browse/SPARK-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-1761. Resolution: Duplicate > Add broadcast information on SparkUI storage tab > -

[jira] [Commented] (SPARK-3957) Broadcast variable memory usage not reflected in UI

[ https://issues.apache.org/jira/browse/SPARK-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174024#comment-14174024 ] Andrew Or commented on SPARK-3957: -- Hey [~devl.development] are you planning to work on t

[jira] [Commented] (SPARK-1761) Add broadcast information on SparkUI storage tab

[ https://issues.apache.org/jira/browse/SPARK-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174026#comment-14174026 ] Andrew Or commented on SPARK-1761: -- Closing in favor of SPARK-3957, which is more descrip

[jira] [Closed] (SPARK-3923) All Standalone Mode services time out with each other

[ https://issues.apache.org/jira/browse/SPARK-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3923. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Aaron Davidson Target Version/s

[jira] [Closed] (SPARK-3941) _remainingMem should not increase twice when updateBlockInfo

[ https://issues.apache.org/jira/browse/SPARK-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3941. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Zhang, Liye Target Version/s: 1

[jira] [Updated] (SPARK-3890) remove redundant spark.executor.memory in doc

[ https://issues.apache.org/jira/browse/SPARK-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3890: - Affects Version/s: (was: 1.2.0) 1.1.0 > remove redundant spark.executor.memory

[jira] [Closed] (SPARK-3890) remove redundant spark.executor.memory in doc

[ https://issues.apache.org/jira/browse/SPARK-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3890. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Assignee: WangTao

[jira] [Updated] (SPARK-3890) remove redundant spark.executor.memory in doc

[ https://issues.apache.org/jira/browse/SPARK-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3890: - Affects Version/s: 1.2.0 > remove redundant spark.executor.memory in doc > ---

[jira] [Updated] (SPARK-3067) JobProgressPage could not show Fair Scheduler Pools section sometimes

[ https://issues.apache.org/jira/browse/SPARK-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3067: - Affects Version/s: 1.2.0 > JobProgressPage could not show Fair Scheduler Pools section sometimes > ---

[jira] [Closed] (SPARK-3067) JobProgressPage could not show Fair Scheduler Pools section sometimes

[ https://issues.apache.org/jira/browse/SPARK-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3067. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: YanTang Zhai > JobProgressPage could not sh

[jira] [Updated] (SPARK-3067) JobProgressPage could not show Fair Scheduler Pools section sometimes

[ https://issues.apache.org/jira/browse/SPARK-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3067: - Affects Version/s: (was: 1.2.0) 1.1.0 > JobProgressPage could not show Fair Sch

[jira] [Closed] (SPARK-3606) Spark-on-Yarn AmIpFilter does not work with Yarn HA.

[ https://issues.apache.org/jira/browse/SPARK-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3606. Resolution: Fixed Fix Version/s: 1.1.1 > Spark-on-Yarn AmIpFilter does not work with Yarn HA. > -

[jira] [Closed] (SPARK-3935) Unused variable in PairRDDFunctions.scala

[ https://issues.apache.org/jira/browse/SPARK-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3935. Resolution: Fixed Fix Version/s: 1.2.0 > Unused variable in PairRDDFunctions.scala >

[jira] [Closed] (SPARK-3935) Unused variable in PairRDDFunctions.scala

[ https://issues.apache.org/jira/browse/SPARK-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3935. Resolution: Fixed > Unused variable in PairRDDFunctions.scala > - >

[jira] [Reopened] (SPARK-3935) Unused variable in PairRDDFunctions.scala

[ https://issues.apache.org/jira/browse/SPARK-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-3935: -- Assignee: wangfei > Unused variable in PairRDDFunctions.scala > --

[jira] [Updated] (SPARK-3888) Limit the memory used by python worker

[ https://issues.apache.org/jira/browse/SPARK-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3888: - Affects Version/s: 1.1.0 > Limit the memory used by python worker > --

[jira] [Updated] (SPARK-3822) Expose a mechanism for SparkContext to ask for / remove Yarn containers

[ https://issues.apache.org/jira/browse/SPARK-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3822: - Affects Version/s: 1.1.0 > Expose a mechanism for SparkContext to ask for / remove Yarn containers > -

[jira] [Updated] (SPARK-4010) Spark UI returns 500 in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4010: - Affects Version/s: 1.2.0 > Spark UI returns 500 in yarn-client mode > ---

[jira] [Closed] (SPARK-4010) Spark UI returns 500 in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4010. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Target Version/s: 1.1.1,

[jira] [Created] (SPARK-4013) Do not create multiple actor systems on each executor

Andrew Or created SPARK-4013: Summary: Do not create multiple actor systems on each executor Key: SPARK-4013 URL: https://issues.apache.org/jira/browse/SPARK-4013 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4013) Do not create multiple actor systems on each executor

[ https://issues.apache.org/jira/browse/SPARK-4013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4013: - Description: This causes many more error messages to be logged on the driver than necessary when an execut

[jira] [Updated] (SPARK-4013) Do not run multiple actor systems on each executor

[ https://issues.apache.org/jira/browse/SPARK-4013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4013: - Summary: Do not run multiple actor systems on each executor (was: Do not create multiple actor systems on

[jira] [Created] (SPARK-4020) Failed executor not properly removed if it has not run tasks

Andrew Or created SPARK-4020: Summary: Failed executor not properly removed if it has not run tasks Key: SPARK-4020 URL: https://issues.apache.org/jira/browse/SPARK-4020 Project: Spark Issue Typ

[jira] [Closed] (SPARK-3994) countByKey / countByValue do not go through Aggregator

[ https://issues.apache.org/jira/browse/SPARK-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3994. Resolution: Fixed Fix Version/s: 1.2.0 Target Version/s: 1.2.0 > countByKey / countByValue

[jira] [Updated] (SPARK-3994) countByKey / countByValue do not go through Aggregator

[ https://issues.apache.org/jira/browse/SPARK-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3994: - Affects Version/s: (was: 1.1.0) 1.0.0 > countByKey / countByValue do not go thr

[jira] [Updated] (SPARK-3994) countByKey / countByValue do not go through Aggregator

[ https://issues.apache.org/jira/browse/SPARK-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3994: - Affects Version/s: 1.1.0 > countByKey / countByValue do not go through Aggregator > --

[jira] [Updated] (SPARK-3877) The exit code of spark-submit is still 0 when an yarn application fails

[ https://issues.apache.org/jira/browse/SPARK-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3877: - Target Version/s: 1.1.1, 1.2.0 Affects Version/s: 1.1.0 Fix Version/s: 1.2.0 Assi

[jira] [Updated] (SPARK-3877) The exit code of spark-submit is still 0 when an yarn application fails

[ https://issues.apache.org/jira/browse/SPARK-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3877: - Priority: Major (was: Minor) > The exit code of spark-submit is still 0 when an yarn application fails >

[jira] [Closed] (SPARK-3877) The exit code of spark-submit is still 0 when an yarn application fails

[ https://issues.apache.org/jira/browse/SPARK-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3877. Resolution: Fixed Fix Version/s: 1.1.1 > The exit code of spark-submit is still 0 when an yarn applic

[jira] [Updated] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4006: - Fix Version/s: 1.2.0 > Spark Driver crashes whenever an Executor is registered twice > ---

[jira] [Updated] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4006: - Assignee: Tal Sliwowicz > Spark Driver crashes whenever an Executor is registered twice >

[jira] [Created] (SPARK-4071) Unroll fails silently if BlockManager size is small

Andrew Or created SPARK-4071: Summary: Unroll fails silently if BlockManager size is small Key: SPARK-4071 URL: https://issues.apache.org/jira/browse/SPARK-4071 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4071) Unroll fails silently if BlockManager size is small

[ https://issues.apache.org/jira/browse/SPARK-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4071: - Description: In tests, we may want to have BlockManagers of size < 1MB (spark.storage.unrollMemoryThreshol

[jira] [Closed] (SPARK-2713) Executors of same application in same host should only download files & jars once

[ https://issues.apache.org/jira/browse/SPARK-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2713. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Zhihui Target Version/s: 1.2.0

[jira] [Closed] (SPARK-4076) Parameter expansion in spark-config is wrong

[ https://issues.apache.org/jira/browse/SPARK-4076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4076. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Kousuke Saruta > Parameter expansion in spa

[jira] [Closed] (SPARK-4075) Jar url validation is not enough for Jar file

[ https://issues.apache.org/jira/browse/SPARK-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4075. Resolution: Fixed Fix Version/s: 1.1.1 Assignee: Kousuke Saruta Target Version/s

[jira] [Closed] (SPARK-4013) Do not run multiple actor systems on each executor

[ https://issues.apache.org/jira/browse/SPARK-4013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4013. Resolution: Fixed Fix Version/s: 1.2.0 > Do not run multiple actor systems on each executor > ---

[jira] [Updated] (SPARK-4067) refactor ExecutorUncaughtExceptionHandler as a general one as it is used like this

[ https://issues.apache.org/jira/browse/SPARK-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4067: - Component/s: Spark Core > refactor ExecutorUncaughtExceptionHandler as a general one as it is used like >

[jira] [Closed] (SPARK-4067) refactor ExecutorUncaughtExceptionHandler as a general one as it is used like this

[ https://issues.apache.org/jira/browse/SPARK-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4067. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Nan Zhu Target Version/s: 1.2.0

[jira] [Updated] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4006: - Fix Version/s: 1.1.1 > Spark Driver crashes whenever an Executor is registered twice > ---

[jira] [Commented] (SPARK-2105) SparkUI doesn't remove active stages that failed

[ https://issues.apache.org/jira/browse/SPARK-2105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14184620#comment-14184620 ] Andrew Or commented on SPARK-2105: -- Hey Josh I think this was fixed by this commit: https

[jira] [Updated] (SPARK-3970) Remove duplicate removal of local dirs

[ https://issues.apache.org/jira/browse/SPARK-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3970: - Affects Version/s: 1.1.0 > Remove duplicate removal of local dirs > --

[jira] [Updated] (SPARK-3970) Remove duplicate removal of local dirs

[ https://issues.apache.org/jira/browse/SPARK-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3970: - Assignee: Liang-Chi Hsieh > Remove duplicate removal of local dirs > -

[jira] [Closed] (SPARK-3970) Remove duplicate removal of local dirs

[ https://issues.apache.org/jira/browse/SPARK-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3970. Resolution: Fixed Fix Version/s: 1.2.0 Target Version/s: 1.2.0 > Remove duplicate removal o

[jira] [Updated] (SPARK-3611) Show number of cores for each executor in application web UI

[ https://issues.apache.org/jira/browse/SPARK-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3611: - Affects Version/s: 1.0.0 > Show number of cores for each executor in application web UI >

[jira] [Closed] (SPARK-4110) Wrong comments about default settings in spark-daemon.sh

[ https://issues.apache.org/jira/browse/SPARK-4110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4110. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Assignee: Kousuke

[jira] [Updated] (SPARK-4096) let ApplicationMaster accept executor memory argument in same format as JVM memory strings

[ https://issues.apache.org/jira/browse/SPARK-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4096: - Affects Version/s: 1.1.0 > let ApplicationMaster accept executor memory argument in same format as JVM >

[jira] [Closed] (SPARK-4096) let ApplicationMaster accept executor memory argument in same format as JVM memory strings

[ https://issues.apache.org/jira/browse/SPARK-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4096. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: WangTaoTheTonic Target Version/

[jira] [Closed] (SPARK-3657) yarn alpha YarnRMClientImpl throws NPE appMasterRequest.setTrackingUrl starting spark-shell

[ https://issues.apache.org/jira/browse/SPARK-3657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3657. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Kousuke Saruta > yarn alpha YarnRMClientImp

[jira] [Closed] (SPARK-4089) The version number of Spark in _config.yaml is wrong.

[ https://issues.apache.org/jira/browse/SPARK-4089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4089. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Kousuke Saruta > The version number of Spar

[jira] [Closed] (SPARK-4065) pyspark will not use ipython on Windows

[ https://issues.apache.org/jira/browse/SPARK-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4065. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Target Version/s: 1.1.1,

[jira] [Updated] (SPARK-4065) pyspark will not use ipython on Windows

[ https://issues.apache.org/jira/browse/SPARK-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4065: - Assignee: Michael Griffiths > pyspark will not use ipython on Windows > --

[jira] [Closed] (SPARK-4058) Log file name is hard coded even though there is a variable '$LOG_FILE '

[ https://issues.apache.org/jira/browse/SPARK-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4058. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Kousuke Saruta > Log file name is hard code

[jira] [Created] (SPARK-4126) Do not set `spark.executor.instances` if not needed (yarn-cluster)

Andrew Or created SPARK-4126: Summary: Do not set `spark.executor.instances` if not needed (yarn-cluster) Key: SPARK-4126 URL: https://issues.apache.org/jira/browse/SPARK-4126 Project: Spark Iss

[jira] [Created] (SPARK-4134) Tone down scary executor lost messages when killing on purpose

Andrew Or created SPARK-4134: Summary: Tone down scary executor lost messages when killing on purpose Key: SPARK-4134 URL: https://issues.apache.org/jira/browse/SPARK-4134 Project: Spark Issue T

[jira] [Updated] (SPARK-4136) Under dynamic allocation, cancel outstanding executor requests when pending task queue is empty

[ https://issues.apache.org/jira/browse/SPARK-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4136: - Affects Version/s: (was: 1.1.0) 1.2.0 > Under dynamic allocation, cancel outsta

<    1   2   3   4   5   6   7   8   9   10   >