[jira] [Updated] (SPARK-10192) Test for fetch failure in a shared dependency for "skipped" stages

[ https://issues.apache.org/jira/browse/SPARK-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10192: -- Component/s: (was: Spark Core) Scheduler > Test for fetch failure in a shared depe

[jira] [Updated] (SPARK-10372) Add end-to-end tests for the scheduling code

[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10372: -- Fix Version/s: (was: 1.6.0) > Add end-to-end tests for the scheduling code > --

[jira] [Updated] (SPARK-10372) Add end-to-end tests for the scheduler

[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10372: -- Summary: Add end-to-end tests for the scheduler (was: Tests for entire scheduler) > Add end-to-end te

[jira] [Updated] (SPARK-10192) Test for fetch failure in a shared dependency for "skipped" stages

[ https://issues.apache.org/jira/browse/SPARK-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10192: -- Issue Type: Sub-task (was: Test) Parent: SPARK-8987 > Test for fetch failure in a shared depen

[jira] [Updated] (SPARK-10192) Test for fetch failure in a shared dependency for "skipped" stages

[ https://issues.apache.org/jira/browse/SPARK-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10192: -- Component/s: Tests > Test for fetch failure in a shared dependency for "skipped" stages > -

[jira] [Updated] (SPARK-10372) Add end-to-end tests for the scheduling code

[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10372: -- Summary: Add end-to-end tests for the scheduling code (was: Add end-to-end tests for the scheduler) >

[jira] [Updated] (SPARK-8987) Increase test coverage of DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8987: - Issue Type: Umbrella (was: Bug) > Increase test coverage of DAGScheduler > --

[jira] [Updated] (SPARK-10372) Tests for entire scheduler

[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10372: -- Issue Type: Sub-task (was: Test) Parent: SPARK-8987 > Tests for entire scheduler > ---

[jira] [Updated] (SPARK-10144) Actually show peak execution memory on UI by default

[ https://issues.apache.org/jira/browse/SPARK-10144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10144: -- Summary: Actually show peak execution memory on UI by default (was: Actually show peak execution memor

[jira] [Created] (SPARK-10144) Actually show peak execution memory by default

Andrew Or created SPARK-10144: - Summary: Actually show peak execution memory by default Key: SPARK-10144 URL: https://issues.apache.org/jira/browse/SPARK-10144 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4134) Dynamic allocation: tone down scary executor lost messages when killing on purpose

[ https://issues.apache.org/jira/browse/SPARK-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4134: - Target Version/s: 1.6.0 (was: 1.5.0) > Dynamic allocation: tone down scary executor lost messages when ki

[jira] [Closed] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

[ https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10124. - Resolution: Fixed Fix Version/s: 1.5.0 > Mesos cluster mode causes exception when multiple spark a

[jira] [Updated] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

[ https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10124: -- Assignee: Timothy Chen > Mesos cluster mode causes exception when multiple spark apps are being > sche

[jira] [Commented] (SPARK-8469) Application timeline view unreadable with many executors

[ https://issues.apache.org/jira/browse/SPARK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702511#comment-14702511 ] Andrew Or commented on SPARK-8469: -- I've spoken with a few actual dynamic allocation user

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Fix Version/s: 1.6.0 > Exception not failing Python applications (in yarn cluster mode) >

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Target Version/s: 1.6.0, 1.5.1 (was: 1.6.0) > Exception not failing Python applications (in yarn cluster

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Target Version/s: 1.6.0 (was: 1.5.1) > Exception not failing Python applications (in yarn cluster mode) >

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Fix Version/s: (was: 1.6.0) > Exception not failing Python applications (in yarn cluster mode) > -

[jira] [Updated] (SPARK-10058) Flaky test: HeartbeatReceiverSuite: normal heartbeat

[ https://issues.apache.org/jira/browse/SPARK-10058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10058: -- Labels: flaky-test (was: ) > Flaky test: HeartbeatReceiverSuite: normal heartbeat > --

[jira] [Updated] (SPARK-10058) Flaky test: HeartbeatReceiverSuite: normal heartbeat

[ https://issues.apache.org/jira/browse/SPARK-10058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10058: -- Priority: Critical (was: Major) > Flaky test: HeartbeatReceiverSuite: normal heartbeat > -

[jira] [Updated] (SPARK-10003) Improve readability of DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10003: -- Description: There are many opportunities for improving DAGScheduler's readability. This issue will rep

[jira] [Created] (SPARK-10003) Improve readability of DAGScheduler

Andrew Or created SPARK-10003: - Summary: Improve readability of DAGScheduler Key: SPARK-10003 URL: https://issues.apache.org/jira/browse/SPARK-10003 Project: Spark Issue Type: Bug Compo

[jira] [Closed] (SPARK-9877) StandaloneRestServer NPE when submitting application

[ https://issues.apache.org/jira/browse/SPARK-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9877. Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 1.5.0 > StandaloneRestServer NPE when

[jira] [Resolved] (SPARK-9948) Flaky test: o.a.s.AccumulatorSuite - internal accumulators

[ https://issues.apache.org/jira/browse/SPARK-9948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9948. -- Resolution: Fixed Fix Version/s: 1.5.0 > Flaky test: o.a.s.AccumulatorSuite - internal accumulato

[jira] [Resolved] (SPARK-9809) Task crashes because the internal accumulators are not properly initialized

[ https://issues.apache.org/jira/browse/SPARK-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9809. -- Resolution: Fixed Assignee: Carson Wang Fix Version/s: 1.5.0 Target Version/

[jira] [Updated] (SPARK-9948) Flaky test: o.a.s.AccumulatorSuite - internal accumulators

[ https://issues.apache.org/jira/browse/SPARK-9948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9948: - Issue Type: Test (was: Bug) > Flaky test: o.a.s.AccumulatorSuite - internal accumulators > --

[jira] [Updated] (SPARK-9948) Flaky test: o.a.s.AccumulatorSuite - internal accumulators

[ https://issues.apache.org/jira/browse/SPARK-9948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9948: - Summary: Flaky test: o.a.s.AccumulatorSuite - internal accumulators (was: Flaky test: org.apache.spark.Ac

[jira] [Updated] (SPARK-9948) Flaky test: o.a.s.AccumulatorSuite - internal accumulators

[ https://issues.apache.org/jira/browse/SPARK-9948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9948: - Labels: flaky-test (was: ) > Flaky test: o.a.s.AccumulatorSuite - internal accumulators > ---

[jira] [Updated] (SPARK-9948) Flaky test: org.apache.spark.AccumulatorSuite - internal accumulators

[ https://issues.apache.org/jira/browse/SPARK-9948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9948: - Summary: Flaky test: org.apache.spark.AccumulatorSuite - internal accumulators (was: Flaky test: org.apac

[jira] [Created] (SPARK-9948) Flaky test: org.apache.spark.AccumulatorSuite - internal accumulators in fully resubmitted stages

Andrew Or created SPARK-9948: Summary: Flaky test: org.apache.spark.AccumulatorSuite - internal accumulators in fully resubmitted stages Key: SPARK-9948 URL: https://issues.apache.org/jira/browse/SPARK-9948

[jira] [Commented] (SPARK-9649) Flaky test: o.a.s.deploy.master.MasterSuite: recovery

[ https://issues.apache.org/jira/browse/SPARK-9649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695744#comment-14695744 ] Andrew Or commented on SPARK-9649: -- Also resolved by commit: 8815ba2f674dbb18eb499216df99

[jira] [Updated] (SPARK-9877) StandaloneRestServer NPE when submitting application

[ https://issues.apache.org/jira/browse/SPARK-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9877: - Target Version/s: 1.5.0 > StandaloneRestServer NPE when submitting application > -

[jira] [Updated] (SPARK-9877) StandaloneRestServer NPE when submitting application

[ https://issues.apache.org/jira/browse/SPARK-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9877: - Priority: Blocker (was: Major) > StandaloneRestServer NPE when submitting application > -

[jira] [Updated] (SPARK-9877) StandaloneRestServer NPE when submitting application

[ https://issues.apache.org/jira/browse/SPARK-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9877: - Affects Version/s: (was: 1.4.1) > StandaloneRestServer NPE when submitting application > -

[jira] [Updated] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8167: - Target Version/s: 1.6.0 Fix Version/s: (was: 1.6.0) > Tasks that fail due to YARN preemption ca

[jira] [Closed] (SPARK-9870) Disable driver UI and Master REST server in SparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-9870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9870. Resolution: Fixed Fix Version/s: 1.5.0 > Disable driver UI and Master REST server in SparkSubmitSuite

[jira] [Commented] (SPARK-9795) Dynamic allocation: avoid double counting when killing same executor twice

[ https://issues.apache.org/jira/browse/SPARK-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14693773#comment-14693773 ] Andrew Or commented on SPARK-9795: -- Looks like this did resolve SPARK-9745. Closing that

[jira] [Resolved] (SPARK-9745) Applications hangs when the last executor fails with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9745. -- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Applications hangs whe

[jira] [Resolved] (SPARK-9795) Dynamic allocation: avoid double counting when killing same executor twice

[ https://issues.apache.org/jira/browse/SPARK-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9795. -- Resolution: Fixed Fix Version/s: 1.5.0 > Dynamic allocation: avoid double counting when killing s

[jira] [Commented] (SPARK-8119) HeartbeatReceiver should not adjust application executor resources

[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14693738#comment-14693738 ] Andrew Or commented on SPARK-8119: -- It will be in 1.4.2. I just need to backport it. > H

[jira] [Closed] (SPARK-7373) Support launching Spark drivers in Docker images with Mesos cluster mode

[ https://issues.apache.org/jira/browse/SPARK-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7373. Resolution: Fixed Assignee: Timothy Chen Fix Version/s: 1.4.0 Target Version/s:

[jira] [Commented] (SPARK-9575) Add documentation around Mesos shuffle service and dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-9575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14693009#comment-14693009 ] Andrew Or commented on SPARK-9575: -- Hey [~tnachen] can you start putting in the target ve

[jira] [Updated] (SPARK-9575) Add documentation around Mesos shuffle service and dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-9575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9575: - Component/s: Documentation > Add documentation around Mesos shuffle service and dynamic allocation > -

[jira] [Closed] (SPARK-9575) Add documentation around Mesos shuffle service and dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-9575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9575. Resolution: Fixed Assignee: Timothy Chen Fix Version/s: 1.5.0 Target Version/s:

[jira] [Updated] (SPARK-8798) Allow additional uris to be fetched with mesos

[ https://issues.apache.org/jira/browse/SPARK-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8798: - Issue Type: New Feature (was: Bug) > Allow additional uris to be fetched with mesos > ---

[jira] [Resolved] (SPARK-8798) Allow additional uris to be fetched with mesos

[ https://issues.apache.org/jira/browse/SPARK-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-8798. -- Resolution: Fixed Assignee: Timothy Chen Target Version/s: 1.5.0 > Allow additiona

[jira] [Resolved] (SPARK-9426) Job page DAG visualization is not shown

[ https://issues.apache.org/jira/browse/SPARK-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9426. -- Resolution: Fixed Fix Version/s: 1.5.0 > Job page DAG visualization is not shown > --

[jira] [Updated] (SPARK-9426) Job page DAG visualization is not shown

[ https://issues.apache.org/jira/browse/SPARK-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9426: - Assignee: Carson Wang > Job page DAG visualization is not shown > ---

[jira] [Updated] (SPARK-9829) peakExecutionMemory is not correct in task table

[ https://issues.apache.org/jira/browse/SPARK-9829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9829: - Summary: peakExecutionMemory is not correct in task table (was: peakExecutionMemory is not correct) > pe

[jira] [Closed] (SPARK-9829) peakExecutionMemory is not correct in task table

[ https://issues.apache.org/jira/browse/SPARK-9829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9829. Resolution: Fixed Fix Version/s: 1.5.0 > peakExecutionMemory is not correct in task table > -

[jira] [Closed] (SPARK-9806) Don't share ReplayListenerBus between multiple applications

[ https://issues.apache.org/jira/browse/SPARK-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9806. Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 Target Version/s: 1.4.2,

[jira] [Updated] (SPARK-9806) Don't share ReplayListenerBus between multiple applications

[ https://issues.apache.org/jira/browse/SPARK-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9806: - Assignee: Rohit Agarwal > Don't share ReplayListenerBus between multiple applications > --

[jira] [Closed] (SPARK-8366) maxNumExecutorsNeeded should properly handle failed tasks

[ https://issues.apache.org/jira/browse/SPARK-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8366. Resolution: Fixed Assignee: meiyoula Fix Version/s: 1.5.0 Target Version/s: 1.5.

[jira] [Commented] (SPARK-9745) Applications hangs when the last executor fails with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14692894#comment-14692894 ] Andrew Or commented on SPARK-9745: -- Great!! This will be fixed in 1.5.0. The PR that will

[jira] [Updated] (SPARK-8115) Remove TestData

[ https://issues.apache.org/jira/browse/SPARK-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8115: - Assignee: Andrew Or > Remove TestData > --- > > Key: SPARK-8115 >

[jira] [Updated] (SPARK-8115) Remove TestData

[ https://issues.apache.org/jira/browse/SPARK-8115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8115: - Target Version/s: 1.5.0 > Remove TestData > --- > > Key: SPARK-8115 >

[jira] [Resolved] (SPARK-8114) Remove wildcard import on TestSQLContext._

[ https://issues.apache.org/jira/browse/SPARK-8114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-8114. -- Resolution: Fixed > Remove wildcard import on TestSQLContext._ > ---

[jira] [Updated] (SPARK-8109) TestSQLContext's static initialization is run during MiMa tests, causing SparkContexts to be created

[ https://issues.apache.org/jira/browse/SPARK-8109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8109: - Assignee: Andrew Or > TestSQLContext's static initialization is run during MiMa tests, causing > SparkCon

[jira] [Closed] (SPARK-8114) Remove wildcard import on TestSQLContext._

[ https://issues.apache.org/jira/browse/SPARK-8114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8114. Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 1.5.0 Target Version/s: 1

[jira] [Reopened] (SPARK-8114) Remove wildcard import on TestSQLContext._

[ https://issues.apache.org/jira/browse/SPARK-8114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-8114: -- > Remove wildcard import on TestSQLContext._ > -- > >

[jira] [Updated] (SPARK-9580) Refactor TestSQLContext to make it non-singleton

[ https://issues.apache.org/jira/browse/SPARK-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9580: - Issue Type: Sub-task (was: Bug) Parent: SPARK-8113 > Refactor TestSQLContext to make it non-singl

[jira] [Updated] (SPARK-8113) SQL module test cleanup

[ https://issues.apache.org/jira/browse/SPARK-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8113: - Priority: Major (was: Minor) > SQL module test cleanup > --- > > Key:

[jira] [Reopened] (SPARK-9649) Flaky test: o.a.s.deploy.master.MasterSuite: recovery

[ https://issues.apache.org/jira/browse/SPARK-9649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-9649: -- Seeing this again in master branch https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-SBT/3207/AMPLAB_

[jira] [Updated] (SPARK-9795) Dynamic allocation: avoid double counting when killing same executor twice

[ https://issues.apache.org/jira/browse/SPARK-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9795: - Summary: Dynamic allocation: avoid double counting when killing same executor twice (was: Dynamic allocat

[jira] [Created] (SPARK-9795) Dynamic allocation: avoid double counting when killing same executor

Andrew Or created SPARK-9795: Summary: Dynamic allocation: avoid double counting when killing same executor Key: SPARK-9795 URL: https://issues.apache.org/jira/browse/SPARK-9795 Project: Spark I

[jira] [Closed] (SPARK-9731) Standalone scheduling incorrect cores if spark.executor.cores is not set

[ https://issues.apache.org/jira/browse/SPARK-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9731. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Standalone scheduling inco

[jira] [Updated] (SPARK-9375) The total number of executor(s) requested by the driver may be negative

[ https://issues.apache.org/jira/browse/SPARK-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9375: - Assignee: KaiXinXIaoLei > The total number of executor(s) requested by the driver may be negative >

[jira] [Updated] (SPARK-9745) Applications hangs when the last executor fails with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9745: - Priority: Blocker (was: Critical) > Applications hangs when the last executor fails with dynamic allocati

[jira] [Updated] (SPARK-9375) The total number of executor(s) requested by the driver may be negative

[ https://issues.apache.org/jira/browse/SPARK-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9375: - Priority: Critical (was: Major) > The total number of executor(s) requested by the driver may be negati

[jira] [Commented] (SPARK-9677) Enable SQLQuerySuite."aggregation with codegen updates peak execution memory"

[ https://issues.apache.org/jira/browse/SPARK-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662494#comment-14662494 ] Andrew Or commented on SPARK-9677: -- Resolved by https://github.com/apache/spark/pull/8015

[jira] [Closed] (SPARK-9677) Enable SQLQuerySuite."aggregation with codegen updates peak execution memory"

[ https://issues.apache.org/jira/browse/SPARK-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9677. Resolution: Fixed Fix Version/s: 1.5.0 > Enable SQLQuerySuite."aggregation with codegen updates peak

[jira] [Created] (SPARK-9747) Avoid starving an unsafe operator in an aggregate

Andrew Or created SPARK-9747: Summary: Avoid starving an unsafe operator in an aggregate Key: SPARK-9747 URL: https://issues.apache.org/jira/browse/SPARK-9747 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-9693) Reserve a page in all unsafe operators to avoid starving an operator

[ https://issues.apache.org/jira/browse/SPARK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9693: - Priority: Blocker (was: Critical) > Reserve a page in all unsafe operators to avoid starving an operator

[jira] [Updated] (SPARK-9709) Avoid starving an unsafe operator in a sort

[ https://issues.apache.org/jira/browse/SPARK-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9709: - Priority: Blocker (was: Critical) > Avoid starving an unsafe operator in a sort > ---

[jira] [Updated] (SPARK-9731) Standalone scheduling incorrect cores if spark.executor.cores is not set

[ https://issues.apache.org/jira/browse/SPARK-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9731: - Assignee: Carson Wang > Standalone scheduling incorrect cores if spark.executor.cores is not set > ---

[jira] [Commented] (SPARK-9731) Standalone scheduling incorrect cores if spark.executor.cores is not set

[ https://issues.apache.org/jira/browse/SPARK-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662124#comment-14662124 ] Andrew Or commented on SPARK-9731: -- This was already fixed in SPARK-9353 but was re-intro

[jira] [Updated] (SPARK-9731) Standalone scheduling incorrect cores if spark.executor.cores is not set

[ https://issues.apache.org/jira/browse/SPARK-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9731: - Priority: Blocker (was: Major) > Standalone scheduling incorrect cores if spark.executor.cores is not set

[jira] [Closed] (SPARK-9353) Standalone scheduling memory requirement incorrect if cores per executor is not set

[ https://issues.apache.org/jira/browse/SPARK-9353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9353. Resolution: Fixed Fix Version/s: 1.4.2 > Standalone scheduling memory requirement incorrect if cores

[jira] [Created] (SPARK-9709) Avoid starving an unsafe operator in a sort

Andrew Or created SPARK-9709: Summary: Avoid starving an unsafe operator in a sort Key: SPARK-9709 URL: https://issues.apache.org/jira/browse/SPARK-9709 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-9693) Reserve a page in all unsafe operators to avoid starving an operator

[ https://issues.apache.org/jira/browse/SPARK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9693: - Description: E.g. currently we can do up to 3 sorts within a task: (1) During the aggregation (2) During

[jira] [Updated] (SPARK-9693) Reserve a page in all unsafe operators to avoid starving an operator

[ https://issues.apache.org/jira/browse/SPARK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9693: - Description: E.g. currently we can do up to 3 sorts within a task: (1) During the aggregation (2) During

[jira] [Updated] (SPARK-9693) Reserve a page in all unsafe operators to avoid starving an operator

[ https://issues.apache.org/jira/browse/SPARK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9693: - Summary: Reserve a page in all unsafe operators to avoid starving an operator (was: Reserve a page in all

[jira] [Updated] (SPARK-9693) Reserve a page in all unsafe operators to avoid starving an operator

[ https://issues.apache.org/jira/browse/SPARK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9693: - Description: E.g. Currently we can do up to 3 sorts within a task: (1) During the aggregation (2) During

[jira] [Updated] (SPARK-9693) Reserve a page in all sorters to avoid starving an operator

[ https://issues.apache.org/jira/browse/SPARK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9693: - Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-7075) > Reserve a page in all sor

[jira] [Created] (SPARK-9693) Reserve a page in all sorters to avoid starving an operator

Andrew Or created SPARK-9693: Summary: Reserve a page in all sorters to avoid starving an operator Key: SPARK-9693 URL: https://issues.apache.org/jira/browse/SPARK-9693 Project: Spark Issue Type

[jira] [Updated] (SPARK-9677) Enable SQLQuerySuite."aggregation with codegen updates peak execution memory"

[ https://issues.apache.org/jira/browse/SPARK-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9677: - Priority: Blocker (was: Critical) > Enable SQLQuerySuite."aggregation with codegen updates peak execution

[jira] [Created] (SPARK-9649) Flaky test: o.a.s.deploy.master.MasterSuite: recovery

Andrew Or created SPARK-9649: Summary: Flaky test: o.a.s.deploy.master.MasterSuite: recovery Key: SPARK-9649 URL: https://issues.apache.org/jira/browse/SPARK-9649 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9580) Refactor TestSQLContext to make it non-singleton

Andrew Or created SPARK-9580: Summary: Refactor TestSQLContext to make it non-singleton Key: SPARK-9580 URL: https://issues.apache.org/jira/browse/SPARK-9580 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8735) Expose metrics for runtime memory usage

[ https://issues.apache.org/jira/browse/SPARK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8735: - Component/s: SQL > Expose metrics for runtime memory usage > --- > >

[jira] [Updated] (SPARK-8735) Expose metrics for runtime memory usage

[ https://issues.apache.org/jira/browse/SPARK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8735: - Priority: Blocker (was: Major) > Expose metrics for runtime memory usage > --

[jira] [Created] (SPARK-9561) Enable BroadcastJoinSuite

Andrew Or created SPARK-9561: Summary: Enable BroadcastJoinSuite Key: SPARK-9561 URL: https://issues.apache.org/jira/browse/SPARK-9561 Project: Spark Issue Type: Bug Components: SQL, Te

[jira] [Closed] (SPARK-8873) Support cleaning up shuffle files when using shuffle service in Mesos

[ https://issues.apache.org/jira/browse/SPARK-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8873. Resolution: Fixed Fix Version/s: 1.5.0 > Support cleaning up shuffle files when using shuffle service

[jira] [Closed] (SPARK-4751) Support dynamic allocation for standalone mode

[ https://issues.apache.org/jira/browse/SPARK-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4751. Resolution: Fixed Fix Version/s: 1.5.0 > Support dynamic allocation for standalone mode > ---

[jira] [Updated] (SPARK-8873) Support cleaning up shuffle files when using shuffle service in Mesos

[ https://issues.apache.org/jira/browse/SPARK-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8873: - Priority: Blocker (was: Critical) > Support cleaning up shuffle files when using shuffle service in Mesos

[jira] [Updated] (SPARK-9450) HashedRelation.get() could return an Iterator[Row] instead of Seq[Row]

[ https://issues.apache.org/jira/browse/SPARK-9450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9450: - Target Version/s: 1.5.0 > HashedRelation.get() could return an Iterator[Row] instead of Seq[Row] > ---

[jira] [Updated] (SPARK-9450) HashedRelation.get() could return an Iterator[Row] instead of Seq[Row]

[ https://issues.apache.org/jira/browse/SPARK-9450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9450: - Assignee: Andrew Or > HashedRelation.get() could return an Iterator[Row] instead of Seq[Row] > ---

[jira] [Commented] (SPARK-8414) Ensure ContextCleaner actually triggers clean ups

[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646487#comment-14646487 ] Andrew Or commented on SPARK-8414: -- Oops, you're right. I always mix them up... > Ensure

[jira] [Closed] (SPARK-9352) Add tests for standalone scheduling code

[ https://issues.apache.org/jira/browse/SPARK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-9352. Resolution: Fixed Fix Version/s: 1.4.2 > Add tests for standalone scheduling code > -

[jira] [Updated] (SPARK-9352) Add tests for standalone scheduling code

[ https://issues.apache.org/jira/browse/SPARK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9352: - Labels: (was: backport-needed) > Add tests for standalone scheduling code >

[jira] [Commented] (SPARK-9352) Add tests for standalone scheduling code

[ https://issues.apache.org/jira/browse/SPARK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646486#comment-14646486 ] Andrew Or commented on SPARK-9352: -- This is actually already fixed. It was reverted at on

<    6   7   8   9   10   11   12   13   14   15   >