[jira] [Updated] (SPARK-9997) Create local Expand operator

[ https://issues.apache.org/jira/browse/SPARK-9997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9997: - Assignee: Shixiong Zhu > Create local Expand operator > > >

[jira] [Updated] (SPARK-9996) Create local nested loop join operator

[ https://issues.apache.org/jira/browse/SPARK-9996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9996: - Assignee: Shixiong Zhu > Create local nested loop join operator > --

[jira] [Updated] (SPARK-9992) Create local sample operator

[ https://issues.apache.org/jira/browse/SPARK-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9992: - Assignee: Shixiong Zhu > Create local sample operator > > >

[jira] [Updated] (SPARK-9994) Create local TopK operator

[ https://issues.apache.org/jira/browse/SPARK-9994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9994: - Assignee: Shixiong Zhu > Create local TopK operator > -- > > Key:

[jira] [Updated] (SPARK-9990) Create local hash join operator

[ https://issues.apache.org/jira/browse/SPARK-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9990: - Assignee: Shixiong Zhu > Create local hash join operator > --- > >

[jira] [Created] (SPARK-10450) Minor SQL style, format, typo, readability fixes

Andrew Or created SPARK-10450: - Summary: Minor SQL style, format, typo, readability fixes Key: SPARK-10450 URL: https://issues.apache.org/jira/browse/SPARK-10450 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-9925) Set SQLConf.SHUFFLE_PARTITIONS.key correctly for tests

[ https://issues.apache.org/jira/browse/SPARK-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9925. -- Resolution: Fixed Fix Version/s: 1.6.0 > Set SQLConf.SHUFFLE_PARTITIONS.key correctly for tests

[jira] [Resolved] (SPARK-10450) Minor SQL style, format, typo, readability fixes

[ https://issues.apache.org/jira/browse/SPARK-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10450. --- Resolution: Fixed Fix Version/s: 1.6.0 > Minor SQL style, format, typo, readability fixes >

[jira] [Updated] (SPARK-10176) Show partially analyzed plan when checkAnswer df fails to resolve

[ https://issues.apache.org/jira/browse/SPARK-10176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10176: -- Target Version/s: 1.6.0 (was: 1.5.0) > Show partially analyzed plan when checkAnswer df fails to

[jira] [Updated] (SPARK-10176) Show partially analyzed plan when checkAnswer df fails to resolve

[ https://issues.apache.org/jira/browse/SPARK-10176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10176: -- Fix Version/s: (was: 1.5.0) 1.6.0 > Show partially analyzed plan when

[jira] [Resolved] (SPARK-10176) Show partially analyzed plan when checkAnswer df fails to resolve

[ https://issues.apache.org/jira/browse/SPARK-10176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10176. --- Resolution: Fixed Fix Version/s: 1.5.0 > Show partially analyzed plan when checkAnswer df

[jira] [Resolved] (SPARK-9669) Support PySpark with Mesos Cluster mode

[ https://issues.apache.org/jira/browse/SPARK-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9669. -- Resolution: Fixed Fix Version/s: 1.6.0 > Support PySpark with Mesos Cluster mode >

[jira] [Resolved] (SPARK-10454) Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't cause multiple concurrent attempts for the same map stage

[ https://issues.apache.org/jira/browse/SPARK-10454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10454. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 Target Version/s:

[jira] [Updated] (SPARK-10454) Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't cause multiple concurrent attempts for the same map stage

[ https://issues.apache.org/jira/browse/SPARK-10454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10454: -- Assignee: Pete Robbins > Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't cause

[jira] [Updated] (SPARK-10454) Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't cause multiple concurrent attempts for the same map stage

[ https://issues.apache.org/jira/browse/SPARK-10454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10454: -- Labels: flaky-test (was: ) > Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't

[jira] [Updated] (SPARK-10454) Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't cause multiple concurrent attempts for the same map stage

[ https://issues.apache.org/jira/browse/SPARK-10454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10454: -- Priority: Critical (was: Minor) > Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures

[jira] [Updated] (SPARK-10431) Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics with cache and coalesce

[ https://issues.apache.org/jira/browse/SPARK-10431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10431: -- Assignee: Pete Robbins > Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics with cache

[jira] [Updated] (SPARK-10431) Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics with cache and coalesce

[ https://issues.apache.org/jira/browse/SPARK-10431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10431: -- Priority: Critical (was: Minor) > Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics

[jira] [Updated] (SPARK-10431) Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics with cache and coalesce

[ https://issues.apache.org/jira/browse/SPARK-10431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10431: -- Component/s: (was: Spark Core) Tests > Flaky test:

[jira] [Updated] (SPARK-10431) Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics with cache and coalesce

[ https://issues.apache.org/jira/browse/SPARK-10431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10431: -- Summary: Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics with cache and coalesce

[jira] [Created] (SPARK-10435) SparkSubmit should fail fast for Mesos cluster mode with R

Andrew Or created SPARK-10435: - Summary: SparkSubmit should fail fast for Mesos cluster mode with R Key: SPARK-10435 URL: https://issues.apache.org/jira/browse/SPARK-10435 Project: Spark Issue

[jira] [Updated] (SPARK-10425) Add a regression test for SPARK-10379

[ https://issues.apache.org/jira/browse/SPARK-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10425: -- Priority: Major (was: Minor) > Add a regression test for SPARK-10379 >

[jira] [Updated] (SPARK-9669) Support PySpark with Mesos Cluster mode

[ https://issues.apache.org/jira/browse/SPARK-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9669: - Assignee: Timothy Chen > Support PySpark with Mesos Cluster mode >

[jira] [Updated] (SPARK-9669) Support PySpark with Mesos Cluster mode

[ https://issues.apache.org/jira/browse/SPARK-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9669: - Affects Version/s: 1.5.0 Target Version/s: 1.6.0 > Support PySpark with Mesos Cluster mode >

[jira] [Updated] (SPARK-9669) Support PySpark with Mesos Cluster mode

[ https://issues.apache.org/jira/browse/SPARK-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9669: - Issue Type: New Feature (was: Improvement) > Support PySpark with Mesos Cluster mode >

[jira] [Updated] (SPARK-9869) Flaky test: o.a.s.streaming.InputStreamSuite - socket input stream

[ https://issues.apache.org/jira/browse/SPARK-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9869: - Assignee: Pete Robbins > Flaky test: o.a.s.streaming.InputStreamSuite - socket input stream >

[jira] [Updated] (SPARK-9869) Flaky test: o.a.s.streaming.InputStreamSuite - socket input stream

[ https://issues.apache.org/jira/browse/SPARK-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9869: - Affects Version/s: (was: 1.5.0) 1.4.0 > Flaky test:

[jira] [Updated] (SPARK-10431) Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics with cache and coalesce

[ https://issues.apache.org/jira/browse/SPARK-10431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10431: -- Target Version/s: 1.6.0, 1.5.1 > Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics

[jira] [Updated] (SPARK-10431) Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics with cache and coalesce

[ https://issues.apache.org/jira/browse/SPARK-10431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10431: -- Labels: flaky-test (was: ) > Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics with

[jira] [Updated] (SPARK-9869) Flaky test: o.a.s.streaming.InputStreamSuite - socket input stream

[ https://issues.apache.org/jira/browse/SPARK-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9869: - Summary: Flaky test: o.a.s.streaming.InputStreamSuite - socket input stream (was:

[jira] [Updated] (SPARK-9869) Flaky test: o.a.s.streaming.InputStreamSuite - socket input stream

[ https://issues.apache.org/jira/browse/SPARK-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9869: - Affects Version/s: 1.5.0 > Flaky test: o.a.s.streaming.InputStreamSuite - socket input stream >

[jira] [Updated] (SPARK-9869) Flaky test: o.a.s.streaming.InputStreamSuite - socket input stream

[ https://issues.apache.org/jira/browse/SPARK-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9869: - Target Version/s: 1.6.0, 1.5.1 > Flaky test: o.a.s.streaming.InputStreamSuite - socket input stream >

[jira] [Updated] (SPARK-9869) Flaky test: o.a.s.streaming.InputStreamSuite - socket input stream

[ https://issues.apache.org/jira/browse/SPARK-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9869: - Priority: Critical (was: Major) > Flaky test: o.a.s.streaming.InputStreamSuite - socket input stream >

[jira] [Closed] (SPARK-10432) spark.port.maxRetries documentation is unclear

[ https://issues.apache.org/jira/browse/SPARK-10432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10432. - Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > spark.port.maxRetries

[jira] [Updated] (SPARK-9672) Drivers run in cluster mode on mesos may not have spark-env variables available

[ https://issues.apache.org/jira/browse/SPARK-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9672: - Assignee: Patrick Shields > Drivers run in cluster mode on mesos may not have spark-env variables >

[jira] [Resolved] (SPARK-9672) Drivers run in cluster mode on mesos may not have spark-env variables available

[ https://issues.apache.org/jira/browse/SPARK-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9672. -- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Drivers run in

[jira] [Resolved] (SPARK-9591) Job failed for exception during getting Broadcast variable

[ https://issues.apache.org/jira/browse/SPARK-9591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9591. -- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Job failed for

[jira] [Updated] (SPARK-9591) Job failed for exception during getting Broadcast variable

[ https://issues.apache.org/jira/browse/SPARK-9591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9591: - Assignee: jeanlyn > Job failed for exception during getting Broadcast variable >

[jira] [Resolved] (SPARK-10430) AccumulableInfo and RDDOperationScope violates hashCode + equals contract

[ https://issues.apache.org/jira/browse/SPARK-10430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10430. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > AccumulableInfo

[jira] [Updated] (SPARK-10430) AccumulableInfo and RDDOperationScope violates hashCode + equals contract

[ https://issues.apache.org/jira/browse/SPARK-10430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10430: -- Assignee: Vinod KC > AccumulableInfo and RDDOperationScope violates hashCode + equals contract >

[jira] [Updated] (SPARK-8966) Design a mechanism to ensure that temporary files created in tasks are cleaned up after failures

[ https://issues.apache.org/jira/browse/SPARK-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8966: - Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-9697) > Design a mechanism to

[jira] [Updated] (SPARK-10443) Refactor SortMergeOuterJoin to reduce duplication

[ https://issues.apache.org/jira/browse/SPARK-10443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10443: -- Issue Type: Improvement (was: Bug) > Refactor SortMergeOuterJoin to reduce duplication >

[jira] [Resolved] (SPARK-9869) Flaky test: o.a.s.streaming.InputStreamSuite - socket input stream

[ https://issues.apache.org/jira/browse/SPARK-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9869. -- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > Flaky test:

[jira] [Updated] (SPARK-10431) Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics with cache and coalesce

[ https://issues.apache.org/jira/browse/SPARK-10431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10431: -- Fix Version/s: 1.5.1 1.6.0 > Flaky test: o.a.s.metrics.InputOutputMetricsSuite -

[jira] [Resolved] (SPARK-10431) Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics with cache and coalesce

[ https://issues.apache.org/jira/browse/SPARK-10431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10431. --- Resolution: Fixed > Flaky test: o.a.s.metrics.InputOutputMetricsSuite - input metrics with cache >

[jira] [Resolved] (SPARK-10435) SparkSubmit should fail fast for Mesos cluster mode with R

[ https://issues.apache.org/jira/browse/SPARK-10435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10435. --- Resolution: Fixed Fix Version/s: 1.6.0 > SparkSubmit should fail fast for Mesos cluster mode

[jira] [Created] (SPARK-10443) Refactor SortMergeOuterJoin to reduce duplication

Andrew Or created SPARK-10443: - Summary: Refactor SortMergeOuterJoin to reduce duplication Key: SPARK-10443 URL: https://issues.apache.org/jira/browse/SPARK-10443 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-10247) Cleanup DAGSchedulerSuite "ignore late map task completion"

[ https://issues.apache.org/jira/browse/SPARK-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10247. - Resolution: Fixed Fix Version/s: 1.6.0 > Cleanup DAGSchedulerSuite "ignore late map task

[jira] [Updated] (SPARK-8707) RDD#toDebugString fails if any cached RDD has invalid partitions

[ https://issues.apache.org/jira/browse/SPARK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8707: - Assignee: Navis > RDD#toDebugString fails if any cached RDD has invalid partitions >

[jira] [Closed] (SPARK-10411) In SQL tab move visualization above explain output

[ https://issues.apache.org/jira/browse/SPARK-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10411. - Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > In SQL tab move visualization

[jira] [Closed] (SPARK-5945) Spark should not retry a stage infinitely on a FetchFailedException

[ https://issues.apache.org/jira/browse/SPARK-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5945. Resolution: Fixed Fix Version/s: 1.6.0 > Spark should not retry a stage infinitely on a

[jira] [Closed] (SPARK-10379) UnsafeShuffleExternalSorter should preserve first page

[ https://issues.apache.org/jira/browse/SPARK-10379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10379. - Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > UnsafeShuffleExternalSorter

[jira] [Closed] (SPARK-8707) RDD#toDebugString fails if any cached RDD has invalid partitions

[ https://issues.apache.org/jira/browse/SPARK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8707. Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > RDD#toDebugString fails

[jira] [Updated] (SPARK-6157) Unroll unsuccessful memory_and_disk level block should release reserved unroll memory after put success in disk

[ https://issues.apache.org/jira/browse/SPARK-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6157: - Description: === EDIT by andrewor14 === The existing description was somewhat confusing, so here's a

[jira] [Updated] (SPARK-6157) Unroll unsuccessful memory_and_disk level block should release reserved unroll memory after put success in disk

[ https://issues.apache.org/jira/browse/SPARK-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6157: - Target Version/s: 1.6.0 > Unroll unsuccessful memory_and_disk level block should release reserved >

[jira] [Updated] (SPARK-6157) Unroll unsuccessful memory_and_disk level block should release reserved unroll memory after put success in disk

[ https://issues.apache.org/jira/browse/SPARK-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6157: - Description: === EDIT by andrewor14 === The existing description was somewhat confusing, so here's a

[jira] [Reopened] (SPARK-6157) Unroll unsuccessful memory_and_disk level block should release reserved unroll memory after put success in disk

[ https://issues.apache.org/jira/browse/SPARK-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-6157: -- Assignee: SuYan > Unroll unsuccessful memory_and_disk level block should release reserved > unroll

[jira] [Updated] (SPARK-6157) Unrolling with MEMORY_AND_DISK should always release memory

[ https://issues.apache.org/jira/browse/SPARK-6157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6157: - Summary: Unrolling with MEMORY_AND_DISK should always release memory (was: Unroll unsuccessful

[jira] [Updated] (SPARK-10176) Show partially analyzed plan when checkAnswer df fails to resolve

[ https://issues.apache.org/jira/browse/SPARK-10176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10176: -- Component/s: Tests > Show partially analyzed plan when checkAnswer df fails to resolve >

[jira] [Updated] (SPARK-8469) Application timeline view unreadable with many executors

[ https://issues.apache.org/jira/browse/SPARK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8469: - Assignee: (was: Kousuke Saruta) > Application timeline view unreadable with many executors >

[jira] [Commented] (SPARK-8469) Application timeline view unreadable with many executors

[ https://issues.apache.org/jira/browse/SPARK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728040#comment-14728040 ] Andrew Or commented on SPARK-8469: -- OK, no problem. I will unassign you for now in case others in the

[jira] [Updated] (SPARK-9043) Serialize key, value and combiner classes in ShuffleDependency

[ https://issues.apache.org/jira/browse/SPARK-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9043: - Component/s: (was: Spark Core) Shuffle > Serialize key, value and combiner classes

[jira] [Updated] (SPARK-9043) Serialize key, value and combiner classes in ShuffleDependency

[ https://issues.apache.org/jira/browse/SPARK-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9043: - Assignee: Matt Massie > Serialize key, value and combiner classes in ShuffleDependency >

[jira] [Updated] (SPARK-9043) Serialize key, value and combiner classes in ShuffleDependency

[ https://issues.apache.org/jira/browse/SPARK-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9043: - Target Version/s: 1.6.0 > Serialize key, value and combiner classes in ShuffleDependency >

[jira] [Updated] (SPARK-10372) Tests for entire scheduler

[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10372: -- Issue Type: Sub-task (was: Test) Parent: SPARK-8987 > Tests for entire scheduler >

[jira] [Updated] (SPARK-10192) Test for fetch failure in a shared dependency for "skipped" stages

[ https://issues.apache.org/jira/browse/SPARK-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10192: -- Component/s: Tests > Test for fetch failure in a shared dependency for "skipped" stages >

[jira] [Updated] (SPARK-10372) Add end-to-end tests for the scheduling code

[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10372: -- Summary: Add end-to-end tests for the scheduling code (was: Add end-to-end tests for the scheduler)

[jira] [Updated] (SPARK-10372) Add end-to-end tests for the scheduler

[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10372: -- Summary: Add end-to-end tests for the scheduler (was: Tests for entire scheduler) > Add end-to-end

[jira] [Updated] (SPARK-10192) Test for fetch failure in a shared dependency for "skipped" stages

[ https://issues.apache.org/jira/browse/SPARK-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10192: -- Issue Type: Sub-task (was: Test) Parent: SPARK-8987 > Test for fetch failure in a shared

[jira] [Updated] (SPARK-10372) Add end-to-end tests for the scheduling code

[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10372: -- Component/s: (was: Spark Core) Tests Scheduler > Add end-to-end

[jira] [Updated] (SPARK-10372) Add end-to-end tests for the scheduling code

[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10372: -- Target Version/s: 1.6.0 > Add end-to-end tests for the scheduling code >

[jira] [Updated] (SPARK-10192) Test for fetch failure in a shared dependency for "skipped" stages

[ https://issues.apache.org/jira/browse/SPARK-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10192: -- Component/s: (was: Spark Core) Scheduler > Test for fetch failure in a shared

[jira] [Updated] (SPARK-10372) Add end-to-end tests for the scheduling code

[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10372: -- Fix Version/s: (was: 1.6.0) > Add end-to-end tests for the scheduling code >

[jira] [Updated] (SPARK-8987) Increase test coverage of DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8987: - Issue Type: Umbrella (was: Bug) > Increase test coverage of DAGScheduler >

[jira] [Updated] (SPARK-5269) BlockManager.dataDeserialize always creates a new serializer instance

[ https://issues.apache.org/jira/browse/SPARK-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5269: - Target Version/s: 1.6.0 > BlockManager.dataDeserialize always creates a new serializer instance >

[jira] [Updated] (SPARK-4122) Add library to write data back to Kafka

[ https://issues.apache.org/jira/browse/SPARK-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4122: - Target Version/s: 1.6.0 > Add library to write data back to Kafka >

[jira] [Created] (SPARK-10412) In SQL tab, show execution memory per physical operator

Andrew Or created SPARK-10412: - Summary: In SQL tab, show execution memory per physical operator Key: SPARK-10412 URL: https://issues.apache.org/jira/browse/SPARK-10412 Project: Spark Issue

[jira] [Created] (SPARK-10411) In SQL tab move visualization above explain output

Andrew Or created SPARK-10411: - Summary: In SQL tab move visualization above explain output Key: SPARK-10411 URL: https://issues.apache.org/jira/browse/SPARK-10411 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3586) Support nested directories in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3586: - Labels: (was: patch) > Support nested directories in Spark Streaming >

[jira] [Updated] (SPARK-3586) Support nested directories in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3586: - Target Version/s: 1.6.0 > Support nested directories in Spark Streaming >

[jira] [Updated] (SPARK-10081) Skip re-computing getMissingParentStages in DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-10081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10081: -- Target Version/s: 1.6.0 > Skip re-computing getMissingParentStages in DAGScheduler >

[jira] [Updated] (SPARK-10081) Skip re-computing getMissingParentStages in DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-10081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10081: -- Issue Type: Improvement (was: Bug) > Skip re-computing getMissingParentStages in DAGScheduler >

[jira] [Updated] (SPARK-10247) Cleanup DAGSchedulerSuite "ignore late map task completion"

[ https://issues.apache.org/jira/browse/SPARK-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10247: -- Priority: Trivial (was: Minor) > Cleanup DAGSchedulerSuite "ignore late map task completion" >

[jira] [Updated] (SPARK-10247) Cleanup DAGSchedulerSuite "ignore late map task completion"

[ https://issues.apache.org/jira/browse/SPARK-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10247: -- Target Version/s: 1.6.0 > Cleanup DAGSchedulerSuite "ignore late map task completion" >

[jira] [Updated] (SPARK-10247) Cleanup DAGSchedulerSuite "ignore late map task completion"

[ https://issues.apache.org/jira/browse/SPARK-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10247: -- Component/s: (was: Spark Core) Tests Scheduler > Cleanup

[jira] [Updated] (SPARK-9516) Improve Thread Dump page

[ https://issues.apache.org/jira/browse/SPARK-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9516: - Assignee: Nan Zhu > Improve Thread Dump page > > > Key:

[jira] [Updated] (SPARK-9516) Improve Thread Dump page

[ https://issues.apache.org/jira/browse/SPARK-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9516: - Target Version/s: 1.6.0 > Improve Thread Dump page > > > Key:

[jira] [Updated] (SPARK-10144) Actually show peak execution memory on UI by default

[ https://issues.apache.org/jira/browse/SPARK-10144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10144: -- Summary: Actually show peak execution memory on UI by default (was: Actually show peak execution

[jira] [Created] (SPARK-10144) Actually show peak execution memory by default

Andrew Or created SPARK-10144: - Summary: Actually show peak execution memory by default Key: SPARK-10144 URL: https://issues.apache.org/jira/browse/SPARK-10144 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4134) Dynamic allocation: tone down scary executor lost messages when killing on purpose

[ https://issues.apache.org/jira/browse/SPARK-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4134: - Target Version/s: 1.6.0 (was: 1.5.0) Dynamic allocation: tone down scary executor lost messages when

[jira] [Updated] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

[ https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10124: -- Assignee: Timothy Chen Mesos cluster mode causes exception when multiple spark apps are being

[jira] [Closed] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

[ https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10124. - Resolution: Fixed Fix Version/s: 1.5.0 Mesos cluster mode causes exception when multiple spark

[jira] [Commented] (SPARK-8469) Application timeline view unreadable with many executors

[ https://issues.apache.org/jira/browse/SPARK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702511#comment-14702511 ] Andrew Or commented on SPARK-8469: -- I've spoken with a few actual dynamic allocation

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Target Version/s: 1.6.0, 1.5.1 (was: 1.6.0) Exception not failing Python applications (in yarn cluster

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Target Version/s: 1.6.0 (was: 1.5.1) Exception not failing Python applications (in yarn cluster mode)

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Fix Version/s: 1.6.0 Exception not failing Python applications (in yarn cluster mode)

[jira] [Updated] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7736: - Fix Version/s: (was: 1.6.0) Exception not failing Python applications (in yarn cluster mode)

[jira] [Updated] (SPARK-10058) Flaky test: HeartbeatReceiverSuite: normal heartbeat

[ https://issues.apache.org/jira/browse/SPARK-10058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10058: -- Priority: Critical (was: Major) Flaky test: HeartbeatReceiverSuite: normal heartbeat

[jira] [Updated] (SPARK-10058) Flaky test: HeartbeatReceiverSuite: normal heartbeat

[ https://issues.apache.org/jira/browse/SPARK-10058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10058: -- Labels: flaky-test (was: ) Flaky test: HeartbeatReceiverSuite: normal heartbeat

[jira] [Updated] (SPARK-10003) Improve readability of DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10003: -- Description: There are many opportunities for improving DAGScheduler's readability. This issue will

<    9   10   11   12   13   14   15   16   17   18   >