[jira] [Updated] (SPARK-5663) Delete appStagingDir on local file system

[ https://issues.apache.org/jira/browse/SPARK-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-5663: Description: As we know, in yarn mode Client will create appStagingDir on file system, and AppMaster will

[jira] [Updated] (SPARK-5663) Delete appStagingDir on local file system

[ https://issues.apache.org/jira/browse/SPARK-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-5663: Description: As we know, in yarn mode Client will create appStagingDir on file system, and AppMaster will

[jira] [Created] (SPARK-5664) Restore stty settings when exiting for launching spark-shell from SBT

Liang-Chi Hsieh created SPARK-5664: -- Summary: Restore stty settings when exiting for launching spark-shell from SBT Key: SPARK-5664 URL: https://issues.apache.org/jira/browse/SPARK-5664 Project:

[jira] [Commented] (SPARK-5664) Restore stty settings when exiting for launching spark-shell from SBT

[ https://issues.apache.org/jira/browse/SPARK-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310678#comment-14310678 ] Apache Spark commented on SPARK-5664: - User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310643#comment-14310643 ] Apache Spark commented on SPARK-4550: - User 'sryza' has created a pull request for

[jira] [Commented] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310753#comment-14310753 ] Apache Spark commented on SPARK-4267: - User 'srowen' has created a pull request for

[jira] [Created] (SPARK-5665) Update netlib-java documentation

Sean Owen created SPARK-5665: Summary: Update netlib-java documentation Key: SPARK-5665 URL: https://issues.apache.org/jira/browse/SPARK-5665 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-5666) Adhere to accepte coding standards

Prabeesh K created SPARK-5666: - Summary: Adhere to accepte coding standards Key: SPARK-5666 URL: https://issues.apache.org/jira/browse/SPARK-5666 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-5666) Adhere to accepte coding standards

[ https://issues.apache.org/jira/browse/SPARK-5666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabeesh K updated SPARK-5666: -- Description: Cleanup the source code related to the Mqtt Spark Streaming to adhere to accept coding

[jira] [Commented] (SPARK-5666) Adhere to accepte coding standards

[ https://issues.apache.org/jira/browse/SPARK-5666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310842#comment-14310842 ] Apache Spark commented on SPARK-5666: - User 'prabeesh' has created a pull request for

[jira] [Resolved] (SPARK-5326) Show fetch wait time as optional metric in the UI

[ https://issues.apache.org/jira/browse/SPARK-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-5326. --- Resolution: Fixed https://github.com/apache/spark/pull/4110 Show fetch wait time as

[jira] [Commented] (SPARK-5666) Adhere to accepte coding standards

[ https://issues.apache.org/jira/browse/SPARK-5666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310845#comment-14310845 ] Prabeesh K commented on SPARK-5666: --- [~srowen] Please review this Adhere to accepte

[jira] [Updated] (SPARK-5666) Adhere to accept coding standards

[ https://issues.apache.org/jira/browse/SPARK-5666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabeesh K updated SPARK-5666: -- Summary: Adhere to accept coding standards (was: Adhere to accepte coding standards) Adhere to

[jira] [Updated] (SPARK-5326) Show fetch wait time as optional metric in the UI

[ https://issues.apache.org/jira/browse/SPARK-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-5326: -- Fix Version/s: 1.3.0 Show fetch wait time as optional metric in the UI

[jira] [Updated] (SPARK-5666) To accept coding standards

[ https://issues.apache.org/jira/browse/SPARK-5666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabeesh K updated SPARK-5666: -- Summary: To accept coding standards (was: Adhere to accept coding standards) To accept coding

[jira] [Commented] (SPARK-5667) Remove version from spark-ec2 example.

[ https://issues.apache.org/jira/browse/SPARK-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310850#comment-14310850 ] Apache Spark commented on SPARK-5667: - User 'MiguelPeralvo' has created a pull request

[jira] [Commented] (SPARK-5666) To accept coding standards

[ https://issues.apache.org/jira/browse/SPARK-5666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310851#comment-14310851 ] Prabeesh K commented on SPARK-5666: --- Primary concern is to improve the code related to

[jira] [Comment Edited] (SPARK-5667) Remove version from spark-ec2 example.

[ https://issues.apache.org/jira/browse/SPARK-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310854#comment-14310854 ] Miguel Peralvo edited comment on SPARK-5667 at 2/7/15 6:15 PM:

[jira] [Resolved] (SPARK-5667) Remove version from spark-ec2 example.

[ https://issues.apache.org/jira/browse/SPARK-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miguel Peralvo resolved SPARK-5667. --- Resolution: Fixed Fixed in [pull request #4300 - Remove version from spark-ec2 example.]

[jira] [Updated] (SPARK-5667) Remove version from spark-ec2 example.

[ https://issues.apache.org/jira/browse/SPARK-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miguel Peralvo updated SPARK-5667: -- Affects Version/s: 1.2.2 1.2.1 1.2.0 Remove

[jira] [Updated] (SPARK-5666) Improvements in Mqtt Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-5666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabeesh K updated SPARK-5666: -- Summary: Improvements in Mqtt Spark Streaming (was: To accept coding standards) Improvements in

[jira] [Commented] (SPARK-5665) Update netlib-java documentation

[ https://issues.apache.org/jira/browse/SPARK-5665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310791#comment-14310791 ] Apache Spark commented on SPARK-5665: - User 'fommil' has created a pull request for

[jira] [Updated] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems

[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4820: - Component/s: Build Spark build encounters File name too long on some encrypted filesystems

[jira] [Updated] (SPARK-5326) Show fetch wait time as optional metric in the UI

[ https://issues.apache.org/jira/browse/SPARK-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5326: - Component/s: Web UI Show fetch wait time as optional metric in the UI

[jira] [Updated] (SPARK-3153) shuffle will run out of space when disks have different free space

[ https://issues.apache.org/jira/browse/SPARK-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3153: - Component/s: Shuffle shuffle will run out of space when disks have different free space

[jira] [Updated] (SPARK-3210) Flume Polling Receiver must be more tolerant to connection failures.

[ https://issues.apache.org/jira/browse/SPARK-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3210: - Component/s: Streaming Flume Polling Receiver must be more tolerant to connection failures.

[jira] [Updated] (SPARK-3133) Piggyback get location RPC call to fetch small blocks

[ https://issues.apache.org/jira/browse/SPARK-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3133: - Component/s: Block Manager Piggyback get location RPC call to fetch small blocks

[jira] [Updated] (SPARK-2018) Big-Endian (IBM Power7) Spark Serialization issue

[ https://issues.apache.org/jira/browse/SPARK-2018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2018: - Component/s: Deploy Big-Endian (IBM Power7) Spark Serialization issue

[jira] [Updated] (SPARK-1910) Add onBlockComplete API to receiver

[ https://issues.apache.org/jira/browse/SPARK-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1910: - Component/s: Block Manager Add onBlockComplete API to receiver ---

[jira] [Updated] (SPARK-1799) Add init script to the debian packaging

[ https://issues.apache.org/jira/browse/SPARK-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1799: - Component/s: Deploy Build Add init script to the debian packaging

[jira] [Updated] (SPARK-3134) Update block locations asynchronously in TorrentBroadcast

[ https://issues.apache.org/jira/browse/SPARK-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3134: - Component/s: Block Manager Update block locations asynchronously in TorrentBroadcast

[jira] [Updated] (SPARK-3750) Log ulimit settings at warning if they are too low

[ https://issues.apache.org/jira/browse/SPARK-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3750: - Component/s: Deploy Log ulimit settings at warning if they are too low

[jira] [Updated] (SPARK-1182) Sort the configuration parameters in configuration.md

[ https://issues.apache.org/jira/browse/SPARK-1182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1182: - Component/s: Documentation Sort the configuration parameters in configuration.md

[jira] [Updated] (SPARK-911) Support map pruning on sorted (K, V) RDD's

[ https://issues.apache.org/jira/browse/SPARK-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-911: Component/s: Spark Core Support map pruning on sorted (K, V) RDD's

[jira] [Updated] (SPARK-1762) Add functionality to pin RDDs in cache

[ https://issues.apache.org/jira/browse/SPARK-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1762: - Component/s: Spark Core Add functionality to pin RDDs in cache --

[jira] [Updated] (SPARK-650) Add a setup hook API for running initialization code on each executor

[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-650: Component/s: Spark Core Add a setup hook API for running initialization code on each executor

[jira] [Updated] (SPARK-746) Automatically Use Avro Serialization for Avro Objects

[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-746: Component/s: Spark Core Automatically Use Avro Serialization for Avro Objects

[jira] [Updated] (SPARK-913) log the size of each shuffle block in block manager

[ https://issues.apache.org/jira/browse/SPARK-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-913: Component/s: Block Manager log the size of each shuffle block in block manager

[jira] [Updated] (SPARK-4721) Improve first thread to put block failed

[ https://issues.apache.org/jira/browse/SPARK-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4721: - Component/s: Block Manager Improve first thread to put block failed

[jira] [Updated] (SPARK-578) Fix interpreter code generation to only capture needed dependencies

[ https://issues.apache.org/jira/browse/SPARK-578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-578: Component/s: Spark Core Fix interpreter code generation to only capture needed dependencies

[jira] [Updated] (SPARK-720) Statically guarantee serialization will succeed

[ https://issues.apache.org/jira/browse/SPARK-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-720: Component/s: Spark Core Statically guarantee serialization will succeed

[jira] [Updated] (SPARK-985) Support Job Cancellation on Mesos Scheduler

[ https://issues.apache.org/jira/browse/SPARK-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-985: Component/s: (was: Mesos) Scheduler Support Job Cancellation on Mesos Scheduler

[jira] [Updated] (SPARK-1697) Driver error org.apache.spark.scheduler.TaskSetManager - Loss was due to java.io.FileNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1697: - Component/s: Scheduler Driver error org.apache.spark.scheduler.TaskSetManager - Loss was due to

[jira] [Updated] (SPARK-4957) TaskScheduler: when no resources are available: backoff after # of tries and crash.

[ https://issues.apache.org/jira/browse/SPARK-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4957: - Component/s: (was: Spark Core) Scheduler TaskScheduler: when no resources are

[jira] [Updated] (SPARK-1715) Ensure actor is self-contained in DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1715: - Component/s: Scheduler Ensure actor is self-contained in DAGScheduler

[jira] [Updated] (SPARK-823) spark.default.parallelism's default is inconsistent across scheduler backends

[ https://issues.apache.org/jira/browse/SPARK-823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-823: Component/s: (was: Documentation) (was: PySpark) (was: Spark

[jira] [Updated] (SPARK-4454) Race condition in DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4454: - Component/s: Scheduler Race condition in DAGScheduler --

[jira] [Updated] (SPARK-5374) abstract RDD's DAG graph iteration in DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-5374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5374: - Component/s: (was: Spark Core) Scheduler abstract RDD's DAG graph iteration in

[jira] [Updated] (SPARK-2456) Scheduler refactoring

[ https://issues.apache.org/jira/browse/SPARK-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2456: - Component/s: (was: Spark Core) Scheduler Scheduler refactoring

[jira] [Updated] (SPARK-1928) DAGScheduler suspended by local task OOM

[ https://issues.apache.org/jira/browse/SPARK-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1928: - Component/s: (was: Spark Core) Scheduler DAGScheduler suspended by local task OOM

[jira] [Updated] (SPARK-790) Implement the reregistered() callback in MesosScheduler to support master failover

[ https://issues.apache.org/jira/browse/SPARK-790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-790: Component/s: (was: Spark Core) Scheduler Implement the reregistered() callback in

[jira] [Updated] (SPARK-912) Take stage breakdown functionality and runLocally out of the main event loop in DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-912: Component/s: Scheduler Take stage breakdown functionality and runLocally out of the main event loop in

[jira] [Updated] (SPARK-2555) Support configuration spark.scheduler.minRegisteredExecutorsRatio in Mesos mode.

[ https://issues.apache.org/jira/browse/SPARK-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2555: - Component/s: (was: Mesos) (was: Spark Core) Scheduler Support

[jira] [Updated] (SPARK-864) DAGScheduler Exception if A Node is Added then Deleted

[ https://issues.apache.org/jira/browse/SPARK-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-864: Component/s: Scheduler DAGScheduler Exception if A Node is Added then Deleted

[jira] [Updated] (SPARK-4654) Clean up DAGScheduler's getMissingParentStages() and stageDependsOn() methods

[ https://issues.apache.org/jira/browse/SPARK-4654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4654: - Component/s: (was: Spark Core) Scheduler Clean up DAGScheduler's

[jira] [Updated] (SPARK-4949) shutdownCallback in SparkDeploySchedulerBackend should be enclosed by synchronized block.

[ https://issues.apache.org/jira/browse/SPARK-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4949: - Component/s: (was: Spark Core) Scheduler shutdownCallback in

[jira] [Updated] (SPARK-5488) SPARK_LOCAL_IP not read by mesos scheduler

[ https://issues.apache.org/jira/browse/SPARK-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5488: - Component/s: Mesos SPARK_LOCAL_IP not read by mesos scheduler

[jira] [Updated] (SPARK-4346) YarnClientSchedulerBack.asyncMonitorApplication should be common with Client.monitorApplication

[ https://issues.apache.org/jira/browse/SPARK-4346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4346: - Component/s: YARN YarnClientSchedulerBack.asyncMonitorApplication should be common with

[jira] [Updated] (SPARK-516) Improve error reporting when slaves fail to start

[ https://issues.apache.org/jira/browse/SPARK-516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-516: Component/s: Spark Core Improve error reporting when slaves fail to start

[jira] [Updated] (SPARK-625) Client hangs when connecting to standalone cluster using wrong address

[ https://issues.apache.org/jira/browse/SPARK-625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-625: Component/s: Spark Core Client hangs when connecting to standalone cluster using wrong address

[jira] [Updated] (SPARK-573) Clarify semantics of the parallelized closures

[ https://issues.apache.org/jira/browse/SPARK-573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-573: Component/s: Spark Core Clarify semantics of the parallelized closures

[jira] [Updated] (SPARK-634) Track and display a read count for each block replica in BlockManager

[ https://issues.apache.org/jira/browse/SPARK-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-634: Component/s: Block Manager Track and display a read count for each block replica in BlockManager

[jira] [Updated] (SPARK-665) Create RPM packages for Spark

[ https://issues.apache.org/jira/browse/SPARK-665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-665: Component/s: Build Create RPM packages for Spark - Key:

[jira] [Updated] (SPARK-4122) Add library to write data back to Kafka

[ https://issues.apache.org/jira/browse/SPARK-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4122: - Component/s: Streaming Add library to write data back to Kafka ---

[jira] [Updated] (SPARK-4503) The history server is not compatible with HDFS HA

[ https://issues.apache.org/jira/browse/SPARK-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4503: - Component/s: Deploy The history server is not compatible with HDFS HA

[jira] [Updated] (SPARK-4206) BlockManager warnings in local mode: Block $blockId already exists on this machine; not re-adding it

[ https://issues.apache.org/jira/browse/SPARK-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4206: - Component/s: Block Manager BlockManager warnings in local mode: Block $blockId already exists on this

[jira] [Updated] (SPARK-3603) InvalidClassException on a Linux VM - probably problem with serialization

[ https://issues.apache.org/jira/browse/SPARK-3603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3603: - Component/s: Deploy InvalidClassException on a Linux VM - probably problem with serialization

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310796#comment-14310796 ] DeepakVohra commented on SPARK-5531: Earlier the following link was getting listed

[jira] [Updated] (SPARK-4566) Multiple --py-files command line options to spark-submit replace instead of adding to previous options

[ https://issues.apache.org/jira/browse/SPARK-4566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4566: - Component/s: Spark Submit Multiple --py-files command line options to spark-submit replace instead of

[jira] [Updated] (SPARK-636) Add mechanism to run system management/configuration tasks on all workers

[ https://issues.apache.org/jira/browse/SPARK-636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-636: Component/s: Spark Core Add mechanism to run system management/configuration tasks on all workers

[jira] [Updated] (SPARK-2610) When spark.serializer is set as org.apache.spark.serializer.KryoSerializer, importing a method causes multiple spark applications creations

[ https://issues.apache.org/jira/browse/SPARK-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2610: - Component/s: Spark Shell When spark.serializer is set as org.apache.spark.serializer.KryoSerializer,

[jira] [Updated] (SPARK-5533) Replace explicit dependency on org.codehaus.jackson

[ https://issues.apache.org/jira/browse/SPARK-5533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5533: - Component/s: Build Replace explicit dependency on org.codehaus.jackson

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310811#comment-14310811 ] Sean Owen commented on SPARK-5531: -- No, the page didn't change:

[jira] [Resolved] (SPARK-1742) Profiler for Spark

[ https://issues.apache.org/jira/browse/SPARK-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1742. -- Resolution: Not a Problem It's since been documented how to use standard profiling tools with Spark:

[jira] [Updated] (SPARK-2016) rdd in-memory storage UI becomes unresponsive when the number of RDD partitions is large

[ https://issues.apache.org/jira/browse/SPARK-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2016: - Component/s: Web UI rdd in-memory storage UI becomes unresponsive when the number of RDD partitions is

[jira] [Updated] (SPARK-2690) Make unidoc part of our test process

[ https://issues.apache.org/jira/browse/SPARK-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2690: - Component/s: Documentation Build Make unidoc part of our test process

[jira] [Updated] (SPARK-3511) Create a RELEASE-NOTES.txt file in the repo

[ https://issues.apache.org/jira/browse/SPARK-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3511: - Component/s: Project Infra Create a RELEASE-NOTES.txt file in the repo

[jira] [Resolved] (SPARK-1980) problems introduced by broadcast

[ https://issues.apache.org/jira/browse/SPARK-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1980. -- Resolution: Invalid Target Version/s: (was: 1.0.0) problems introduced by broadcast

[jira] [Updated] (SPARK-4346) YarnClientSchedulerBack.asyncMonitorApplication should be common with Client.monitorApplication

[ https://issues.apache.org/jira/browse/SPARK-4346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4346: - Component/s: (was: YARN) Scheduler YarnClientSchedulerBack.asyncMonitorApplication

[jira] [Updated] (SPARK-2647) DAGScheduler plugs others when processing one JobSubmitted event

[ https://issues.apache.org/jira/browse/SPARK-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2647: - Component/s: (was: Spark Core) Scheduler DAGScheduler plugs others when processing

[jira] [Updated] (SPARK-4653) DAGScheduler refactoring and cleanup

[ https://issues.apache.org/jira/browse/SPARK-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4653: - Component/s: (was: Spark Core) Scheduler DAGScheduler refactoring and cleanup

[jira] [Updated] (SPARK-4962) Put TaskScheduler.start back in SparkContext to shorten cluster resources occupation period

[ https://issues.apache.org/jira/browse/SPARK-4962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4962: - Component/s: (was: Spark Core) Scheduler Put TaskScheduler.start back in

[jira] [Updated] (SPARK-2581) complete or withdraw visitedStages optimization in DAGScheduler’s stageDependsOn

[ https://issues.apache.org/jira/browse/SPARK-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2581: - Component/s: (was: Spark Core) Scheduler complete or withdraw visitedStages

[jira] [Updated] (SPARK-3419) Scheduler shouldn't delay running a task when executors don't reside at any of its preferred locations

[ https://issues.apache.org/jira/browse/SPARK-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3419: - Component/s: (was: Spark Core) Scheduler Scheduler shouldn't delay running a task

[jira] [Updated] (SPARK-4732) All application progress on the standalone scheduler can be halted by one systematically faulty node

[ https://issues.apache.org/jira/browse/SPARK-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4732: - Component/s: (was: Spark Core) Scheduler All application progress on the standalone

[jira] [Updated] (SPARK-3545) Put HadoopRDD.getPartitions forward and put TaskScheduler.start back in SparkContext to reduce DAGScheduler.JobSubmitted processing time and shorten cluster resources occ

[ https://issues.apache.org/jira/browse/SPARK-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3545: - Component/s: Scheduler Put HadoopRDD.getPartitions forward and put TaskScheduler.start back in

[jira] [Updated] (SPARK-4961) Put HadoopRDD.getPartitions forward to reduce DAGScheduler.JobSubmitted processing time

[ https://issues.apache.org/jira/browse/SPARK-4961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4961: - Component/s: (was: Spark Core) Scheduler Put HadoopRDD.getPartitions forward to

[jira] [Updated] (SPARK-3714) Spark workflow scheduler

[ https://issues.apache.org/jira/browse/SPARK-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3714: - Component/s: (was: Project Infra) Scheduler Spark workflow scheduler

[jira] [Updated] (SPARK-5191) Pyspark: scheduler hangs when importing a standalone pyspark app

[ https://issues.apache.org/jira/browse/SPARK-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5191: - Component/s: (was: PySpark) Scheduler Pyspark: scheduler hangs when importing a

[jira] [Updated] (SPARK-5488) SPARK_LOCAL_IP not read by mesos scheduler

[ https://issues.apache.org/jira/browse/SPARK-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5488: - Component/s: (was: Mesos) Scheduler SPARK_LOCAL_IP not read by mesos scheduler

[jira] [Updated] (SPARK-5316) DAGScheduler may make shuffleToMapStage leak if getParentStages failes

[ https://issues.apache.org/jira/browse/SPARK-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5316: - Component/s: (was: Spark Core) Scheduler DAGScheduler may make shuffleToMapStage

[jira] [Updated] (SPARK-2618) use config spark.scheduler.priority for specifying TaskSet's priority on DAGScheduler

[ https://issues.apache.org/jira/browse/SPARK-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2618: - Component/s: Scheduler use config spark.scheduler.priority for specifying TaskSet's priority on

[jira] [Updated] (SPARK-823) spark.default.parallelism's default is inconsistent across scheduler backends

[ https://issues.apache.org/jira/browse/SPARK-823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-823: Component/s: PySpark Documentation spark.default.parallelism's default is inconsistent

[jira] [Updated] (SPARK-985) Support Job Cancellation on Mesos Scheduler

[ https://issues.apache.org/jira/browse/SPARK-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-985: Component/s: Mesos Support Job Cancellation on Mesos Scheduler ---

[jira] [Updated] (SPARK-2555) Support configuration spark.scheduler.minRegisteredExecutorsRatio in Mesos mode.

[ https://issues.apache.org/jira/browse/SPARK-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2555: - Component/s: Mesos Support configuration spark.scheduler.minRegisteredExecutorsRatio in Mesos mode.

[jira] [Updated] (SPARK-3714) Spark workflow scheduler

[ https://issues.apache.org/jira/browse/SPARK-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3714: - Component/s: Deploy Spark workflow scheduler Key: SPARK-3714

[jira] [Updated] (SPARK-5191) Pyspark: scheduler hangs when importing a standalone pyspark app

[ https://issues.apache.org/jira/browse/SPARK-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5191: - Component/s: PySpark Pyspark: scheduler hangs when importing a standalone pyspark app

[jira] [Resolved] (SPARK-1452) dynamic partition creation not working on cached table

[ https://issues.apache.org/jira/browse/SPARK-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1452. -- Resolution: Won't Fix If this is a Shark issue then I believe it's WontFix, as Shark isn't developed

[jira] [Created] (SPARK-5668) spark_ec2.py region parameter could be either mandatory or its value displayed

Miguel Peralvo created SPARK-5668: - Summary: spark_ec2.py region parameter could be either mandatory or its value displayed Key: SPARK-5668 URL: https://issues.apache.org/jira/browse/SPARK-5668

[jira] [Commented] (SPARK-5531) Spark download .tgz file does not get unpacked

[ https://issues.apache.org/jira/browse/SPARK-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310882#comment-14310882 ] DeepakVohra commented on SPARK-5531: Thanks for the clarification. Spark download

  1   2   >