[jira] [Updated] (SPARK-2954) PySpark MLlib serialization tests fail on Python 2.6

2015-01-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2954: - Fix Version/s: 0.9.3 PySpark MLlib serialization tests fail on Python 2.6

[jira] [Updated] (SPARK-2948) PySpark doesn't work on Python 2.6

2015-01-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2948: - Fix Version/s: 0.9.3 PySpark doesn't work on Python 2.6 --

[jira] [Updated] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

2015-01-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4006: - Target Version/s: 1.2.0, 1.1.1, 0.9.3, 1.0.3 (was: 1.1.1, 1.2.0, 1.0.3) Spark Driver crashes whenever

[jira] [Updated] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

2015-01-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4006: - Fix Version/s: 0.9.3 Spark Driver crashes whenever an Executor is registered twice

[jira] [Closed] (SPARK-4737) Prevent serialization errors from ever crashing the DAG scheduler

2015-01-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4737. Resolution: Fixed Fix Version/s: 1.3.0 Prevent serialization errors from ever crashing the DAG

[jira] [Closed] (SPARK-1953) yarn client mode Application Master memory size is same as driver memory size

2015-01-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-1953. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: WangTaoTheTonic Target

[jira] [Updated] (SPARK-4924) Factor out code to launch Spark applications into a separate library

2015-01-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4924: - Target Version/s: 1.3.0 Factor out code to launch Spark applications into a separate library

[jira] [Updated] (SPARK-4924) Factor out code to launch Spark applications into a separate library

2015-01-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4924: - Affects Version/s: 1.2.0 Factor out code to launch Spark applications into a separate library

[jira] [Updated] (SPARK-4924) Factor out code to launch Spark applications into a separate library

2015-01-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4924: - Affects Version/s: (was: 1.2.0) 1.0.0 Factor out code to launch Spark

[jira] [Closed] (SPARK-5006) spark.port.maxRetries doesn't work

2015-01-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5006. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: WangTaoTheTonic Target

[jira] [Updated] (SPARK-4697) System properties should override environment variables

2015-01-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4697: - Affects Version/s: 1.0.0 System properties should override environment variables

[jira] [Updated] (SPARK-5219) Race condition in TaskSchedulerImpl and TaskSetManager

2015-01-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5219: - Assignee: Shixiong Zhu Race condition in TaskSchedulerImpl and TaskSetManager

[jira] [Updated] (SPARK-5219) Race condition in TaskSchedulerImpl and TaskSetManager

2015-01-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5219: - Affects Version/s: 1.2.0 Race condition in TaskSchedulerImpl and TaskSetManager

[jira] [Created] (SPARK-5222) YARN client and cluster modes have different app name behaviors

2015-01-13 Thread Andrew Or (JIRA)
Andrew Or created SPARK-5222: Summary: YARN client and cluster modes have different app name behaviors Key: SPARK-5222 URL: https://issues.apache.org/jira/browse/SPARK-5222 Project: Spark Issue

[jira] [Updated] (SPARK-5222) YARN client and cluster modes have different app name behaviors

2015-01-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5222: - Description: The behavior is summarized in a table produced by [~WangTaoTheTonic] here:

[jira] [Updated] (SPARK-4697) System properties should override environment variables

2015-01-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4697: - Assignee: WangTaoTheTonic System properties should override environment variables

[jira] [Updated] (SPARK-5222) YARN client and cluster modes have different app name behaviors

2015-01-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5222: - Affects Version/s: 1.0.0 YARN client and cluster modes have different app name behaviors

[jira] [Updated] (SPARK-5222) YARN client and cluster modes have different app name behaviors

2015-01-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5222: - Component/s: YARN YARN client and cluster modes have different app name behaviors

[jira] [Updated] (SPARK-4955) Dynamic allocation doesn't work in YARN cluster mode

2015-01-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4955: - Summary: Dynamic allocation doesn't work in YARN cluster mode (was: Executor does not get killed after

[jira] [Updated] (SPARK-4955) Dynamic allocation doesn't work in YARN cluster mode

2015-01-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4955: - Priority: Critical (was: Major) Dynamic allocation doesn't work in YARN cluster mode

[jira] [Updated] (SPARK-4955) Dynamic allocation doesn't work in YARN cluster mode

2015-01-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4955: - Assignee: Lianhui Wang Dynamic allocation doesn't work in YARN cluster mode

[jira] [Closed] (SPARK-4973) Local directory in the driver of client-mode continues remaining even if application finished when external shuffle is enabled

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4973. Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Target Version/s: 1.3.0,

[jira] [Closed] (SPARK-2100) Allow users to disable Jetty Spark UI in local mode

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2100. Resolution: Duplicate Allow users to disable Jetty Spark UI in local mode

[jira] [Commented] (SPARK-2584) Do not mutate block storage level on the UI

2015-01-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273871#comment-14273871 ] Andrew Or commented on SPARK-2584: -- When the in-memory cache is full, the RDD will be

[jira] [Updated] (SPARK-4859) Improve StreamingListenerBus

2015-01-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4859: - Affects Version/s: 1.0.0 Improve StreamingListenerBus

[jira] [Updated] (SPARK-4859) Improve StreamingListenerBus

2015-01-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4859: - Target Version/s: 1.3.0 Improve StreamingListenerBus

[jira] [Updated] (SPARK-4859) Improve StreamingListenerBus

2015-01-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4859: - Priority: Major (was: Minor) Improve StreamingListenerBus

[jira] [Updated] (SPARK-5703) JobProgressListener throws empty.max error

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5703: - Description: In JobProgressListener, if you have a JobEnd that does not have a corresponding JobStart,

[jira] [Updated] (SPARK-5703) JobProgressListener throws empty.max error

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5703: - Summary: JobProgressListener throws empty.max error (was: JobProgressListener throws empty.max error in

[jira] [Created] (SPARK-5703) JobProgressListener throws empty.max error in HS

2015-02-09 Thread Andrew Or (JIRA)
Andrew Or created SPARK-5703: Summary: JobProgressListener throws empty.max error in HS Key: SPARK-5703 URL: https://issues.apache.org/jira/browse/SPARK-5703 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5703) AllJobsPage throws empty.max error

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5703: - Summary: AllJobsPage throws empty.max error (was: JobProgressListener throws empty.max error)

[jira] [Closed] (SPARK-5311) EventLoggingListener throws exception if log directory does not exist

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5311. Resolution: Won't Fix Assignee: Josh Rosen EventLoggingListener throws exception if log directory

[jira] [Closed] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4267. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Sean Owen Failing to launch jobs on Spark

[jira] [Updated] (SPARK-5690) Flaky test: org.apache.spark.deploy.rest.StandaloneRestSubmitSuite.simple submit until completion

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5690: - Affects Version/s: 1.3.0 Flaky test: org.apache.spark.deploy.rest.StandaloneRestSubmitSuite.simple

[jira] [Updated] (SPARK-5690) Flaky test: org.apache.spark.deploy.rest.StandaloneRestSubmitSuite.simple submit until completion

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5690: - Priority: Critical (was: Major) Flaky test:

[jira] [Closed] (SPARK-5698) Dynamic allocation: do not allow user to request a negative delta

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5698. Resolution: Fixed Fix Version/s: 1.2.2 1.3.0 Target Version/s: 1.3.0,

[jira] [Closed] (SPARK-5735) Replace uses of EasyMock with Mockito

2015-02-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5735. Resolution: Fixed Fix Version/s: 1.3.0 Replace uses of EasyMock with Mockito

[jira] [Closed] (SPARK-5732) Add an option to print the spark version in spark script

2015-02-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5732. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: uncleGen Add an option to print the spark

[jira] [Updated] (SPARK-5529) Executor is still hold while BlockManager has been removed

2015-02-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5529: - Component/s: YARN Executor is still hold while BlockManager has been removed

[jira] [Updated] (SPARK-5529) BlockManager heartbeat expiration does not kill executor

2015-02-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5529: - Assignee: Hong Shen BlockManager heartbeat expiration does not kill executor

[jira] [Updated] (SPARK-5529) BlockManager heartbeat expiration does not kill executor

2015-02-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5529: - Summary: BlockManager heartbeat expiration does not kill executor (was: Executor is still hold while

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5655: - Target Version/s: 1.3.0, 1.2.2 Affects Version/s: (was: 1.2.0) 1.2.1

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5655: - Priority: Critical (was: Blocker) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop

[jira] [Closed] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5613. Resolution: Fixed YarnClientSchedulerBackend fails to get application report when yarn restarts

[jira] [Commented] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314922#comment-14314922 ] Andrew Or commented on SPARK-5613: -- Thanks Patrick. I just verified that it was merged

[jira] [Closed] (SPARK-4136) Under dynamic allocation, cancel outstanding executor requests when no longer needed

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4136. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Sandy Ryza Under dynamic allocation,

[jira] [Updated] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4879: - Target Version/s: 1.0.3, 1.3.0, 1.1.2, 1.2.2 (was: 1.0.3, 1.3.0, 1.1.2, 1.2.1) Missing output

[jira] [Updated] (SPARK-5691) Preventing duplicate registering of an application has incorrect logic

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5691: - Component/s: Deploy Preventing duplicate registering of an application has incorrect logic

[jira] [Closed] (SPARK-5691) Preventing duplicate registering of an application has incorrect logic

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5691. Resolution: Fixed Fix Version/s: 1.2.2 1.1.2 1.0.3

[jira] [Commented] (SPARK-4161) Spark shell class path is not correctly set if spark.driver.extraClassPath is set in defaults.conf

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312918#comment-14312918 ] Andrew Or commented on SPARK-4161: -- It was actually back ported to all three branches. I

[jira] [Updated] (SPARK-4161) Spark shell class path is not correctly set if spark.driver.extraClassPath is set in defaults.conf

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4161: - Labels: (was: backport-needed) Spark shell class path is not correctly set if

[jira] [Closed] (SPARK-4161) Spark shell class path is not correctly set if spark.driver.extraClassPath is set in defaults.conf

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4161. Resolution: Fixed Fix Version/s: 1.2.1 1.1.2 Spark shell class path is not

[jira] [Created] (SPARK-5698) Dynamic allocation: do not allow user to request a negative delta

2015-02-09 Thread Andrew Or (JIRA)
Andrew Or created SPARK-5698: Summary: Dynamic allocation: do not allow user to request a negative delta Key: SPARK-5698 URL: https://issues.apache.org/jira/browse/SPARK-5698 Project: Spark

[jira] [Created] (SPARK-5816) Add huge backward compatibility warning in DriverWrapper

2015-02-13 Thread Andrew Or (JIRA)
Andrew Or created SPARK-5816: Summary: Add huge backward compatibility warning in DriverWrapper Key: SPARK-5816 URL: https://issues.apache.org/jira/browse/SPARK-5816 Project: Spark Issue Type:

[jira] [Updated] (SPARK-5816) Add huge backward compatibility warning in DriverWrapper

2015-02-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5816: - Affects Version/s: 1.3.0 Add huge backward compatibility warning in DriverWrapper

[jira] [Closed] (SPARK-2996) Standalone and Yarn have different settings for adding the user classpath first

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2996. Resolution: Fixed Fix Version/s: 1.3.0 Standalone and Yarn have different settings for adding the

[jira] [Closed] (SPARK-5703) AllJobsPage throws empty.max error

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5703. Resolution: Fixed Fix Version/s: 1.2.2 1.3.0 Target Version/s: 1.3.0,

[jira] [Closed] (SPARK-5701) Only set ShuffleReadMetrics when task does a shuffle

2015-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5701. Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: 1.3.0 Only set

[jira] [Updated] (SPARK-4843) Squash ExecutorRunnable and ExecutorRunnableUtil hierarchy in yarn module

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4843: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-4447 Squash ExecutorRunnable and

[jira] [Closed] (SPARK-4843) Squash ExecutorRunnable and ExecutorRunnableUtil hierarchy in yarn module

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4843. Resolution: Fixed Squash ExecutorRunnable and ExecutorRunnableUtil hierarchy in yarn module

[jira] [Reopened] (SPARK-4843) Squash ExecutorRunnable and ExecutorRunnableUtil hierarchy in yarn module

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-4843: -- Squash ExecutorRunnable and ExecutorRunnableUtil hierarchy in yarn module

[jira] [Updated] (SPARK-4843) Squash ExecutorRunnable and ExecutorRunnableUtil hierarchy in yarn module

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4843: - Affects Version/s: 1.2.0 Squash ExecutorRunnable and ExecutorRunnableUtil hierarchy in yarn module

[jira] [Updated] (SPARK-4843) Squash ExecutorRunnable and ExecutorRunnableUtil hierarchy in yarn module

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4843: - Target Version/s: 1.3.0 Squash ExecutorRunnable and ExecutorRunnableUtil hierarchy in yarn module

[jira] [Updated] (SPARK-4843) Squash ExecutorRunnable and ExecutorRunnableUtil hierarchy in yarn module

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4843: - Affects Version/s: (was: 1.2.0) 1.3.0 Squash ExecutorRunnable and

[jira] [Updated] (SPARK-5087) Merge yarn.Client and yarn.ClientBase

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5087: - Fix Version/s: 1.3.0 Merge yarn.Client and yarn.ClientBase -

[jira] [Closed] (SPARK-5087) Merge yarn.Client and yarn.ClientBase

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5087. Resolution: Fixed Merge yarn.Client and yarn.ClientBase -

[jira] [Updated] (SPARK-5087) Merge yarn.Client and yarn.ClientBase

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5087: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-4447 Merge yarn.Client and

[jira] [Updated] (SPARK-5087) Merge yarn.Client and yarn.ClientBase

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5087: - Affects Version/s: (was: 1.2.0) 1.3.0 Merge yarn.Client and yarn.ClientBase

[jira] [Updated] (SPARK-4989) wrong application configuration cause cluster down in standalone mode

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4989: - Fix Version/s: 1.3.0 wrong application configuration cause cluster down in standalone mode

[jira] [Closed] (SPARK-4989) wrong application configuration cause cluster down in standalone mode

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4989. Resolution: Fixed wrong application configuration cause cluster down in standalone mode

[jira] [Updated] (SPARK-4989) wrong application configuration cause cluster down in standalone mode

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4989: - Assignee: Zhang, Liye wrong application configuration cause cluster down in standalone mode

[jira] [Updated] (SPARK-4973) Local directory in the driver of client-mode continues remaining even if application finished when external shuffle is enabled

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4973: - Affects Version/s: (was: 1.3.0) 1.2.0 Local directory in the driver of

[jira] [Updated] (SPARK-4973) Local directory in the driver of client-mode continues remaining even if application finished when external shuffle is enabled

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4973: - Assignee: Kousuke Saruta Local directory in the driver of client-mode continues remaining even if

[jira] [Updated] (SPARK-4951) A busy executor may be killed when dynamicAllocation is enabled

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4951: - Assignee: Shixiong Zhu A busy executor may be killed when dynamicAllocation is enabled

[jira] [Updated] (SPARK-4389) Set akka.remote.netty.tcp.bind-hostname=0.0.0.0 so driver can be located behind NAT

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4389: - Affects Version/s: 1.2.0 Set akka.remote.netty.tcp.bind-hostname=0.0.0.0 so driver can be located

[jira] [Closed] (SPARK-2458) Make failed application log visible on History Server

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2458. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Masayoshi TSUZUKI Target

[jira] [Updated] (SPARK-4951) A busy executor may be killed when dynamicAllocation is enabled

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4951: - Affects Version/s: 1.2.0 A busy executor may be killed when dynamicAllocation is enabled

[jira] [Updated] (SPARK-4777) Some block memory after unrollSafely not count into used memory(memoryStore.entrys or unrollMemory)

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4777: - Priority: Major (was: Minor) Some block memory after unrollSafely not count into used

[jira] [Updated] (SPARK-4286) Support External Shuffle Service with Mesos integration

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4286: - Affects Version/s: 1.2.0 Support External Shuffle Service with Mesos integration

[jira] [Closed] (SPARK-5130) yarn-cluster mode should not be considered as client mode in spark-submit

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5130. Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Assignee:

[jira] [Updated] (SPARK-5130) yarn-cluster mode should not be considered as client mode in spark-submit

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5130: - Affects Version/s: 1.2.0 yarn-cluster mode should not be considered as client mode in spark-submit

[jira] [Updated] (SPARK-1825) Windows Spark fails to work with Linux YARN

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1825: - Assignee: Masayoshi TSUZUKI Windows Spark fails to work with Linux YARN

[jira] [Updated] (SPARK-5006) spark.port.maxRetries doesn't work

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5006: - Affects Version/s: 1.1.0 spark.port.maxRetries doesn't work --

[jira] [Updated] (SPARK-5626) Spurious test failures due to NullPointerException in EasyMock test code

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5626: - Priority: Critical (was: Major) Spurious test failures due to NullPointerException in EasyMock test

[jira] [Updated] (SPARK-5679) Flaky tests in o.a.s.metrics.InputOutputMetricsSuite: input metrics with interleaved reads and input metrics with mixed read method

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5679: - Priority: Critical (was: Major) Flaky tests in o.a.s.metrics.InputOutputMetricsSuite: input metrics

[jira] [Updated] (SPARK-5731) Flaky test: o.a.s.streaming.kafka.DirectKafkaStreamSuite.basic stream receiving with multiple topics and smallest starting offset

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5731: - Summary: Flaky test: o.a.s.streaming.kafka.DirectKafkaStreamSuite.basic stream receiving with multiple

[jira] [Updated] (SPARK-5659) Flaky test: o.a.s.streaming.ReceiverSuite.block

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5659: - Summary: Flaky test: o.a.s.streaming.ReceiverSuite.block (was: Flaky Test:

[jira] [Updated] (SPARK-5696) HiveThriftServer2Suite fails because of extra log4j.properties in the driver classpath

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5696: - Priority: Critical (was: Major) HiveThriftServer2Suite fails because of extra log4j.properties in the

[jira] [Updated] (SPARK-4571) History server shows negative time

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4571: - Priority: Major (was: Minor) History server shows negative time --

[jira] [Updated] (SPARK-5812) Flaky test: o.a.s.JavaAPISuite

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5812: - Summary: Flaky test: o.a.s.JavaAPISuite (was: Potential flaky test JavaAPISuite.glom) Flaky test:

[jira] [Updated] (SPARK-5812) Flaky test: o.a.s.JavaAPISuite

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5812: - Priority: Critical (was: Major) Flaky test: o.a.s.JavaAPISuite --

[jira] [Updated] (SPARK-5751) Flaky test: o.a.s.sql.hive.thriftserver.HiveThriftServer2Suite sometimes timeouts

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5751: - Summary: Flaky test: o.a.s.sql.hive.thriftserver.HiveThriftServer2Suite sometimes timeouts (was: First

[jira] [Commented] (SPARK-5345) Flaky test: o.a.s.deploy.history.FsHistoryProviderSuite

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326911#comment-14326911 ] Andrew Or commented on SPARK-5345: -- The real fix should be here:

[jira] [Updated] (SPARK-5076) Don't show Cores or Memory Per Node columns for completed applications

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5076: - Affects Version/s: 1.0.0 Don't show Cores or Memory Per Node columns for completed applications

[jira] [Updated] (SPARK-5345) Flaky test: o.a.s.deploy.history.FsHistoryProviderSuite

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5345: - Priority: Critical (was: Major) Flaky test: o.a.s.deploy.history.FsHistoryProviderSuite

[jira] [Updated] (SPARK-5548) Flaky test: o.a.s.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5548: - Target Version/s: (was: 1.3.0) Flaky test: o.a.s.util.AkkaUtilsSuite.remote fetch ssl on - untrusted

[jira] [Updated] (SPARK-5345) Flaky test: o.a.s.deploy.history.FsHistoryProviderSuite

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5345: - Assignee: Kousuke Saruta Flaky test: o.a.s.deploy.history.FsHistoryProviderSuite

[jira] [Updated] (SPARK-5548) Flaky test: o.a.s.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5548: - Fix Version/s: (was: 1.3.0) Flaky test: o.a.s.util.AkkaUtilsSuite.remote fetch ssl on - untrusted

[jira] [Commented] (SPARK-5690) Flaky test: org.apache.spark.deploy.rest.StandaloneRestSubmitSuite.simple submit until completion

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326903#comment-14326903 ] Andrew Or commented on SPARK-5690: -- Fixed in https://github.com/apache/spark/pull/4637

[jira] [Updated] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5700: - Labels: (was: flaky-test) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4

<    5   6   7   8   9   10   11   12   13   14   >