[jira] [Closed] (SPARK-4759) Deadlock in complex spark job in local mode

2015-01-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4759. Resolution: Fixed Fix Version/s: 1.2.0 Deadlock in complex spark job in local mode

[jira] [Closed] (SPARK-4569) Rename externalSorting in Aggregator

2015-01-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4569. Resolution: Fixed Fix Version/s: 1.2.1 1.1.2 Assignee: Ilya Ganelin

[jira] [Updated] (SPARK-4793) way to find assembly jar is too strict

2015-01-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4793: - Labels: (was: backport-needed) way to find assembly jar is too strict

[jira] [Updated] (SPARK-4215) Allow requesting executors only on Yarn (for now)

2015-01-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4215: - Labels: (was: backport-needed) Allow requesting executors only on Yarn (for now)

[jira] [Closed] (SPARK-4793) way to find assembly jar is too strict

2015-01-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4793. Resolution: Fixed way to find assembly jar is too strict --

[jira] [Closed] (SPARK-1507) Spark on Yarn: Add support for user to specify # cores for ApplicationMaster

2015-01-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-1507. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: WangTaoTheTonic Target

[jira] [Closed] (SPARK-5201) ParallelCollectionRDD.slice(seq, numSlices) has int overflow when dealing with inclusive range

2015-01-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5201. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Ye Xianjin Target Version/s:

[jira] [Updated] (SPARK-5201) ParallelCollectionRDD.slice(seq, numSlices) has int overflow when dealing with inclusive range

2015-01-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5201: - Affects Version/s: (was: 1.2.0) 1.0.0 ParallelCollectionRDD.slice(seq,

[jira] [Closed] (SPARK-5231) History Server shows wrong job submission time.

2015-01-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5231. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Kousuke Saruta History Server shows wrong

[jira] [Updated] (SPARK-5655) YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster configured in secure mode

2015-02-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5655: - Affects Version/s: 1.3.0 YARN Auxiliary Shuffle service can't access shuffle files on Hadoop cluster

[jira] [Closed] (SPARK-5729) Potential NPE in StandaloneRestServer if user specifies bad path

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5729. Resolution: Fixed Fix Version/s: 1.3.0 Potential NPE in StandaloneRestServer if user specifies bad

[jira] [Updated] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4879: - Fix Version/s: 1.3.0 Missing output partitions after job completes with speculative execution

[jira] [Created] (SPARK-5729) Potential NPE in StandaloneRestServer if user specifies bad path

2015-02-10 Thread Andrew Or (JIRA)
Andrew Or created SPARK-5729: Summary: Potential NPE in StandaloneRestServer if user specifies bad path Key: SPARK-5729 URL: https://issues.apache.org/jira/browse/SPARK-5729 Project: Spark

[jira] [Updated] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-02-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4879: - Labels: backport-needed (was: ) Missing output partitions after job completes with speculative

[jira] [Updated] (SPARK-5759) ExecutorRunnable should catch YarnException while NMClient start container

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5759: - Affects Version/s: 1.2.0 ExecutorRunnable should catch YarnException while NMClient start container

[jira] [Updated] (SPARK-5765) word split problem in run-example and compute-classpath

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5765: - Assignee: Venkata Ramana G word split problem in run-example and compute-classpath

[jira] [Closed] (SPARK-5760) StandaloneRestClient/Server error behavior is incorrect

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5760. Resolution: Fixed Fix Version/s: 1.3.0 StandaloneRestClient/Server error behavior is incorrect

[jira] [Updated] (SPARK-5765) word split problem in run-example and compute-classpath

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5765: - Affects Version/s: 1.3.0 1.2.1 word split problem in run-example and

[jira] [Updated] (SPARK-5765) word split problem in run-example and compute-classpath

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5765: - Affects Version/s: (was: 1.2.2) (was: 1.3.0) word split problem in

[jira] [Closed] (SPARK-5762) Shuffle write time is incorrect for sort-based shuffle

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5762. Resolution: Fixed Fix Version/s: 1.2.2 1.3.0 Target Version/s: 1.3.0,

[jira] [Closed] (SPARK-5780) The loggings of Python unittests are noisy and scaring in

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5780. Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: 1.3.0 (was: 1.4.0) The loggings

[jira] [Updated] (SPARK-5780) The loggings of Python unittests are noisy and scaring in

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5780: - Affects Version/s: (was: 1.4.0) The loggings of Python unittests are noisy and scaring in

[jira] [Closed] (SPARK-5690) Flaky test: org.apache.spark.deploy.rest.StandaloneRestSubmitSuite.simple submit until completion

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5690. Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: 1.3.0 Flaky test:

[jira] [Closed] (SPARK-5761) Revamp StandaloneRestProtocolSuite

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5761. Resolution: Fixed Fix Version/s: 1.3.0 Revamp StandaloneRestProtocolSuite

[jira] [Updated] (SPARK-5783) Include filename, line number in eventlog-parsing error message

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5783: - Affects Version/s: (was: 1.2.1) 1.0.0 Include filename, line number in

[jira] [Closed] (SPARK-5759) ExecutorRunnable should catch YarnException while NMClient start container

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5759. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Lianhui Wang Target Version/s:

[jira] [Updated] (SPARK-5762) Shuffle write time is incorrect for sort-based shuffle

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5762: - Target Version/s: 1.3.0 (was: 1.3.0, 1.2.2) Shuffle write time is incorrect for sort-based shuffle

[jira] [Updated] (SPARK-5762) Shuffle write time is incorrect for sort-based shuffle

2015-02-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5762: - Fix Version/s: (was: 1.2.2) Shuffle write time is incorrect for sort-based shuffle

[jira] [Created] (SPARK-5761) Revamp StandaloneRestProtocolSuite

2015-02-11 Thread Andrew Or (JIRA)
Andrew Or created SPARK-5761: Summary: Revamp StandaloneRestProtocolSuite Key: SPARK-5761 URL: https://issues.apache.org/jira/browse/SPARK-5761 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5749) Fix Bash word splitting bugs in compute-classpath.sh

2015-02-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324625#comment-14324625 ] Andrew Or commented on SPARK-5749: -- I think Sean's assignment is correct. Fix Bash word

[jira] [Updated] (SPARK-3340) Deprecate ADD_JARS and ADD_FILES

2015-02-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3340: - Assignee: Andrey Zagrebin Deprecate ADD_JARS and ADD_FILES

[jira] [Updated] (SPARK-5337) respect spark.task.cpus when launch executors

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5337: - Affects Version/s: 1.0.0 respect spark.task.cpus when launch executors

[jira] [Updated] (SPARK-5825) Failure stopping Services while command line argument is too long

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5825: - Affects Version/s: 1.0.0 Failure stopping Services while command line argument is too long

[jira] [Closed] (SPARK-5825) Failure stopping Services while command line argument is too long

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5825. Resolution: Fixed Fix Version/s: 1.2.2 1.3.0 Failure stopping Services while

[jira] [Updated] (SPARK-5719) allow daemons to bind to specified host

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5719: - Affects Version/s: 1.0.0 allow daemons to bind to specified host

[jira] [Closed] (SPARK-5423) ExternalAppendOnlyMap won't delete temp spilled file if some exception happens during using it

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5423. Resolution: Fixed Fix Version/s: 1.2.2 1.1.2 1.3.0

[jira] [Updated] (SPARK-5423) ExternalAppendOnlyMap won't delete temp spilled file if some exception happens during using it

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5423: - Affects Version/s: 1.0.0 ExternalAppendOnlyMap won't delete temp spilled file if some exception

[jira] [Updated] (SPARK-5423) ExternalAppendOnlyMap won't delete temp spilled file if some exception happens during using it

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5423: - Priority: Major (was: Minor) ExternalAppendOnlyMap won't delete temp spilled file if some exception

[jira] [Updated] (SPARK-5316) DAGScheduler may make shuffleToMapStage leak if getParentStages failes

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5316: - Priority: Major (was: Minor) DAGScheduler may make shuffleToMapStage leak if getParentStages failes

[jira] [Updated] (SPARK-4962) Put TaskScheduler.start back in SparkContext to shorten cluster resources occupation period

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4962: - Affects Version/s: 1.0.0 Put TaskScheduler.start back in SparkContext to shorten cluster resources

[jira] [Updated] (SPARK-5316) DAGScheduler may make shuffleToMapStage leak if getParentStages failes

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5316: - Affects Version/s: 1.0.0 DAGScheduler may make shuffleToMapStage leak if getParentStages failes

[jira] [Updated] (SPARK-4921) TaskSetManager mistakenly returns PROCESS_LOCAL for NO_PREF tasks

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4921: - Summary: TaskSetManager mistakenly returns PROCESS_LOCAL for NO_PREF tasks (was: Performance issue

[jira] [Closed] (SPARK-3545) Put HadoopRDD.getPartitions forward and put TaskScheduler.start back in SparkContext to reduce DAGScheduler.JobSubmitted processing time and shorten cluster resources occu

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3545. Resolution: Won't Fix Put HadoopRDD.getPartitions forward and put TaskScheduler.start back in

[jira] [Updated] (SPARK-4848) On a stand-alone cluster, several worker-specific variables are read only on the master

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4848: - Component/s: (was: Project Infra) Deploy On a stand-alone cluster, several

[jira] [Updated] (SPARK-4848) On a stand-alone cluster, several worker-specific variables are read only on the master

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4848: - Affects Version/s: 1.0.0 On a stand-alone cluster, several worker-specific variables are read only on

[jira] [Updated] (SPARK-4721) Improve first thread to put block failed

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4721: - Affects Version/s: 1.0.0 Improve first thread to put block failed

[jira] [Updated] (SPARK-4669) Allow users to set arbitrary akka configurations via property file

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4669: - Affects Version/s: 1.0.0 Allow users to set arbitrary akka configurations via property file

[jira] [Closed] (SPARK-2188) Support sbt/sbt for Windows

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2188. Resolution: Won't Fix Support sbt/sbt for Windows --- Key:

[jira] [Updated] (SPARK-911) Support map pruning on sorted (K, V) RDD's

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-911: Affects Version/s: 1.0.0 Support map pruning on sorted (K, V) RDD's

[jira] [Updated] (SPARK-3051) Support looking-up named accumulators in a registry

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3051: - Affects Version/s: 1.0.0 Support looking-up named accumulators in a registry

[jira] [Updated] (SPARK-2033) Automatically cleanup checkpoint

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2033: - Affects Version/s: 1.0.0 Automatically cleanup checkpoint -

[jira] [Commented] (SPARK-3882) JobProgressListener gets permanently out of sync with long running job

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328237#comment-14328237 ] Andrew Or commented on SPARK-3882: -- Hi [~dgshep] is this still an issue after upgrading

[jira] [Closed] (SPARK-5849) Handle more types of invalid JSON requests in SubmitRestProtocolMessage.parseAction

2015-02-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5849. Resolution: Fixed Fix Version/s: 1.3.0 Handle more types of invalid JSON requests in

[jira] [Closed] (SPARK-3340) Deprecate ADD_JARS and ADD_FILES

2015-02-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3340. Resolution: Fixed Fix Version/s: 1.3.0 Deprecate ADD_JARS and ADD_FILES

[jira] [Closed] (SPARK-5548) Flaky test: o.a.s.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5548. Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: 1.3.0 Closing again

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway

2015-01-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292874#comment-14292874 ] Andrew Or commented on SPARK-5388: -- Hi Dale, thank you for your comments. Yes, in the

[jira] [Updated] (SPARK-5431) SparkSubmitSuite and DriverSuite hang indefinitely if Master fails

2015-01-27 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5431: - Priority: Major (was: Critical) SparkSubmitSuite and DriverSuite hang indefinitely if Master fails

[jira] [Updated] (SPARK-5431) SparkSubmitSuite and DriverSuite hang indefinitely if Master fails

2015-01-27 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5431: - Affects Version/s: 1.0.0 SparkSubmitSuite and DriverSuite hang indefinitely if Master fails

[jira] [Created] (SPARK-5431) SparkSubmitSuite and DriverSuite hang indefinitely if Master fails

2015-01-27 Thread Andrew Or (JIRA)
Andrew Or created SPARK-5431: Summary: SparkSubmitSuite and DriverSuite hang indefinitely if Master fails Key: SPARK-5431 URL: https://issues.apache.org/jira/browse/SPARK-5431 Project: Spark

[jira] [Updated] (SPARK-5432) SparkSubmitSuite should sc.stop()

2015-01-27 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5432: - Summary: SparkSubmitSuite should sc.stop() (was: DriverSuite and SparkSubmitSuite should sc.stop())

[jira] [Created] (SPARK-5437) DriverSuite and SparkSubmitSuite leak JVMs on timeout

2015-01-27 Thread Andrew Or (JIRA)
Andrew Or created SPARK-5437: Summary: DriverSuite and SparkSubmitSuite leak JVMs on timeout Key: SPARK-5437 URL: https://issues.apache.org/jira/browse/SPARK-5437 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5432) SparkSubmitSuite should sc.stop()

2015-01-27 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5432: - Priority: Minor (was: Major) SparkSubmitSuite should sc.stop() -

[jira] [Updated] (SPARK-5432) SparkSubmitSuite should sc.stop()

2015-01-27 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5432: - Description: The reason why we need all the hacks around the UI ports for these two suites is because we

[jira] [Updated] (SPARK-5437) DriverSuite and SparkSubmitSuite incorrect timeout behavior

2015-01-27 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5437: - Summary: DriverSuite and SparkSubmitSuite incorrect timeout behavior (was: DriverSuite and

[jira] [Created] (SPARK-5432) DriverSuite and SparkSubmitSuite should sc.stop()

2015-01-27 Thread Andrew Or (JIRA)
Andrew Or created SPARK-5432: Summary: DriverSuite and SparkSubmitSuite should sc.stop() Key: SPARK-5432 URL: https://issues.apache.org/jira/browse/SPARK-5432 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-5432) SparkSubmitSuite should sc.stop()

2015-01-27 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5432. Resolution: Won't Fix It may be intended behavior for the test suites to ensure that the driver does

[jira] [Updated] (SPARK-5413) Upgrade metrics dependency to 3.1.0

2015-01-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5413: - Target Version/s: 1.3.0 Upgrade metrics dependency to 3.1.0 -

[jira] [Closed] (SPARK-4955) Dynamic allocation doesn't work in YARN cluster mode

2015-01-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4955. Resolution: Fixed Fix Version/s: 1.3.0 Dynamic allocation doesn't work in YARN cluster mode

[jira] [Updated] (SPARK-5417) Remove redundant executor-ID set() call

2015-01-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5417: - Target Version/s: 1.3.0, 1.2.1 Fix Version/s: 1.3.0 Assignee: Ryan Williams

[jira] [Updated] (SPARK-4989) wrong application configuration cause cluster down in standalone mode

2015-01-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4989: - Target Version/s: 1.3.0, 1.1.2, 1.2.2 (was: 1.3.0) wrong application configuration cause cluster down

[jira] [Reopened] (SPARK-4989) wrong application configuration cause cluster down in standalone mode

2015-01-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-4989: -- wrong application configuration cause cluster down in standalone mode

[jira] [Updated] (SPARK-5434) Preserve spaces in path to spark-ec2

2015-01-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5434: - Assignee: Nicholas Chammas Preserve spaces in path to spark-ec2

[jira] [Updated] (SPARK-5434) Preserve spaces in path to spark-ec2

2015-01-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5434: - Target Version/s: 1.3.0, 1.2.1 Fix Version/s: 1.3.0 Labels: backport-needed (was: )

[jira] [Updated] (SPARK-4989) wrong application configuration cause cluster down in standalone mode

2015-01-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4989: - Fix Version/s: 1.1.2 wrong application configuration cause cluster down in standalone mode

[jira] [Updated] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

2015-01-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4267: - Priority: Blocker (was: Major) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

[jira] [Updated] (SPARK-4267) Failing to launch jobs on Spark on YARN with Hadoop 2.5.0 or later

2015-01-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4267: - Component/s: YARN Target Version/s: 1.3.0 Failing to launch jobs on Spark on YARN with Hadoop

[jira] [Updated] (SPARK-3782) Direct use of log4j in AkkaUtils interferes with certain logging configurations

2015-01-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3782: - Affects Version/s: 1.1.0 Direct use of log4j in AkkaUtils interferes with certain logging

[jira] [Commented] (SPARK-4506) Update documentation to clarify whether standalone-cluster mode is now officially supported

2015-01-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291307#comment-14291307 ] Andrew Or commented on SPARK-4506: -- Thanks for pointing that out. I have merged the patch

[jira] [Updated] (SPARK-4430) Apache RAT Checks fail spuriously on test files

2015-01-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4430: - Affects Version/s: (was: 1.2.0) 1.1.0 Apache RAT Checks fail spuriously on

[jira] [Closed] (SPARK-5268) CoarseGrainedExecutorBackend exits for irrelevant DisassociatedEvent

2015-01-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5268. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Nan Zhu Target Version/s:

[jira] [Updated] (SPARK-4430) Apache RAT Checks fail spuriously on test files

2015-01-25 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4430: - Affects Version/s: 1.2.0 Apache RAT Checks fail spuriously on test files

[jira] [Closed] (SPARK-5176) Thrift server fails with confusing error message when deploy-mode is cluster

2015-02-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5176. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Tom Panning Target Version/s:

[jira] [Closed] (SPARK-1825) Windows Spark fails to work with Linux YARN

2015-02-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-1825. Resolution: Fixed Fix Version/s: 1.3.0 Windows Spark fails to work with Linux YARN

[jira] [Closed] (SPARK-4859) Refactor LiveListenerBus and StreamingListenerBus

2015-02-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4859. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Shixiong Zhu Refactor LiveListenerBus and

[jira] [Commented] (SPARK-5515) Build fails with spark-ganglia-lgpl profile

2015-02-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14300818#comment-14300818 ] Andrew Or commented on SPARK-5515: -- https://github.com/apache/spark/pull/4303 Build

[jira] [Commented] (SPARK-5515) Build fails with spark-ganglia-lgpl profile

2015-02-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14300897#comment-14300897 ] Andrew Or commented on SPARK-5515: -- yes I just closed this Build fails with

[jira] [Closed] (SPARK-5515) Build fails with spark-ganglia-lgpl profile

2015-02-01 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5515. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Kousuke Saruta Build fails with

[jira] [Updated] (SPARK-5413) Upgrade metrics dependency to 3.1.0

2015-01-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5413: - Priority: Critical (was: Major) Upgrade metrics dependency to 3.1.0

[jira] [Closed] (SPARK-4990) Search SPARK_CONF_DIR first when --properties-file is not specified

2015-01-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4990. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: WangTaoTheTonic Target

[jira] [Updated] (SPARK-4990) Search SPARK_CONF_DIR first when --properties-file is not specified

2015-01-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4990: - Affects Version/s: 1.0.0 Search SPARK_CONF_DIR first when --properties-file is not specified

[jira] [Closed] (SPARK-4033) Integer overflow when SparkPi is called with more than 25000 slices

2015-01-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4033. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: SaintBacchus Target Version/s:

[jira] [Closed] (SPARK-4951) A busy executor may be killed when dynamicAllocation is enabled

2015-01-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4951. Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Target Version/s: 1.3.0,

[jira] [Closed] (SPARK-5122) Remove Shark from spark-ec2

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5122. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Nicholas Chammas Target

[jira] [Reopened] (SPARK-3490) Alleviate port collisions during tests

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-3490: -- Alleviate port collisions during tests -- Key:

[jira] [Updated] (SPARK-3490) Alleviate port collisions during tests

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3490: - Target Version/s: 1.2.0, 1.1.1, 0.9.3, 1.0.3 (was: 1.1.1, 1.2.0) Alleviate port collisions during tests

[jira] [Commented] (SPARK-3490) Alleviate port collisions during tests

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270320#comment-14270320 ] Andrew Or commented on SPARK-3490: -- Reopening this for branches 0.9 and 1.0 Alleviate

[jira] [Updated] (SPARK-5122) Remove Shark from spark-ec2

2015-01-08 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5122: - Affects Version/s: 1.0.0 Remove Shark from spark-ec2 --- Key:

[jira] [Updated] (SPARK-3490) Alleviate port collisions during tests

2015-01-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3490: - Fix Version/s: 0.9.3 Alleviate port collisions during tests --

[jira] [Updated] (SPARK-2910) Test with Python 2.6 on Jenkins

2015-01-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2910: - Fix Version/s: 0.9.2 Test with Python 2.6 on Jenkins ---

[jira] [Updated] (SPARK-2101) Python unit tests fail on Python 2.6 because of lack of unittest.skipIf()

2015-01-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2101: - Fix Version/s: 0.9.3 Python unit tests fail on Python 2.6 because of lack of unittest.skipIf()

<    4   5   6   7   8   9   10   11   12   13   >