[jira] [Resolved] (SPARK-12174) Slow test: BlockManagerSuite."SPARK-9591: getRemoteBytes from another location when Exception throw"

2016-01-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12174. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Slow test: BlockMan

[jira] [Created] (SPARK-12790) Remove HistoryServer old multiple files format

2016-01-12 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12790: - Summary: Remove HistoryServer old multiple files format Key: SPARK-12790 URL: https://issues.apache.org/jira/browse/SPARK-12790 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-12627) Remove SparkContext preferred locations constructor

2016-01-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12627. --- Resolution: Fixed Assignee: Reynold Xin (was: Andrew Or) Fix Version/s: 2.0.0 > Remo

[jira] [Commented] (SPARK-12627) Remove SparkContext preferred locations constructor

2016-01-05 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15084438#comment-15084438 ] Andrew Or commented on SPARK-12627: --- Resolved through https://github.com/apache/spark/p

[jira] [Updated] (SPARK-12628) SparkUI: weird formatting on additional metrics tooltip

2016-01-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12628: -- Attachment: Screen Shot 2016-01-04 at 1.18.16 PM.png > SparkUI: weird formatting on additional metrics

[jira] [Created] (SPARK-12628) SparkUI: weird formatting on additional metrics tooltip

2016-01-04 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12628: - Summary: SparkUI: weird formatting on additional metrics tooltip Key: SPARK-12628 URL: https://issues.apache.org/jira/browse/SPARK-12628 Project: Spark Issue Type:

[jira] [Created] (SPARK-12627) Remove SparkContext preferred locations constructor

2016-01-04 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12627: - Summary: Remove SparkContext preferred locations constructor Key: SPARK-12627 URL: https://issues.apache.org/jira/browse/SPARK-12627 Project: Spark Issue Type: Sub

[jira] [Assigned] (SPARK-12627) Remove SparkContext preferred locations constructor

2016-01-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-12627: - Assignee: Andrew Or > Remove SparkContext preferred locations constructor >

[jira] [Comment Edited] (SPARK-12414) Remove closure serializer

2015-12-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075814#comment-15075814 ] Andrew Or edited comment on SPARK-12414 at 12/31/15 7:51 AM: -

[jira] [Commented] (SPARK-12414) Remove closure serializer

2015-12-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075814#comment-15075814 ] Andrew Or commented on SPARK-12414: --- It's also for code cleanup. Right now SparkEnv has

[jira] [Assigned] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

2015-12-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-12582: - Assignee: Andrew Or > IndexShuffleBlockResolverSuite fails in windows >

[jira] [Updated] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

2015-12-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12582: -- Component/s: (was: Shuffle) Windows Tests > IndexShuffleBlockReso

[jira] [Updated] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

2015-12-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12582: -- Assignee: yucai (was: Andrew Or) > IndexShuffleBlockResolverSuite fails in windows > -

[jira] [Updated] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

2015-12-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12582: -- Assignee: (was: Apache Spark) Target Version/s: 1.6.1, 2.0.0 > IndexShuffleBlockResolve

[jira] [Updated] (SPARK-12554) Standalone mode may hang if max cores is not a multiple of executor cores

2015-12-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12554: -- Priority: Minor (was: Major) > Standalone mode may hang if max cores is not a multiple of executor cor

[jira] [Updated] (SPARK-12554) Standalone mode may hang if max cores is not a multiple of executor cores

2015-12-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12554: -- Summary: Standalone mode may hang if max cores is not a multiple of executor cores (was: Standalone ap

[jira] [Commented] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

2015-12-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075353#comment-15075353 ] Andrew Or commented on SPARK-12554: --- [~jerrylead] The change you are proposing changes

[jira] [Created] (SPARK-12565) Document standalone mode jar distribution more clearly

2015-12-29 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12565: - Summary: Document standalone mode jar distribution more clearly Key: SPARK-12565 URL: https://issues.apache.org/jira/browse/SPARK-12565 Project: Spark Issue Type:

[jira] [Created] (SPARK-12561) Remove JobLogger

2015-12-29 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12561: - Summary: Remove JobLogger Key: SPARK-12561 URL: https://issues.apache.org/jira/browse/SPARK-12561 Project: Spark Issue Type: Sub-task Components: Spark C

[jira] [Commented] (SPARK-12415) Do not use closure serializer to serialize task result

2015-12-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15074201#comment-15074201 ] Andrew Or commented on SPARK-12415: --- Closed as Won't Fix. We can't use Kryo to serializ

[jira] [Closed] (SPARK-12415) Do not use closure serializer to serialize task result

2015-12-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-12415. - Resolution: Won't Fix > Do not use closure serializer to serialize task result >

[jira] [Commented] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

2015-12-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15074198#comment-15074198 ] Andrew Or commented on SPARK-12554: --- If anything I would say it's the calculation of {

[jira] [Commented] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

2015-12-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15074189#comment-15074189 ] Andrew Or commented on SPARK-12554: --- I've downgraded the issue. I also think the behav

[jira] [Updated] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

2015-12-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12554: -- Priority: Major (was: Critical) > Standalone app scheduler will hang when app.coreToAssign < minCoresP

[jira] [Updated] (SPARK-12559) Standalone cluster mode doesn't work with --packages

2015-12-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12559: -- Description: >From the mailing list: {quote} Another problem I ran into that you also might is that --p

[jira] [Created] (SPARK-12559) Standalone cluster mode doesn't work with --packages

2015-12-29 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12559: - Summary: Standalone cluster mode doesn't work with --packages Key: SPARK-12559 URL: https://issues.apache.org/jira/browse/SPARK-12559 Project: Spark Issue Type: Bu

[jira] [Updated] (SPARK-12411) Reconsider executor heartbeats rpc timeout

2015-12-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12411: -- Fix Version/s: 1.6.1 > Reconsider executor heartbeats rpc timeout > ---

[jira] [Updated] (SPARK-12411) Reconsider executor heartbeats rpc timeout

2015-12-23 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12411: -- Target Version/s: 1.6.1, 2.0.0 (was: 2.0.0) > Reconsider executor heartbeats rpc timeout > ---

[jira] [Assigned] (SPARK-12414) Remove closure serializer

2015-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-12414: - Assignee: Andrew Or > Remove closure serializer > - > >

[jira] [Created] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2015-12-22 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12485: - Summary: Rename "dynamic allocation" to "elastic scaling" Key: SPARK-12485 URL: https://issues.apache.org/jira/browse/SPARK-12485 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-12485) Rename "dynamic allocation" to "elastic scaling"

2015-12-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12485: -- Target Version/s: 2.0.0 > Rename "dynamic allocation" to "elastic scaling" > --

[jira] [Updated] (SPARK-12473) Reuse serializer instances for performance

2015-12-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12473: -- Description: After commit de02782 of page rank regressed from 242s to 260s, about 7%. Although current

[jira] [Updated] (SPARK-12473) Reuse serializer instances for performance

2015-12-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12473: -- Description: After commit de02782 of page rank regressed from 242s to 260s, about 7%. Although current

[jira] [Updated] (SPARK-12473) Reuse serializer instances for performance

2015-12-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12473: -- Description: After commit de02782 of page rank regressed from 242s to 260s, about 7%. The commit added

[jira] [Created] (SPARK-12473) Reuse serializer instances for performance

2015-12-21 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12473: - Summary: Reuse serializer instances for performance Key: SPARK-12473 URL: https://issues.apache.org/jira/browse/SPARK-12473 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12414) Remove closure serializer

2015-12-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12414: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-11806 > Remove closure serializer >

[jira] [Commented] (SPARK-12339) NullPointerException on stage kill from web UI

2015-12-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067154#comment-15067154 ] Andrew Or commented on SPARK-12339: --- I've updated the affected version to 2.0 since SPA

[jira] [Resolved] (SPARK-5882) Add a test for GraphLoader.edgeListFile

2015-12-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-5882. -- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.0.0 Target Ver

[jira] [Resolved] (SPARK-12392) Optimize a location order of broadcast blocks by considering preferred local hosts

2015-12-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12392. --- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.0.0 Target

[jira] [Updated] (SPARK-12339) NullPointerException on stage kill from web UI

2015-12-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12339: -- Affects Version/s: (was: 1.6.0) 2.0.0 > NullPointerException on stage kill f

[jira] [Resolved] (SPARK-12339) NullPointerException on stage kill from web UI

2015-12-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12339. --- Resolution: Fixed Assignee: Alex Bozarth (was: Apache Spark) Fix Version/s:

[jira] [Resolved] (SPARK-12466) Harmless Master NPE in tests

2015-12-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12466. --- Resolution: Fixed > Harmless Master NPE in tests > > > K

[jira] [Resolved] (SPARK-2331) SparkContext.emptyRDD should return RDD[T] not EmptyRDD[T]

2015-12-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-2331. -- Resolution: Fixed Fix Version/s: 2.0.0 > SparkContext.emptyRDD should return RDD[T] not EmptyRDD[

[jira] [Commented] (SPARK-12464) Remove spark.deploy.mesos.zookeeper.url and use spark.deploy.zookeeper.url

2015-12-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067062#comment-15067062 ] Andrew Or commented on SPARK-12464: --- By the way for future reference you probably don't

[jira] [Created] (SPARK-12466) Harmless Master NPE in tests

2015-12-21 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12466: - Summary: Harmless Master NPE in tests Key: SPARK-12466 URL: https://issues.apache.org/jira/browse/SPARK-12466 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-12345) Mesos cluster mode is broken

2015-12-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15065047#comment-15065047 ] Andrew Or commented on SPARK-12345: --- For those who are following: There are 4 patches

[jira] [Updated] (SPARK-12413) Mesos ZK persistence throws a NotSerializableException

2015-12-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12413: -- Fix Version/s: (was: 2.0.0) > Mesos ZK persistence throws a NotSerializableException >

[jira] [Resolved] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

2015-12-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11097. --- Resolution: Fixed Fix Version/s: 2.0.0 > Add connection established callback to lower level RP

[jira] [Resolved] (SPARK-12411) Reconsider executor heartbeats rpc timeout

2015-12-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12411. --- Resolution: Fixed Assignee: Nong Li Fix Version/s: 2.0.0 Target Version/s

[jira] [Updated] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

2015-12-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11097: -- Assignee: Shixiong Zhu (was: Apache Spark) > Add connection established callback to lower level RPC la

[jira] [Updated] (SPARK-12365) Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called

2015-12-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12365: -- Target Version/s: 2.0.0 (was: 1.6.1, 2.0.0) > Use ShutdownHookManager where Runtime.getRuntime.addShut

[jira] [Updated] (SPARK-12365) Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called

2015-12-18 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12365: -- Fix Version/s: (was: 1.6.1) > Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is

[jira] [Created] (SPARK-12415) Do not use closure serializer to serialize task result

2015-12-17 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12415: - Summary: Do not use closure serializer to serialize task result Key: SPARK-12415 URL: https://issues.apache.org/jira/browse/SPARK-12415 Project: Spark Issue Type:

[jira] [Created] (SPARK-12414) Remove closure serializer

2015-12-17 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12414: - Summary: Remove closure serializer Key: SPARK-12414 URL: https://issues.apache.org/jira/browse/SPARK-12414 Project: Spark Issue Type: Bug Components: Spa

[jira] [Updated] (SPARK-12390) Clean up unused serializer parameter in BlockManager

2015-12-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12390: -- Fix Version/s: 1.6.1 > Clean up unused serializer parameter in BlockManager > -

[jira] [Resolved] (SPARK-12390) Clean up unused serializer parameter in BlockManager

2015-12-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12390. --- Resolution: Fixed > Clean up unused serializer parameter in BlockManager > --

[jira] [Assigned] (SPARK-12390) Clean up unused serializer parameter in BlockManager

2015-12-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-12390: - Assignee: Andrew Or (was: Apache Spark) > Clean up unused serializer parameter in BlockManager

[jira] [Updated] (SPARK-12390) Clean up unused serializer parameter in BlockManager

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12390: -- Fix Version/s: 2.0.0 > Clean up unused serializer parameter in BlockManager > -

[jira] [Resolved] (SPARK-12386) Setting "spark.executor.port" leads to NPE in SparkEnv

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12386. --- Resolution: Fixed Assignee: Marcelo Vanzin (was: Apache Spark) Fix Version/s

[jira] [Updated] (SPARK-12186) stage web URI will redirect to the wrong location if it is the first URI from the application to be requested from the history server

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12186: -- Fix Version/s: (was: 1.6.0) 2.0.0 1.6.1 > stage web URI will

[jira] [Updated] (SPARK-12186) stage web URI will redirect to the wrong location if it is the first URI from the application to be requested from the history server

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12186: -- Target Version/s: 1.6.1, 2.0.0 (was: 1.6.0) > stage web URI will redirect to the wrong location if it

[jira] [Resolved] (SPARK-12186) stage web URI will redirect to the wrong location if it is the first URI from the application to be requested from the history server

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12186. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > stage web URI will

[jira] [Updated] (SPARK-12186) stage web URI will redirect to the wrong location if it is the first URI from the application to be requested from the history server

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12186: -- Assignee: Rohit Agarwal > stage web URI will redirect to the wrong location if it is the first URI from

[jira] [Resolved] (SPARK-12365) Use ShutdownHookManager where Runtime.getRuntime.addShutdownHook() is called

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12365. --- Resolution: Fixed Assignee: Ted Yu (was: Apache Spark) Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-10248) DAGSchedulerSuite should check there were no errors in EventProcessLoop

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10248. --- Resolution: Fixed Assignee: Imran Rashid Fix Version/s: 2.0.0

[jira] [Created] (SPARK-12390) Clean up unused serializer parameter in BlockManager

2015-12-16 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12390: - Summary: Clean up unused serializer parameter in BlockManager Key: SPARK-12390 URL: https://issues.apache.org/jira/browse/SPARK-12390 Project: Spark Issue Type: Bu

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12345: -- Assignee: Timothy Chen (was: Luc Bourlier) > Mesos cluster mode is broken > --

[jira] [Resolved] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12345. --- Resolution: Fixed Assignee: Luc Bourlier (was: Apache Spark) > Mesos cluster mode is broken >

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12345: -- Fix Version/s: 1.6.0 > Mesos cluster mode is broken > > >

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12345: -- Target Version/s: 1.6.0 (was: 1.6.1) > Mesos cluster mode is broken > > >

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12345: -- Summary: Mesos cluster mode is broken (was: Mesos cluster mode is broken when SPARK_HOME is set) > Me

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken when SPARK_HOME is set

2015-12-16 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12345: -- Summary: Mesos cluster mode is broken when SPARK_HOME is set (was: Mesos cluster mode is broken) > Me

[jira] [Resolved] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-4514. -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 1.2.1, 1.1.2 (was: 1.1.2, 1.2.

[jira] [Updated] (SPARK-9026) SimpleFutureAction.onComplete should not tie up a separate thread for each callback

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9026: - Assignee: Richard W. Eggert II (was: Josh Rosen) > SimpleFutureAction.onComplete should not tie up a sepa

[jira] [Updated] (SPARK-4514) SparkContext localProperties does not inherit property updates across thread reuse

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4514: - Assignee: Richard W. Eggert II (was: Josh Rosen) > SparkContext localProperties does not inherit property

[jira] [Updated] (SPARK-4117) Spark on Yarn handle AM being told command from RM

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4117: - Assignee: Devaraj K > Spark on Yarn handle AM being told command from RM > ---

[jira] [Updated] (SPARK-9886) Validate usages of Runtime.getRuntime.addShutdownHook

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9886: - Assignee: Naveen Kumar Minchu > Validate usages of Runtime.getRuntime.addShutdownHook > --

[jira] [Resolved] (SPARK-4117) Spark on Yarn handle AM being told command from RM

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-4117. -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Spark on Yarn handle A

[jira] [Updated] (SPARK-10477) using DSL in ColumnPruningSuite to improve readablity

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10477: -- Component/s: Tests > using DSL in ColumnPruningSuite to improve readablity > --

[jira] [Resolved] (SPARK-10477) using DSL in ColumnPruningSuite to improve readablity

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10477. --- Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-12062) Master rebuilding historical SparkUI should be asynchronous

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12062. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 > Master rebuilding historical

[jira] [Resolved] (SPARK-9886) Validate usages of Runtime.getRuntime.addShutdownHook

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9886. -- Resolution: Fixed Assignee: (was: Apache Spark) Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-10123) Cannot set "--deploy-mode" in default configuration

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10123. --- Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 2.0.0 > Cannot set "--deploy-m

[jira] [Resolved] (SPARK-9026) SimpleFutureAction.onComplete should not tie up a separate thread for each callback

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9026. -- Resolution: Fixed Fix Version/s: 2.0.0 > SimpleFutureAction.onComplete should not tie up a separa

[jira] [Resolved] (SPARK-9516) Improve Thread Dump page

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9516. -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Improve Thread Dump pa

[jira] [Resolved] (SPARK-12351) Add documentation of submitting Mesos jobs with cluster mode

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12351. --- Resolution: Fixed Assignee: Timothy Chen Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-12130) Replace shuffleManagerClass with shortShuffleMgrNames in ExternalShuffleBlockResolver

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12130. --- Resolution: Fixed Assignee: Lianhui Wang Fix Version/s: 2.0.0 Target Vers

[jira] [Updated] (SPARK-12130) Replace shuffleManagerClass with shortShuffleMgrNames in ExternalShuffleBlockResolver

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12130: -- Issue Type: Improvement (was: Bug) > Replace shuffleManagerClass with shortShuffleMgrNames in > Exter

[jira] [Resolved] (SPARK-12105) Add a DataFrame.show() with argument for output PrintStream

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12105. --- Resolution: Fixed Assignee: Jean-Baptiste Onofré Fix Version/s: 2.0.0 Tar

[jira] [Updated] (SPARK-12345) Mesos cluster mode is broken

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12345: -- Target Version/s: 1.6.1 (was: 1.6.0) > Mesos cluster mode is broken > > >

[jira] [Updated] (SPARK-10250) Scala PairRDDFunctions.groupByKey() should be fault-tolerant of single large groups

2015-12-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10250: -- Summary: Scala PairRDDFunctions.groupByKey() should be fault-tolerant of single large groups (was: Sca

[jira] [Created] (SPARK-12345) Mesos cluster mode is broken

2015-12-15 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12345: - Summary: Mesos cluster mode is broken Key: SPARK-12345 URL: https://issues.apache.org/jira/browse/SPARK-12345 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-12062) Master rebuilding historical SparkUI should be asynchronous

2015-12-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12062: -- Target Version/s: 1.6.1, 2.0.0 > Master rebuilding historical SparkUI should be asynchronous >

[jira] [Reopened] (SPARK-12062) Master rebuilding historical SparkUI should be asynchronous

2015-12-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-12062: --- > Master rebuilding historical SparkUI should be asynchronous > -

[jira] [Resolved] (SPARK-12275) No plan for BroadcastHint in some condition

2015-12-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12275. --- Resolution: Fixed Fix Version/s: 1.5.3 Target Version/s: 1.5.3, 1.6.1, 2.0.0 (was: 1

[jira] [Commented] (SPARK-12062) Master rebuilding historical SparkUI should be asynchronous

2015-12-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15054829#comment-15054829 ] Andrew Or commented on SPARK-12062: --- I see, if you already have a patch then this is wo

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

2015-12-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053929#comment-15053929 ] Andrew Or commented on SPARK-6270: -- [~shivaram] That may be difficult to do because diffe

[jira] [Commented] (SPARK-6270) Standalone Master hangs when streaming job completes and event logging is enabled

2015-12-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053924#comment-15053924 ] Andrew Or commented on SPARK-6270: -- I have filed a JIRA for it: https://issues.apache.org

[jira] [Created] (SPARK-12299) Remove history serving functionality from standalone Master

2015-12-11 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12299: - Summary: Remove history serving functionality from standalone Master Key: SPARK-12299 URL: https://issues.apache.org/jira/browse/SPARK-12299 Project: Spark Issue

[jira] [Commented] (SPARK-12062) Master rebuilding historical SparkUI should be asynchronous

2015-12-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053923#comment-15053923 ] Andrew Or commented on SPARK-12062: --- Actually, I'm closing this as a Won't Fix since SP

<    1   2   3   4   5   6   7   8   9   10   >