[jira] [Resolved] (SPARK-10887) Build HashedRelation outside of HashJoinNode

[ https://issues.apache.org/jira/browse/SPARK-10887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10887. --- Resolution: Fixed Fix Version/s: 1.6.0 > Build HashedRelation outside of HashJoinNode > --

[jira] [Updated] (SPARK-7527) Wrong detection of REPL mode in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7527: - Target Version/s: 1.5.0, 1.4.2 (was: 1.5.0) > Wrong detection of REPL mode in ClosureCleaner > --

[jira] [Updated] (SPARK-7527) Wrong detection of REPL mode in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7527: - Fix Version/s: 1.4.2 > Wrong detection of REPL mode in ClosureCleaner > --

[jira] [Updated] (SPARK-10000) Consolidate storage and execution memory management

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1: -- Attachment: unified-memory-management-spark-1.pdf > Consolidate storage and execution memory manage

[jira] [Updated] (SPARK-10000) Consolidate storage and execution memory management

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1: -- Attachment: (was: unified-memory-management-spark-1.pdf) > Consolidate storage and execution me

[jira] [Updated] (SPARK-10000) Consolidate storage and execution memory management

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1: -- Summary: Consolidate storage and execution memory management (was: Consolidate cache memory management

[jira] [Created] (SPARK-10985) Avoid passing evicted blocks throughout BlockManager / CacheManager

Andrew Or created SPARK-10985: - Summary: Avoid passing evicted blocks throughout BlockManager / CacheManager Key: SPARK-10985 URL: https://issues.apache.org/jira/browse/SPARK-10985 Project: Spark

[jira] [Updated] (SPARK-10956) Introduce common memory management interface for execution and storage

[ https://issues.apache.org/jira/browse/SPARK-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10956: -- Affects Version/s: (was: 1.0.0) > Introduce common memory management interface for execution and st

[jira] [Updated] (SPARK-10956) Introduce common memory management interface for execution and storage

[ https://issues.apache.org/jira/browse/SPARK-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10956: -- Priority: Major (was: Critical) > Introduce common memory management interface for execution and stora

[jira] [Created] (SPARK-10984) Simplify *MemoryManager class structure

Andrew Or created SPARK-10984: - Summary: Simplify *MemoryManager class structure Key: SPARK-10984 URL: https://issues.apache.org/jira/browse/SPARK-10984 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-10983) Implement unified memory manager

Andrew Or created SPARK-10983: - Summary: Implement unified memory manager Key: SPARK-10983 URL: https://issues.apache.org/jira/browse/SPARK-10983 Project: Spark Issue Type: Sub-task Com

[jira] [Updated] (SPARK-10956) Introduce common memory management interface for execution and storage

[ https://issues.apache.org/jira/browse/SPARK-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10956: -- Description: The first step towards implementing a solution for SPARK-1 is to refactor the existin

[jira] [Updated] (SPARK-10956) Introduce common memory management interface for execution and storage

[ https://issues.apache.org/jira/browse/SPARK-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10956: -- Description: The first step towards implementing a solution for SPARK-1 is to refactor the existin

[jira] [Updated] (SPARK-10000) Consolidate cache memory management and execution memory management

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1: -- Attachment: unified-memory-management-spark-1.pdf > Consolidate cache memory management and executi

[jira] [Updated] (SPARK-10000) Consolidate cache memory management and execution memory management

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1: -- Description: Memory management in Spark is currently broken down into two disjoint regions: one for ex

[jira] [Updated] (SPARK-10000) Consolidate cache memory management and execution memory management

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1: -- Description: Memory management in Spark is currently broken down into two disjoint regions: one for ex

[jira] [Updated] (SPARK-10956) Introduce common memory management interface for execution and storage

[ https://issues.apache.org/jira/browse/SPARK-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10956: -- Description: Memory management in Spark is currently broken down into two disjoint regions: one for ex

[jira] [Created] (SPARK-10956) Introduce common memory management interface for execution and storage

Andrew Or created SPARK-10956: - Summary: Introduce common memory management interface for execution and storage Key: SPARK-10956 URL: https://issues.apache.org/jira/browse/SPARK-10956 Project: Spark

[jira] [Created] (SPARK-10907) Get rid of pending unroll memory

Andrew Or created SPARK-10907: - Summary: Get rid of pending unroll memory Key: SPARK-10907 URL: https://issues.apache.org/jira/browse/SPARK-10907 Project: Spark Issue Type: Bug Componen

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940232#comment-14940232 ] Andrew Or commented on SPARK-10474: --- [~nadenf] That's a different issue. In your stack

[jira] [Resolved] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10851. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Exception not faili

[jira] [Updated] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10851: -- Assignee: Sun Rui > Exception not failing R applications (in yarn cluster mode) > -

[jira] [Resolved] (SPARK-10871) Specify number of failed executors in ApplicationMaster error message

[ https://issues.apache.org/jira/browse/SPARK-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10871. --- Resolution: Fixed Assignee: Ryan Williams Fix Version/s: 1.6.0

[jira] [Updated] (SPARK-10825) Flaky test: StandaloneDynamicAllocationSuite

[ https://issues.apache.org/jira/browse/SPARK-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10825: -- Summary: Flaky test: StandaloneDynamicAllocationSuite (was: Fix race conditions in StandaloneDynamicAl

[jira] [Updated] (SPARK-10825) Flaky test: StandaloneDynamicAllocationSuite

[ https://issues.apache.org/jira/browse/SPARK-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10825: -- Priority: Critical (was: Major) > Flaky test: StandaloneDynamicAllocationSuite > -

[jira] [Resolved] (SPARK-10825) Flaky test: StandaloneDynamicAllocationSuite

[ https://issues.apache.org/jira/browse/SPARK-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10825. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0

[jira] [Updated] (SPARK-10825) Flaky test: StandaloneDynamicAllocationSuite

[ https://issues.apache.org/jira/browse/SPARK-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10825: -- Labels: flaky-test (was: ) > Flaky test: StandaloneDynamicAllocationSuite > --

[jira] [Created] (SPARK-10864) SparkUI: app name is hidden if window is resized

Andrew Or created SPARK-10864: - Summary: SparkUI: app name is hidden if window is resized Key: SPARK-10864 URL: https://issues.apache.org/jira/browse/SPARK-10864 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10864) SparkUI: app name is hidden if window is resized

[ https://issues.apache.org/jira/browse/SPARK-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10864: -- Attachment: Screen Shot 2015-09-28 at 5.44.06 PM.png > SparkUI: app name is hidden if window is resized

[jira] [Commented] (SPARK-10773) Repartition operation failing on RDD with "argument type mismatch" error

[ https://issues.apache.org/jira/browse/SPARK-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906803#comment-14906803 ] Andrew Or commented on SPARK-10773: --- I believe this is fixed in 1.5.0: https://issues.a

[jira] [Closed] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10474. - Resolution: Fixed > TungstenAggregation cannot acquire memory for pointer array after switching > to sor

[jira] [Created] (SPARK-10783) Do track the pointer array in UnsafeInMemorySorter

Andrew Or created SPARK-10783: - Summary: Do track the pointer array in UnsafeInMemorySorter Key: SPARK-10783 URL: https://issues.apache.org/jira/browse/SPARK-10783 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905299#comment-14905299 ] Andrew Or commented on SPARK-10474: --- Alright, I think this should fix it for real: http

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905279#comment-14905279 ] Andrew Or commented on SPARK-10474: --- Re-opening this because I found the real cause for

[jira] [Resolved] (SPARK-10733) TungstenAggregation cannot acquire page after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10733. --- Resolution: Duplicate Looks like this is a duplicate of SPARK-10474 after all. I'm closing this... >

[jira] [Reopened] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-10474: --- > TungstenAggregation cannot acquire memory for pointer array after switching > to sort-based >

[jira] [Resolved] (SPARK-10640) Spark history server fails to parse taskEndReasonFromJson TaskCommitDenied

[ https://issues.apache.org/jira/browse/SPARK-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10640. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > Spark history server fails t

[jira] [Updated] (SPARK-9585) HiveHBaseTableInputFormat can'be cached

[ https://issues.apache.org/jira/browse/SPARK-9585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9585: - Assignee: meiyoula > HiveHBaseTableInputFormat can'be cached > --- > >

[jira] [Commented] (SPARK-10733) TungstenAggregation cannot acquire page after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14902765#comment-14902765 ] Andrew Or commented on SPARK-10733: --- [~jameszhouyi] what do you mean "throw out" error

[jira] [Updated] (SPARK-10695) spark.mesos.constraints documentation uses "=" to separate value instead ":" as parser and mesos expects.

[ https://issues.apache.org/jira/browse/SPARK-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10695: -- Component/s: Mesos > spark.mesos.constraints documentation uses "=" to separate value instead ":" > as

[jira] [Updated] (SPARK-10695) spark.mesos.constraints documentation uses "=" to separate value instead ":" as parser and mesos expects.

[ https://issues.apache.org/jira/browse/SPARK-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10695: -- Assignee: Akash Mishra > spark.mesos.constraints documentation uses "=" to separate value instead ":"

[jira] [Resolved] (SPARK-10695) spark.mesos.constraints documentation uses "=" to separate value instead ":" as parser and mesos expects.

[ https://issues.apache.org/jira/browse/SPARK-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10695. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0, 1.5.1 (was: 1.5.1)

[jira] [Resolved] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-8567. -- Resolution: Fixed Target Version/s: 1.5.0, 1.4.1, 1.6.0 (was: 1.4.1, 1.5.0, 1.6.0) > Flaky te

[jira] [Updated] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8567: - Fix Version/s: 1.5.1 1.6.0 > Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars > -

[jira] [Updated] (SPARK-10649) Streaming jobs unexpectedly inherits job group, job descriptions from context starting thread

[ https://issues.apache.org/jira/browse/SPARK-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10649: -- Fix Version/s: 1.5.1 > Streaming jobs unexpectedly inherits job group, job descriptions from context >

[jira] [Updated] (SPARK-10458) Would like to know if a given Spark Context is stopped or currently stopping

[ https://issues.apache.org/jira/browse/SPARK-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10458: -- Assignee: Madhusudanan Kandasamy > Would like to know if a given Spark Context is stopped or currently

[jira] [Resolved] (SPARK-10458) Would like to know if a given Spark Context is stopped or currently stopping

[ https://issues.apache.org/jira/browse/SPARK-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10458. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Would like to know

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14901694#comment-14901694 ] Andrew Or commented on SPARK-10474: --- Also, would you mind testing out this commit to se

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14901440#comment-14901440 ] Andrew Or commented on SPARK-10474: --- [~Yi Zhou] [~jrk] did you set `spark.task.cpus` by

[jira] [Comment Edited] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14901440#comment-14901440 ] Andrew Or edited comment on SPARK-10474 at 9/21/15 9:23 PM: [

[jira] [Created] (SPARK-10733) TungstenAggregation cannot acquire page after switching to sort-based

Andrew Or created SPARK-10733: - Summary: TungstenAggregation cannot acquire page after switching to sort-based Key: SPARK-10733 URL: https://issues.apache.org/jira/browse/SPARK-10733 Project: Spark

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14901105#comment-14901105 ] Andrew Or commented on SPARK-10474: --- OK, I filed SPARK-10733 for that problem. It's a r

[jira] [Updated] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10474: -- Summary: TungstenAggregation cannot acquire memory for pointer array after switching to sort-based (wa

[jira] [Updated] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10474: -- Summary: TungstenAggregation cannot acquire memory for pointer array (was: Aggregation failed with una

[jira] [Reopened] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-10474: --- > Aggregation failed with unable to acquire memory > > >

[jira] [Closed] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10474. - Resolution: Fixed > Aggregation failed with unable to acquire memory > --

[jira] [Resolved] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10474. --- Resolution: Fixed > Aggregation failed with unable to acquire memory > --

[jira] [Reopened] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-10474: --- > Aggregation failed with unable to acquire memory > > >

[jira] [Commented] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14901043#comment-14901043 ] Andrew Or commented on SPARK-10474: --- I see, thanks for reporting. I think the fix was c

[jira] [Resolved] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10474. --- Resolution: Fixed Assignee: Andrew Or Fix Version/s: 1.5.1 1.6.0 >

[jira] [Commented] (SPARK-10677) UnsafeExternalSorter should atomically release and acquire

[ https://issues.apache.org/jira/browse/SPARK-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876138#comment-14876138 ] Andrew Or commented on SPARK-10677: --- Closing as Won't Fix because the ShuffleMemoryMana

[jira] [Resolved] (SPARK-10677) UnsafeExternalSorter should atomically release and acquire

[ https://issues.apache.org/jira/browse/SPARK-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10677. --- Resolution: Won't Fix > UnsafeExternalSorter should atomically release and acquire >

[jira] [Updated] (SPARK-10640) Spark history server fails to parse taskEndReasonFromJson TaskCommitDenied

[ https://issues.apache.org/jira/browse/SPARK-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10640: -- Target Version/s: 1.6.0, 1.5.1 (was: 1.5.1) > Spark history server fails to parse taskEndReasonFromJso

[jira] [Updated] (SPARK-10640) Spark history server fails to parse taskEndReasonFromJson TaskCommitDenied

[ https://issues.apache.org/jira/browse/SPARK-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10640: -- Priority: Blocker (was: Critical) > Spark history server fails to parse taskEndReasonFromJson TaskComm

[jira] [Updated] (SPARK-8414) Ensure ContextCleaner actually triggers clean ups

[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8414: - Target Version/s: 1.6.0 (was: 1.5.1) > Ensure ContextCleaner actually triggers clean ups > --

[jira] [Created] (SPARK-10677) UnsafeExternalSorter should atomically release and acquire

Andrew Or created SPARK-10677: - Summary: UnsafeExternalSorter should atomically release and acquire Key: SPARK-10677 URL: https://issues.apache.org/jira/browse/SPARK-10677 Project: Spark Issue Ty

[jira] [Created] (SPARK-10653) Remove unnecessary things from SparkEnv

Andrew Or created SPARK-10653: - Summary: Remove unnecessary things from SparkEnv Key: SPARK-10653 URL: https://issues.apache.org/jira/browse/SPARK-10653 Project: Spark Issue Type: Bug C

[jira] [Updated] (SPARK-10650) Spark docs include test and other extra classes

[ https://issues.apache.org/jira/browse/SPARK-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10650: -- Target Version/s: 1.6.0, 1.5.1 (was: 1.5.1) > Spark docs include test and other extra classes > --

[jira] [Updated] (SPARK-8673) Launcher: add support for monitoring launched applications

[ https://issues.apache.org/jira/browse/SPARK-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8673: - Assignee: Marcelo Vanzin > Launcher: add support for monitoring launched applications > --

[jira] [Resolved] (SPARK-10624) TakeOrderedAndProjectNode output is not ordered

[ https://issues.apache.org/jira/browse/SPARK-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10624. --- Resolution: Fixed Fix Version/s: 1.6.0 > TakeOrderedAndProjectNode output is not ordered > ---

[jira] [Resolved] (SPARK-10613) Reduce LocalNode tests dependency on SQLContext

[ https://issues.apache.org/jira/browse/SPARK-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10613. --- Resolution: Fixed Fix Version/s: 1.6.0 > Reduce LocalNode tests dependency on SQLContext > ---

[jira] [Resolved] (SPARK-10575) Wrap RDD.takeSample with scope

[ https://issues.apache.org/jira/browse/SPARK-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10575. --- Resolution: Fixed Fix Version/s: 1.6.0 > Wrap RDD.takeSample with scope >

[jira] [Resolved] (SPARK-10612) Add prepare to LocalNode

[ https://issues.apache.org/jira/browse/SPARK-10612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10612. --- Resolution: Fixed Fix Version/s: 1.6.0 > Add prepare to LocalNode > >

[jira] [Resolved] (SPARK-10548) Concurrent execution in SQL does not work

[ https://issues.apache.org/jira/browse/SPARK-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10548. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > Concurrent execution in SQL

[jira] [Commented] (SPARK-10563) SparkContext's local properties should be cloned when inherited

[ https://issues.apache.org/jira/browse/SPARK-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14746512#comment-14746512 ] Andrew Or commented on SPARK-10563: --- NOTE: there's a subtle difference in behavior betw

[jira] [Resolved] (SPARK-10563) SparkContext's local properties should be cloned when inherited

[ https://issues.apache.org/jira/browse/SPARK-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10563. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > SparkContext's local propert

[jira] [Created] (SPARK-10624) TakeOrderedAndProjectNode output is not ordered

Andrew Or created SPARK-10624: - Summary: TakeOrderedAndProjectNode output is not ordered Key: SPARK-10624 URL: https://issues.apache.org/jira/browse/SPARK-10624 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-6942) Umbrella: UI Visualizations for Core and Dataframes

[ https://issues.apache.org/jira/browse/SPARK-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6942. -- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Umbrella: UI Visualiza

[jira] [Resolved] (SPARK-6943) Graphically show the RDD DAG on the UI

[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6943. -- Resolution: Fixed > Graphically show the RDD DAG on the UI > -- > >

[jira] [Reopened] (SPARK-6944) Mechanism to associate generic operator scope with RDD's

[ https://issues.apache.org/jira/browse/SPARK-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-6944: -- > Mechanism to associate generic operator scope with RDD's > ---

[jira] [Resolved] (SPARK-6945) Provide SQL tab in the Spark UI

[ https://issues.apache.org/jira/browse/SPARK-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6945. -- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Provide SQL tab in the

[jira] [Resolved] (SPARK-6946) Add visualization of logical and physical plans for SQL/DataFrames

[ https://issues.apache.org/jira/browse/SPARK-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6946. -- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Add visualization of l

[jira] [Reopened] (SPARK-6943) Graphically show the RDD DAG on the UI

[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-6943: -- > Graphically show the RDD DAG on the UI > -- > > Key: S

[jira] [Resolved] (SPARK-6944) Mechanism to associate generic operator scope with RDD's

[ https://issues.apache.org/jira/browse/SPARK-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6944. -- Resolution: Fixed > Mechanism to associate generic operator scope with RDD's > -

[jira] [Created] (SPARK-10613) Reduce LocalNode tests dependency on SQLContext

Andrew Or created SPARK-10613: - Summary: Reduce LocalNode tests dependency on SQLContext Key: SPARK-10613 URL: https://issues.apache.org/jira/browse/SPARK-10613 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-10543) Peak Execution Memory Quantile should be Per-task Basis

[ https://issues.apache.org/jira/browse/SPARK-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10543. --- Resolution: Fixed Assignee: Sen Fang Fix Version/s: 1.5.1

[jira] [Resolved] (SPARK-10549) scala 2.11 spark on yarn with security - Repl doesn't work

[ https://issues.apache.org/jira/browse/SPARK-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10549. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 Target Version/s:

[jira] [Resolved] (SPARK-10576) Move .java files out of src/main/scala

[ https://issues.apache.org/jira/browse/SPARK-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10576. --- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 1.6.0 Target Version

[jira] [Resolved] (SPARK-10594) ApplicationMaster "--help" references the removed "--num-executors" option

[ https://issues.apache.org/jira/browse/SPARK-10594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10594. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > ApplicationMaster "

[jira] [Updated] (SPARK-10594) ApplicationMaster "--help" references the removed "--num-executors" option

[ https://issues.apache.org/jira/browse/SPARK-10594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10594: -- Assignee: Erick Tryzelaar > ApplicationMaster "--help" references the removed "--num-executors" option

[jira] [Resolved] (SPARK-9996) Create local nested loop join operator

[ https://issues.apache.org/jira/browse/SPARK-9996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9996. -- Resolution: Fixed Fix Version/s: 1.6.0 > Create local nested loop join operator > ---

[jira] [Resolved] (SPARK-9997) Create local Expand operator

[ https://issues.apache.org/jira/browse/SPARK-9997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9997. -- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Create local Expand op

[jira] [Updated] (SPARK-10598) RoutingTablePartition toMessage method refers to bytes instead of bits

[ https://issues.apache.org/jira/browse/SPARK-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10598: -- Assignee: Robin East > RoutingTablePartition toMessage method refers to bytes instead of bits > ---

[jira] [Updated] (SPARK-10575) Wrap RDD.takeSample with scope

[ https://issues.apache.org/jira/browse/SPARK-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10575: -- Assignee: Vinod KC > Wrap RDD.takeSample with scope > -- > >

[jira] [Updated] (SPARK-10575) Wrap RDD.takeSample with scope

[ https://issues.apache.org/jira/browse/SPARK-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10575: -- Affects Version/s: 1.4.0 Target Version/s: 1.6.0 > Wrap RDD.takeSample with scope > --

[jira] [Updated] (SPARK-10563) SparkContext's local properties should be cloned when inherited

[ https://issues.apache.org/jira/browse/SPARK-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10563: -- Target Version/s: 1.6.0, 1.5.1 (was: 1.6.0) > SparkContext's local properties should be cloned when in

[jira] [Resolved] (SPARK-10564) ThreadingSuite: assertions in threads don't fail the test

[ https://issues.apache.org/jira/browse/SPARK-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10564. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > ThreadingSuite: assertions i

[jira] [Resolved] (SPARK-9998) Create local intersect operator

[ https://issues.apache.org/jira/browse/SPARK-9998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9998. -- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Create local intersect

[jira] [Resolved] (SPARK-9994) Create local TopK operator

[ https://issues.apache.org/jira/browse/SPARK-9994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9994. -- Resolution: Fixed Fix Version/s: 1.6.0 > Create local TopK operator > --

[jira] [Resolved] (SPARK-9992) Create local sample operator

[ https://issues.apache.org/jira/browse/SPARK-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9992. -- Resolution: Fixed Fix Version/s: 1.6.0 > Create local sample operator > -

<    4   5   6   7   8   9   10   11   12   13   >