[jira] [Created] (SPARK-10907) Get rid of pending unroll memory

Andrew Or created SPARK-10907: - Summary: Get rid of pending unroll memory Key: SPARK-10907 URL: https://issues.apache.org/jira/browse/SPARK-10907 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10851: -- Assignee: Sun Rui > Exception not failing R applications (in yarn cluster mode) >

[jira] [Resolved] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10851. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Exception not

[jira] [Updated] (SPARK-10825) Flaky test: StandaloneDynamicAllocationSuite

[ https://issues.apache.org/jira/browse/SPARK-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10825: -- Labels: flaky-test (was: ) > Flaky test: StandaloneDynamicAllocationSuite >

[jira] [Resolved] (SPARK-10825) Flaky test: StandaloneDynamicAllocationSuite

[ https://issues.apache.org/jira/browse/SPARK-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10825. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0

[jira] [Updated] (SPARK-10825) Flaky test: StandaloneDynamicAllocationSuite

[ https://issues.apache.org/jira/browse/SPARK-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10825: -- Priority: Critical (was: Major) > Flaky test: StandaloneDynamicAllocationSuite >

[jira] [Updated] (SPARK-10825) Flaky test: StandaloneDynamicAllocationSuite

[ https://issues.apache.org/jira/browse/SPARK-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10825: -- Summary: Flaky test: StandaloneDynamicAllocationSuite (was: Fix race conditions in

[jira] [Resolved] (SPARK-10871) Specify number of failed executors in ApplicationMaster error message

[ https://issues.apache.org/jira/browse/SPARK-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10871. --- Resolution: Fixed Assignee: Ryan Williams Fix Version/s: 1.6.0

[jira] [Updated] (SPARK-10864) SparkUI: app name is hidden if window is resized

[ https://issues.apache.org/jira/browse/SPARK-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10864: -- Attachment: Screen Shot 2015-09-28 at 5.44.06 PM.png > SparkUI: app name is hidden if window is

[jira] [Created] (SPARK-10864) SparkUI: app name is hidden if window is resized

Andrew Or created SPARK-10864: - Summary: SparkUI: app name is hidden if window is resized Key: SPARK-10864 URL: https://issues.apache.org/jira/browse/SPARK-10864 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10773) Repartition operation failing on RDD with "argument type mismatch" error

[ https://issues.apache.org/jira/browse/SPARK-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906803#comment-14906803 ] Andrew Or commented on SPARK-10773: --- I believe this is fixed in 1.5.0:

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905279#comment-14905279 ] Andrew Or commented on SPARK-10474: --- Re-opening this because I found the real cause for this issue

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905299#comment-14905299 ] Andrew Or commented on SPARK-10474: --- Alright, I think this should fix it for real:

[jira] [Resolved] (SPARK-10733) TungstenAggregation cannot acquire page after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10733. --- Resolution: Duplicate Looks like this is a duplicate of SPARK-10474 after all. I'm closing this...

[jira] [Reopened] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-10474: --- > TungstenAggregation cannot acquire memory for pointer array after switching > to sort-based >

[jira] [Created] (SPARK-10783) Do track the pointer array in UnsafeInMemorySorter

Andrew Or created SPARK-10783: - Summary: Do track the pointer array in UnsafeInMemorySorter Key: SPARK-10783 URL: https://issues.apache.org/jira/browse/SPARK-10783 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10474. - Resolution: Fixed > TungstenAggregation cannot acquire memory for pointer array after switching > to

[jira] [Updated] (SPARK-10458) Would like to know if a given Spark Context is stopped or currently stopping

[ https://issues.apache.org/jira/browse/SPARK-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10458: -- Assignee: Madhusudanan Kandasamy > Would like to know if a given Spark Context is stopped or currently

[jira] [Updated] (SPARK-10649) Streaming jobs unexpectedly inherits job group, job descriptions from context starting thread

[ https://issues.apache.org/jira/browse/SPARK-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10649: -- Fix Version/s: 1.5.1 > Streaming jobs unexpectedly inherits job group, job descriptions from context

[jira] [Updated] (SPARK-10695) spark.mesos.constraints documentation uses "=" to separate value instead ":" as parser and mesos expects.

[ https://issues.apache.org/jira/browse/SPARK-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10695: -- Assignee: Akash Mishra > spark.mesos.constraints documentation uses "=" to separate value instead ":"

[jira] [Resolved] (SPARK-10695) spark.mesos.constraints documentation uses "=" to separate value instead ":" as parser and mesos expects.

[ https://issues.apache.org/jira/browse/SPARK-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10695. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0, 1.5.1 (was: 1.5.1)

[jira] [Resolved] (SPARK-10458) Would like to know if a given Spark Context is stopped or currently stopping

[ https://issues.apache.org/jira/browse/SPARK-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10458. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Would like to know

[jira] [Updated] (SPARK-10695) spark.mesos.constraints documentation uses "=" to separate value instead ":" as parser and mesos expects.

[ https://issues.apache.org/jira/browse/SPARK-10695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10695: -- Component/s: Mesos > spark.mesos.constraints documentation uses "=" to separate value instead ":" >

[jira] [Resolved] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-8567. -- Resolution: Fixed Target Version/s: 1.5.0, 1.4.1, 1.6.0 (was: 1.4.1, 1.5.0, 1.6.0) > Flaky

[jira] [Updated] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8567: - Fix Version/s: 1.5.1 1.6.0 > Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars >

[jira] [Resolved] (SPARK-10640) Spark history server fails to parse taskEndReasonFromJson TaskCommitDenied

[ https://issues.apache.org/jira/browse/SPARK-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10640. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > Spark history server fails

[jira] [Updated] (SPARK-9585) HiveHBaseTableInputFormat can'be cached

[ https://issues.apache.org/jira/browse/SPARK-9585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9585: - Assignee: meiyoula > HiveHBaseTableInputFormat can'be cached > --- >

[jira] [Commented] (SPARK-10733) TungstenAggregation cannot acquire page after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902765#comment-14902765 ] Andrew Or commented on SPARK-10733: --- [~jameszhouyi] what do you mean "throw out" error message? I don't

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901694#comment-14901694 ] Andrew Or commented on SPARK-10474: --- Also, would you mind testing out this commit to see if it fixes

[jira] [Commented] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901043#comment-14901043 ] Andrew Or commented on SPARK-10474: --- I see, thanks for reporting. I think the fix was correct, but it

[jira] [Updated] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10474: -- Summary: TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[jira] [Created] (SPARK-10733) TungstenAggregation cannot acquire page after switching to sort-based

Andrew Or created SPARK-10733: - Summary: TungstenAggregation cannot acquire page after switching to sort-based Key: SPARK-10733 URL: https://issues.apache.org/jira/browse/SPARK-10733 Project: Spark

[jira] [Reopened] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-10474: --- > Aggregation failed with unable to acquire memory > >

[jira] [Closed] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10474. - Resolution: Fixed > Aggregation failed with unable to acquire memory >

[jira] [Updated] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10474: -- Summary: TungstenAggregation cannot acquire memory for pointer array (was: Aggregation failed with

[jira] [Reopened] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-10474: --- > Aggregation failed with unable to acquire memory > >

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901105#comment-14901105 ] Andrew Or commented on SPARK-10474: --- OK, I filed SPARK-10733 for that problem. It's a really a

[jira] [Resolved] (SPARK-10474) Aggregation failed with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10474. --- Resolution: Fixed > Aggregation failed with unable to acquire memory >

[jira] [Comment Edited] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901440#comment-14901440 ] Andrew Or edited comment on SPARK-10474 at 9/21/15 9:23 PM: [~jameszhouyi]

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901440#comment-14901440 ] Andrew Or commented on SPARK-10474: --- [~Yi Zhou] [~jrk] did you set `spark.task.cpus` by any chance? >

[jira] [Commented] (SPARK-10677) UnsafeExternalSorter should atomically release and acquire

[ https://issues.apache.org/jira/browse/SPARK-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14876138#comment-14876138 ] Andrew Or commented on SPARK-10677: --- Closing as Won't Fix because the ShuffleMemoryManager actually

[jira] [Resolved] (SPARK-10677) UnsafeExternalSorter should atomically release and acquire

[ https://issues.apache.org/jira/browse/SPARK-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10677. --- Resolution: Won't Fix > UnsafeExternalSorter should atomically release and acquire >

[jira] [Updated] (SPARK-8414) Ensure ContextCleaner actually triggers clean ups

[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8414: - Target Version/s: 1.6.0 (was: 1.5.1) > Ensure ContextCleaner actually triggers clean ups >

[jira] [Updated] (SPARK-10640) Spark history server fails to parse taskEndReasonFromJson TaskCommitDenied

[ https://issues.apache.org/jira/browse/SPARK-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10640: -- Target Version/s: 1.6.0, 1.5.1 (was: 1.5.1) > Spark history server fails to parse

[jira] [Updated] (SPARK-10640) Spark history server fails to parse taskEndReasonFromJson TaskCommitDenied

[ https://issues.apache.org/jira/browse/SPARK-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10640: -- Priority: Blocker (was: Critical) > Spark history server fails to parse taskEndReasonFromJson

[jira] [Created] (SPARK-10653) Remove unnecessary things from SparkEnv

Andrew Or created SPARK-10653: - Summary: Remove unnecessary things from SparkEnv Key: SPARK-10653 URL: https://issues.apache.org/jira/browse/SPARK-10653 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10650) Spark docs include test and other extra classes

[ https://issues.apache.org/jira/browse/SPARK-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10650: -- Target Version/s: 1.6.0, 1.5.1 (was: 1.5.1) > Spark docs include test and other extra classes >

[jira] [Created] (SPARK-10624) TakeOrderedAndProjectNode output is not ordered

Andrew Or created SPARK-10624: - Summary: TakeOrderedAndProjectNode output is not ordered Key: SPARK-10624 URL: https://issues.apache.org/jira/browse/SPARK-10624 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-10613) Reduce LocalNode tests dependency on SQLContext

[ https://issues.apache.org/jira/browse/SPARK-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10613. --- Resolution: Fixed Fix Version/s: 1.6.0 > Reduce LocalNode tests dependency on SQLContext >

[jira] [Resolved] (SPARK-10624) TakeOrderedAndProjectNode output is not ordered

[ https://issues.apache.org/jira/browse/SPARK-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10624. --- Resolution: Fixed Fix Version/s: 1.6.0 > TakeOrderedAndProjectNode output is not ordered >

[jira] [Resolved] (SPARK-10575) Wrap RDD.takeSample with scope

[ https://issues.apache.org/jira/browse/SPARK-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10575. --- Resolution: Fixed Fix Version/s: 1.6.0 > Wrap RDD.takeSample with scope >

[jira] [Resolved] (SPARK-10548) Concurrent execution in SQL does not work

[ https://issues.apache.org/jira/browse/SPARK-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10548. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > Concurrent execution in SQL

[jira] [Commented] (SPARK-10563) SparkContext's local properties should be cloned when inherited

[ https://issues.apache.org/jira/browse/SPARK-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14746512#comment-14746512 ] Andrew Or commented on SPARK-10563: --- NOTE: there's a subtle difference in behavior between branch-1.6

[jira] [Updated] (SPARK-8673) Launcher: add support for monitoring launched applications

[ https://issues.apache.org/jira/browse/SPARK-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8673: - Assignee: Marcelo Vanzin > Launcher: add support for monitoring launched applications >

[jira] [Resolved] (SPARK-10563) SparkContext's local properties should be cloned when inherited

[ https://issues.apache.org/jira/browse/SPARK-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10563. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > SparkContext's local

[jira] [Resolved] (SPARK-10612) Add prepare to LocalNode

[ https://issues.apache.org/jira/browse/SPARK-10612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10612. --- Resolution: Fixed Fix Version/s: 1.6.0 > Add prepare to LocalNode >

[jira] [Created] (SPARK-10613) Reduce LocalNode tests dependency on SQLContext

Andrew Or created SPARK-10613: - Summary: Reduce LocalNode tests dependency on SQLContext Key: SPARK-10613 URL: https://issues.apache.org/jira/browse/SPARK-10613 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-6946) Add visualization of logical and physical plans for SQL/DataFrames

[ https://issues.apache.org/jira/browse/SPARK-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6946. -- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Add visualization of

[jira] [Reopened] (SPARK-6943) Graphically show the RDD DAG on the UI

[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-6943: -- > Graphically show the RDD DAG on the UI > -- > > Key:

[jira] [Resolved] (SPARK-6944) Mechanism to associate generic operator scope with RDD's

[ https://issues.apache.org/jira/browse/SPARK-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6944. -- Resolution: Fixed > Mechanism to associate generic operator scope with RDD's >

[jira] [Resolved] (SPARK-6945) Provide SQL tab in the Spark UI

[ https://issues.apache.org/jira/browse/SPARK-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6945. -- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Provide SQL tab in

[jira] [Reopened] (SPARK-6944) Mechanism to associate generic operator scope with RDD's

[ https://issues.apache.org/jira/browse/SPARK-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-6944: -- > Mechanism to associate generic operator scope with RDD's >

[jira] [Resolved] (SPARK-6943) Graphically show the RDD DAG on the UI

[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6943. -- Resolution: Fixed > Graphically show the RDD DAG on the UI > -- > >

[jira] [Resolved] (SPARK-6942) Umbrella: UI Visualizations for Core and Dataframes

[ https://issues.apache.org/jira/browse/SPARK-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6942. -- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Umbrella: UI

[jira] [Updated] (SPARK-10563) SparkContext's local properties should be cloned when inherited

[ https://issues.apache.org/jira/browse/SPARK-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10563: -- Target Version/s: 1.6.0, 1.5.1 (was: 1.6.0) > SparkContext's local properties should be cloned when

[jira] [Updated] (SPARK-10598) RoutingTablePartition toMessage method refers to bytes instead of bits

[ https://issues.apache.org/jira/browse/SPARK-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10598: -- Assignee: Robin East > RoutingTablePartition toMessage method refers to bytes instead of bits >

[jira] [Resolved] (SPARK-10543) Peak Execution Memory Quantile should be Per-task Basis

[ https://issues.apache.org/jira/browse/SPARK-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10543. --- Resolution: Fixed Assignee: Sen Fang Fix Version/s: 1.5.1

[jira] [Updated] (SPARK-10575) Wrap RDD.takeSample with scope

[ https://issues.apache.org/jira/browse/SPARK-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10575: -- Affects Version/s: 1.4.0 Target Version/s: 1.6.0 > Wrap RDD.takeSample with scope >

[jira] [Resolved] (SPARK-10549) scala 2.11 spark on yarn with security - Repl doesn't work

[ https://issues.apache.org/jira/browse/SPARK-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10549. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 Target Version/s:

[jira] [Resolved] (SPARK-10594) ApplicationMaster "--help" references the removed "--num-executors" option

[ https://issues.apache.org/jira/browse/SPARK-10594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10594. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > ApplicationMaster

[jira] [Updated] (SPARK-10594) ApplicationMaster "--help" references the removed "--num-executors" option

[ https://issues.apache.org/jira/browse/SPARK-10594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10594: -- Assignee: Erick Tryzelaar > ApplicationMaster "--help" references the removed "--num-executors" option

[jira] [Resolved] (SPARK-9996) Create local nested loop join operator

[ https://issues.apache.org/jira/browse/SPARK-9996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9996. -- Resolution: Fixed Fix Version/s: 1.6.0 > Create local nested loop join operator >

[jira] [Resolved] (SPARK-9997) Create local Expand operator

[ https://issues.apache.org/jira/browse/SPARK-9997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9997. -- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Create local Expand

[jira] [Updated] (SPARK-10575) Wrap RDD.takeSample with scope

[ https://issues.apache.org/jira/browse/SPARK-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10575: -- Assignee: Vinod KC > Wrap RDD.takeSample with scope > -- > >

[jira] [Resolved] (SPARK-10576) Move .java files out of src/main/scala

[ https://issues.apache.org/jira/browse/SPARK-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10576. --- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 1.6.0 Target

[jira] [Updated] (SPARK-10564) ThreadingSuite: assertions in threads don't fail the test

[ https://issues.apache.org/jira/browse/SPARK-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10564: -- Description: In ThreadingSuite we have things like: {code} test(...) { ... val threads = (1

[jira] [Created] (SPARK-10563) SparkContext's local properties should be cloned when inherited

Andrew Or created SPARK-10563: - Summary: SparkContext's local properties should be cloned when inherited Key: SPARK-10563 URL: https://issues.apache.org/jira/browse/SPARK-10563 Project: Spark

[jira] [Created] (SPARK-10564) ThreadingSuite: assertions in threads don't fail the test

Andrew Or created SPARK-10564: - Summary: ThreadingSuite: assertions in threads don't fail the test Key: SPARK-10564 URL: https://issues.apache.org/jira/browse/SPARK-10564 Project: Spark Issue

[jira] [Resolved] (SPARK-9994) Create local TopK operator

[ https://issues.apache.org/jira/browse/SPARK-9994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9994. -- Resolution: Fixed Fix Version/s: 1.6.0 > Create local TopK operator > --

[jira] [Resolved] (SPARK-9992) Create local sample operator

[ https://issues.apache.org/jira/browse/SPARK-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9992. -- Resolution: Fixed Fix Version/s: 1.6.0 > Create local sample operator >

[jira] [Resolved] (SPARK-9998) Create local intersect operator

[ https://issues.apache.org/jira/browse/SPARK-9998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9998. -- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Create local

[jira] [Resolved] (SPARK-10564) ThreadingSuite: assertions in threads don't fail the test

[ https://issues.apache.org/jira/browse/SPARK-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10564. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > ThreadingSuite: assertions

[jira] [Updated] (SPARK-10563) SparkContext's local properties should be cloned when inherited

[ https://issues.apache.org/jira/browse/SPARK-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10563: -- Description: Currently, when a child thread inherits local properties from the parent thread, it gets

[jira] [Resolved] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-8167. -- Resolution: Fixed Fix Version/s: 1.6.0 > Tasks that fail due to YARN preemption can cause job

[jira] [Resolved] (SPARK-10466) UnsafeRow exception in Sort-Based Shuffle with data spill

[ https://issues.apache.org/jira/browse/SPARK-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10466. --- Resolution: Fixed Assignee: Cheng Hao Fix Version/s: 1.5.1

[jira] [Resolved] (SPARK-10469) Document tungsten-sort

[ https://issues.apache.org/jira/browse/SPARK-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10469. --- Resolution: Fixed Assignee: holdenk Fix Version/s: 1.5.1

[jira] [Updated] (SPARK-6350) Make mesosExecutorCores configurable in mesos "fine-grained" mode

[ https://issues.apache.org/jira/browse/SPARK-6350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6350: - Affects Version/s: 1.5.0 > Make mesosExecutorCores configurable in mesos "fine-grained" mode >

[jira] [Resolved] (SPARK-10514) Minimum ratio of registered resources [ spark.scheduler.minRegisteredResourcesRatio] is not enabled for Mesos Coarse Grained mode

[ https://issues.apache.org/jira/browse/SPARK-10514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10514. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Minimum ratio of

[jira] [Resolved] (SPARK-6350) Make mesosExecutorCores configurable in mesos "fine-grained" mode

[ https://issues.apache.org/jira/browse/SPARK-6350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6350. -- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 Target Version/s:

[jira] [Updated] (SPARK-10514) Minimum ratio of registered resources [ spark.scheduler.minRegisteredResourcesRatio] is not enabled for Mesos Coarse Grained mode

[ https://issues.apache.org/jira/browse/SPARK-10514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10514: -- Component/s: (was: Spark Core) Mesos > Minimum ratio of registered resources [ >

[jira] [Updated] (SPARK-10514) Minimum ratio of registered resources [ spark.scheduler.minRegisteredResourcesRatio] is not enabled for Mesos Coarse Grained mode

[ https://issues.apache.org/jira/browse/SPARK-10514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10514: -- Assignee: Akash Mishra > Minimum ratio of registered resources [ >

[jira] [Updated] (SPARK-10548) Concurrent execution in SQL does not work

[ https://issues.apache.org/jira/browse/SPARK-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10548: -- Description: >From the mailing list: {code} future { df1.count() } future { df2.count() }

[jira] [Updated] (SPARK-6350) Make mesosExecutorCores configurable in mesos "fine-grained" mode

[ https://issues.apache.org/jira/browse/SPARK-6350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6350: - Labels: backport-needed (was: ) > Make mesosExecutorCores configurable in mesos "fine-grained" mode >

[jira] [Reopened] (SPARK-6350) Make mesosExecutorCores configurable in mesos "fine-grained" mode

[ https://issues.apache.org/jira/browse/SPARK-6350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-6350: -- > Make mesosExecutorCores configurable in mesos "fine-grained" mode >

[jira] [Commented] (SPARK-6350) Make mesosExecutorCores configurable in mesos "fine-grained" mode

[ https://issues.apache.org/jira/browse/SPARK-6350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739645#comment-14739645 ] Andrew Or commented on SPARK-6350: -- re-opening this because it needs to be back ported into branch-1.5 >

[jira] [Updated] (SPARK-6350) Make mesosExecutorCores configurable in mesos "fine-grained" mode

[ https://issues.apache.org/jira/browse/SPARK-6350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6350: - Fix Version/s: (was: 1.5.1) > Make mesosExecutorCores configurable in mesos "fine-grained" mode >

[jira] [Updated] (SPARK-10548) Concurrent execution in SQL does not work

[ https://issues.apache.org/jira/browse/SPARK-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10548: -- Assignee: Andrew Or > Concurrent execution in SQL does not work >

[jira] [Resolved] (SPARK-9990) Create local hash join operator

[ https://issues.apache.org/jira/browse/SPARK-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9990. -- Resolution: Fixed Fix Version/s: 1.6.0 > Create local hash join operator >

[jira] [Created] (SPARK-10548) Concurrent execution in SQL does not work

Andrew Or created SPARK-10548: - Summary: Concurrent execution in SQL does not work Key: SPARK-10548 URL: https://issues.apache.org/jira/browse/SPARK-10548 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9998) Create local intersect operator

[ https://issues.apache.org/jira/browse/SPARK-9998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9998: - Assignee: Shixiong Zhu > Create local intersect operator > --- > >

<    8   9   10   11   12   13   14   15   16   17   >