[jira] [Commented] (SPARK-5088) Use spark-class for running executors directly

2015-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264282#comment-14264282 ] Apache Spark commented on SPARK-5088: - User 'jongyoul' has created a pull request for

[jira] [Updated] (SPARK-5009) allCaseVersions function in SqlLexical leads to StackOverflow Exception

2015-01-04 Thread shengli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shengli updated SPARK-5009: --- Description: Recently I found a bug when I add new feature in SqlParser. Which is : If I define a KeyWord

[jira] [Created] (SPARK-5074) Fix a non-deterministic test in org.apache.spark.scheduler.DAGSchedulerSuite

2015-01-04 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-5074: --- Summary: Fix a non-deterministic test in org.apache.spark.scheduler.DAGSchedulerSuite Key: SPARK-5074 URL: https://issues.apache.org/jira/browse/SPARK-5074 Project:

[jira] [Commented] (SPARK-5074) Fix a non-deterministic test in org.apache.spark.scheduler.DAGSchedulerSuite

2015-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263838#comment-14263838 ] Apache Spark commented on SPARK-5074: - User 'zsxwing' has created a pull request for

[jira] [Commented] (SPARK-5064) GraphX rmatGraph hangs

2015-01-04 Thread Tomas Hudik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263875#comment-14263875 ] Tomas Hudik commented on SPARK-5064: the same behavior can be seen in version

[jira] [Commented] (SPARK-5068) When the path not found in the hdfs,we can't get the result

2015-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263902#comment-14263902 ] Apache Spark commented on SPARK-5068: - User 'jeanlyn' has created a pull request for

[jira] [Commented] (SPARK-5059) list of user's objects in Spark REPL

2015-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263908#comment-14263908 ] Apache Spark commented on SPARK-5059: - User 'xhudik' has created a pull request for

[jira] [Commented] (SPARK-3306) Addition of external resource dependency in executors

2015-01-04 Thread Yan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263914#comment-14263914 ] Yan commented on SPARK-3306: Yes, close/cleanup will be supported, plus a show/list

[jira] [Commented] (SPARK-5036) Better support sending partial messages in Pregel API

2015-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263786#comment-14263786 ] Apache Spark commented on SPARK-5036: - User 'shijinkui' has created a pull request for

[jira] [Commented] (SPARK-5066) Can not get all key that has same hashcode when reading key ordered from different Streaming.

2015-01-04 Thread guowei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263787#comment-14263787 ] guowei commented on SPARK-5066: --- it should return K4 first in your example Can not get all

[jira] [Created] (SPARK-5069) Race condition in TaskSchedulerImpl.dagScheduler

2015-01-04 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-5069: --- Summary: Race condition in TaskSchedulerImpl.dagScheduler Key: SPARK-5069 URL: https://issues.apache.org/jira/browse/SPARK-5069 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-5070) Race condition in TaskSchedulerImpl.dagScheduler

2015-01-04 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-5070: --- Summary: Race condition in TaskSchedulerImpl.dagScheduler Key: SPARK-5070 URL: https://issues.apache.org/jira/browse/SPARK-5070 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-5071) Race condition in TaskSchedulerImpl.dagScheduler

2015-01-04 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-5071: --- Summary: Race condition in TaskSchedulerImpl.dagScheduler Key: SPARK-5071 URL: https://issues.apache.org/jira/browse/SPARK-5071 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-5072) Race condition in TaskSchedulerImpl.dagScheduler

2015-01-04 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-5072: --- Summary: Race condition in TaskSchedulerImpl.dagScheduler Key: SPARK-5072 URL: https://issues.apache.org/jira/browse/SPARK-5072 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-5070) Race condition in TaskSchedulerImpl.dagScheduler

2015-01-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu closed SPARK-5070. --- Resolution: Fixed Race condition in TaskSchedulerImpl.dagScheduler

[jira] [Commented] (SPARK-5069) Race condition in TaskSchedulerImpl.dagScheduler

2015-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263795#comment-14263795 ] Apache Spark commented on SPARK-5069: - User 'zsxwing' has created a pull request for

[jira] [Closed] (SPARK-5072) Race condition in TaskSchedulerImpl.dagScheduler

2015-01-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu closed SPARK-5072. --- Resolution: Duplicate Create the duplicate issue due to bad network. Race condition in

[jira] [Closed] (SPARK-5071) Race condition in TaskSchedulerImpl.dagScheduler

2015-01-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu closed SPARK-5071. --- Resolution: Duplicate Sorry that creating the dulicate issue due to bad network. Race condition in

[jira] [Closed] (SPARK-5070) Race condition in TaskSchedulerImpl.dagScheduler

2015-01-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu closed SPARK-5070. --- Resolution: Duplicate Sorry that creating the dulicate issue due to bad network. Race condition in

[jira] [Reopened] (SPARK-5070) Race condition in TaskSchedulerImpl.dagScheduler

2015-01-04 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reopened SPARK-5070: - Race condition in TaskSchedulerImpl.dagScheduler

[jira] [Commented] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

2015-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263815#comment-14263815 ] Apache Spark commented on SPARK-4226: - User 'saucam' has created a pull request for

[jira] [Created] (SPARK-5073) spark.storage.memoryMapThreshold have two default value

2015-01-04 Thread Yuan Jianhui (JIRA)
Yuan Jianhui created SPARK-5073: --- Summary: spark.storage.memoryMapThreshold have two default value Key: SPARK-5073 URL: https://issues.apache.org/jira/browse/SPARK-5073 Project: Spark Issue

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2015-01-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263823#comment-14263823 ] Sean Owen commented on SPARK-1529: -- So Spark needs to read and write local files for

[jira] [Commented] (SPARK-4779) PySpark Shuffle Fails Looking for Files that Don't Exist when low on Memory

2015-01-04 Thread Brad Willard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263925#comment-14263925 ] Brad Willard commented on SPARK-4779: - [~davies] I've already killed the environment

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2015-01-04 Thread Kannan Rajah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263928#comment-14263928 ] Kannan Rajah commented on SPARK-1529: - In a MapR distribution, these files need to go

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

2015-01-04 Thread Stephen Haberman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263956#comment-14263956 ] Stephen Haberman commented on SPARK-3633: - Sorry for the latest reply on this, but

[jira] [Updated] (SPARK-794) Remove sleep() in ClusterScheduler.stop

2015-01-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-794: - Target Version/s: 1.2.1 Fix Version/s: 1.3.0 Labels: backport-needed (was: ) I'm

[jira] [Created] (SPARK-5075) Memory Leak when repartitioning SchemaRDD from JSON

2015-01-04 Thread Brad Willard (JIRA)
Brad Willard created SPARK-5075: --- Summary: Memory Leak when repartitioning SchemaRDD from JSON Key: SPARK-5075 URL: https://issues.apache.org/jira/browse/SPARK-5075 Project: Spark Issue Type:

[jira] [Created] (SPARK-5076) Don't show Cores or Memory Per Node columns for completed applications

2015-01-04 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-5076: - Summary: Don't show Cores or Memory Per Node columns for completed applications Key: SPARK-5076 URL: https://issues.apache.org/jira/browse/SPARK-5076 Project: Spark

[jira] [Updated] (SPARK-4787) Resource unreleased during failure in SparkContext initialization

2015-01-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4787: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-4194 Resource unreleased during failure in

[jira] [Updated] (SPARK-4787) Clean up resources in SparkContext if errors occur during DAGScheduler initialization

2015-01-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4787: -- Summary: Clean up resources in SparkContext if errors occur during DAGScheduler initialization (was:

[jira] [Updated] (SPARK-4787) Clean up SparkContext after DAGScheduler initialization errors

2015-01-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4787: -- Description: If an exception occurs when creating the DAGScheduler, then other resources in

[jira] [Updated] (SPARK-4787) Clean up SparkContext after DAGScheduler initialization errors

2015-01-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4787: -- Assignee: Dale Richardson Clean up SparkContext after DAGScheduler initialization errors

[jira] [Resolved] (SPARK-4787) Clean up SparkContext after DAGScheduler initialization errors

2015-01-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4787. --- Resolution: Fixed Fix Version/s: 1.2.1 1.0.3 1.1.2 Issue

[jira] [Updated] (SPARK-5074) Fix a non-deterministic test in org.apache.spark.scheduler.DAGSchedulerSuite

2015-01-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5074: -- Labels: flaky-test (was: ) Fix a non-deterministic test in

[jira] [Created] (SPARK-5077) Map output statuses can still exceed spark.akka.frameSize

2015-01-04 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-5077: - Summary: Map output statuses can still exceed spark.akka.frameSize Key: SPARK-5077 URL: https://issues.apache.org/jira/browse/SPARK-5077 Project: Spark Issue

[jira] [Commented] (SPARK-5027) add SVMWithLBFGS interface in MLLIB

2015-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264111#comment-14264111 ] Apache Spark commented on SPARK-5027: - User 'loachli' has created a pull request for

[jira] [Commented] (SPARK-2352) [MLLIB] Add Artificial Neural Network (ANN) to Spark

2015-01-04 Thread Nathan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264117#comment-14264117 ] Nathan M commented on SPARK-2352: - We'd really like to see this - any updates? [MLLIB]

[jira] [Commented] (SPARK-5078) Allow setting Akka host name from env vars

2015-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264123#comment-14264123 ] Apache Spark commented on SPARK-5078: - User 'marmbrus' has created a pull request for

[jira] [Created] (SPARK-5078) Allow setting Akka host name from env vars

2015-01-04 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-5078: --- Summary: Allow setting Akka host name from env vars Key: SPARK-5078 URL: https://issues.apache.org/jira/browse/SPARK-5078 Project: Spark Issue Type:

[jira] [Created] (SPARK-5079) Detect failed jobs / batches in Spark Streaming unit tests

2015-01-04 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-5079: - Summary: Detect failed jobs / batches in Spark Streaming unit tests Key: SPARK-5079 URL: https://issues.apache.org/jira/browse/SPARK-5079 Project: Spark Issue

[jira] [Updated] (SPARK-5068) When the path not found in the hdfs,we can't get the result

2015-01-04 Thread jeanlyn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn updated SPARK-5068: --- Fix Version/s: 1.2.1 When the path not found in the hdfs,we can't get the result

[jira] [Created] (SPARK-5080) Expose more cluster resource information to user

2015-01-04 Thread Rui Li (JIRA)
Rui Li created SPARK-5080: - Summary: Expose more cluster resource information to user Key: SPARK-5080 URL: https://issues.apache.org/jira/browse/SPARK-5080 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-5081) Shuffle write increases

2015-01-04 Thread Kevin Jung (JIRA)
Kevin Jung created SPARK-5081: - Summary: Shuffle write increases Key: SPARK-5081 URL: https://issues.apache.org/jira/browse/SPARK-5081 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-4835) Streaming saveAs*HadoopFiles() methods may throw FileAlreadyExistsException during checkpoint recovery

2015-01-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264172#comment-14264172 ] Tathagata Das commented on SPARK-4835: -- [~joshrosen] Even if this resolved, there

[jira] [Resolved] (SPARK-4835) Streaming saveAs*HadoopFiles() methods may throw FileAlreadyExistsException during checkpoint recovery

2015-01-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4835. -- Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Streaming

[jira] [Commented] (SPARK-4835) Streaming saveAs*HadoopFiles() methods may throw FileAlreadyExistsException during checkpoint recovery

2015-01-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264176#comment-14264176 ] Josh Rosen commented on SPARK-4835: --- Yeah, let's open a second followup JIRA for that.

[jira] [Comment Edited] (SPARK-5085) netty shuffle service causing connection timeouts

2015-01-04 Thread Stephen Haberman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264196#comment-14264196 ] Stephen Haberman edited comment on SPARK-5085 at 1/5/15 5:32 AM:

[jira] [Created] (SPARK-5086) Specifying the master instance type

2015-01-04 Thread inkyu lee (JIRA)
inkyu lee created SPARK-5086: Summary: Specifying the master instance type Key: SPARK-5086 URL: https://issues.apache.org/jira/browse/SPARK-5086 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-5087) Merge yarn.Client and yarn.ClientBase

2015-01-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-5087: -- Summary: Merge yarn.Client and yarn.ClientBase (was: Consolidate yarn.Client and yarn.ClientBase)

[jira] [Commented] (SPARK-5084) when mysql is used as the metadata storage for spark-sql, Exception occurs when HiveQuerySuite is excute

2015-01-04 Thread baishuo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264225#comment-14264225 ] baishuo commented on SPARK-5084: the exception like this: from

[jira] [Created] (SPARK-5088) Use spark-class for running executors directly

2015-01-04 Thread Jongyoul Lee (JIRA)
Jongyoul Lee created SPARK-5088: --- Summary: Use spark-class for running executors directly Key: SPARK-5088 URL: https://issues.apache.org/jira/browse/SPARK-5088 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-5067) testTaskInfo doesn't compare SparkListenerApplicationStart.appId

2015-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5067. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Shixiong Zhu testTaskInfo doesn't

[jira] [Updated] (SPARK-5081) Shuffle write increases

2015-01-04 Thread Kevin Jung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Jung updated SPARK-5081: -- Description: The size of shuffle write showing in spark web UI is much different when I execute same

[jira] [Commented] (SPARK-5084) when mysql is used as the metadata storage for spark-sql, Exception occurs when HiveQuerySuite is excute

2015-01-04 Thread jeanlyn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264183#comment-14264183 ] jeanlyn commented on SPARK-5084: more description? when mysql is used as the metadata

[jira] [Resolved] (SPARK-5069) Race condition in TaskSchedulerImpl.dagScheduler

2015-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5069. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Shixiong Zhu Race condition in

[jira] [Resolved] (SPARK-5083) Fix a flaky test in TaskResultGetterSuite

2015-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5083. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Shixiong Zhu Fix a flaky test in

[jira] [Commented] (SPARK-5007) Try random port when startServiceOnPort to reduce the chance of port collision

2015-01-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264191#comment-14264191 ] Reynold Xin commented on SPARK-5007: [~yantangzhai] making it trying random ports

[jira] [Created] (SPARK-5085) netty shuffle service causing connection timeouts

2015-01-04 Thread Stephen Haberman (JIRA)
Stephen Haberman created SPARK-5085: --- Summary: netty shuffle service causing connection timeouts Key: SPARK-5085 URL: https://issues.apache.org/jira/browse/SPARK-5085 Project: Spark Issue

[jira] [Comment Edited] (SPARK-5085) netty shuffle service causing connection timeouts

2015-01-04 Thread Stephen Haberman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264196#comment-14264196 ] Stephen Haberman edited comment on SPARK-5085 at 1/5/15 5:34 AM:

[jira] [Created] (SPARK-5087) Consolidate yarn.Client and yarn.ClientBase

2015-01-04 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-5087: - Summary: Consolidate yarn.Client and yarn.ClientBase Key: SPARK-5087 URL: https://issues.apache.org/jira/browse/SPARK-5087 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5083) Fix a flaky test in TaskResultGetterSuite

2015-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264153#comment-14264153 ] Apache Spark commented on SPARK-5083: - User 'zsxwing' has created a pull request for

[jira] [Commented] (SPARK-5085) netty shuffle service causing connection timeouts

2015-01-04 Thread Stephen Haberman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264196#comment-14264196 ] Stephen Haberman commented on SPARK-5085: - There is no interesting output in the

[jira] [Commented] (SPARK-5087) Merge yarn.Client and yarn.ClientBase

2015-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264229#comment-14264229 ] Apache Spark commented on SPARK-5087: - User 'sryza' has created a pull request for

[jira] [Updated] (SPARK-5081) Shuffle write increases

2015-01-04 Thread Kevin Jung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Jung updated SPARK-5081: -- Description: The size of shuffle write showing in spark web UI is much different when I execute same

[jira] [Created] (SPARK-5082) Minor typo in the Tuning Spark document about Data Serialization

2015-01-04 Thread yangping wu (JIRA)
yangping wu created SPARK-5082: -- Summary: Minor typo in the Tuning Spark document about Data Serialization Key: SPARK-5082 URL: https://issues.apache.org/jira/browse/SPARK-5082 Project: Spark

[jira] [Created] (SPARK-5083) Fix a flaky test in TaskResultGetterSuite

2015-01-04 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-5083: --- Summary: Fix a flaky test in TaskResultGetterSuite Key: SPARK-5083 URL: https://issues.apache.org/jira/browse/SPARK-5083 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-5084) when mysql is used as the metadata storage for spark-sql, Exception occurs when HiveQuerySuite is excute

2015-01-04 Thread baishuo (JIRA)
baishuo created SPARK-5084: -- Summary: when mysql is used as the metadata storage for spark-sql, Exception occurs when HiveQuerySuite is excute Key: SPARK-5084 URL: https://issues.apache.org/jira/browse/SPARK-5084

[jira] [Resolved] (SPARK-4986) Graceful shutdown for Spark Streaming does not work in Standalone cluster mode

2015-01-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4986. -- Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Graceful shutdown for

[jira] [Comment Edited] (SPARK-5085) netty shuffle service causing connection timeouts

2015-01-04 Thread Stephen Haberman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264196#comment-14264196 ] Stephen Haberman edited comment on SPARK-5085 at 1/5/15 5:31 AM:

[jira] [Comment Edited] (SPARK-5085) netty shuffle service causing connection timeouts

2015-01-04 Thread Stephen Haberman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264196#comment-14264196 ] Stephen Haberman edited comment on SPARK-5085 at 1/5/15 5:32 AM:

[jira] [Commented] (SPARK-5084) when mysql is used as the metadata storage for spark-sql, Exception occurs when HiveQuerySuite is excute

2015-01-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264227#comment-14264227 ] Apache Spark commented on SPARK-5084: - User 'baishuo' has created a pull request for