[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-10-01 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-144794054 Shall we close this PR? it sounds like it's not obviously better to reduce the default. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-10-01 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-144804153 Please keep SPARK-10787 open. Users may bump into OOME due to the limitation of ObjectOutputStream --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-10-01 Thread tedyu
Github user tedyu closed the pull request at: https://github.com/apache/spark/pull/8896 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-25 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-143360758 What if we write our own version of ObjectOutputStream with weak references instead of using strong references ? --- If your project is set up for it, you can reply to

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-25 Thread jayluan
Github user jayluan commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-143379925 Jira ticket created at [SPARK-10821](https://issues.apache.org/jira/browse/SPARK-10821) Toy test case to recreate the problem as follows. I can't seem to attach

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8896#discussion_r40288500 --- Diff: core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala --- @@ -138,7 +142,7 @@ private[spark] class JavaSerializerInstance(

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142828118 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142828119 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/8896#discussion_r40306708 --- Diff: core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala --- @@ -138,7 +142,7 @@ private[spark] class JavaSerializerInstance( */

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142893455 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142893578 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142898742 [Test build #42969 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42969/consoleFull) for PR 8896 at commit

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/8896#discussion_r40294658 --- Diff: core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala --- @@ -45,6 +45,10 @@ private[spark] class JavaSerializationStream( }

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8896#discussion_r40288294 --- Diff: core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala --- @@ -45,6 +45,10 @@ private[spark] class JavaSerializationStream(

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142828033 [Test build #42956 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42956/console) for PR 8896 at commit

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142939232 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142939229 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142938922 [Test build #42969 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42969/console) for PR 8896 at commit

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-24 Thread jayluan
Github user jayluan commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-143054170 I am still getting this issue with objectStreamReset values of 10, and 1. Please see my configuration in this thread:

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142818546 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142818544 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142818484 [Test build #42952 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42952/console) for PR 8896 at commit

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142795450 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142795432 [Test build #42954 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42954/console) for PR 8896 at commit

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142796117 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142795452 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142796177 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142798087 [Test build #42956 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42956/consoleFull) for PR 8896 at commit

[GitHub] spark pull request: SPARK-10787 Reset ObjectOutputStream more ofte...

2015-09-23 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/8896#issuecomment-142801966 The MiMa test failure was due to: ``` [error] (core/*:mimaPreviousClassfiles) sbt.ResolveException: download failed: