Github user ChitturiPadma commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-139986149
Hello All,
I am running a streaming application with batch intervals as 2sec, I
constantly see Failed to get broadcast_2_piece0 of broadcast_2 exception. The
c
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/126
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabl
Github user witgo commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39816405
Good job, guys.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
en
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39816346
Merged into master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this fea
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39816204
Looks good to me. Thanks @tdas and @andrewor14 for a ton of work on this
patch. I'll merge this.
---
If your project is set up for it, you can reply to this email and ha
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39814561
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39814562
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13880/
---
If your project
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39814456
This passed tests, it appears there was an issue with the junit output
stuff on jenkins...
---
If your project is set up for it, you can reply to this email and have you
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39811444
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39811447
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39810858
Looks like there were failures here:
```
[info] - query block statuses *** FAILED *** (30 seconds, 11 milliseconds)
[info] java.util.concurrent.TimeoutEx
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39810678
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39810679
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13876/
---
If your project is set up for it, you can r
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11375673
--- Diff:
core/src/main/scala/org/apache/spark/util/TimeStampedHashMap.scala ---
@@ -87,53 +86,67 @@ class TimeStampedHashMap[A, B](updateTimeStampOnGet:
Boolean
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39809380
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39809384
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39809254
Jenkins, test this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have t
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11375347
--- Diff:
core/src/main/scala/org/apache/spark/util/TimeStampedHashMap.scala ---
@@ -87,53 +86,67 @@ class TimeStampedHashMap[A, B](updateTimeStampOnGet:
Boo
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11375039
--- Diff:
core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala ---
@@ -90,6 +90,20 @@ private[spark] class DiskBlockManager(shuffleManager:
Shuffl
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11375031
--- Diff:
core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala ---
@@ -90,6 +90,20 @@ private[spark] class DiskBlockManager(shuffleManager:
Sh
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374624
--- Diff:
core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala ---
@@ -54,7 +85,15 @@ private[spark] class HttpBroadcast[T](@transient var
valu
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374621
--- Diff:
core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala ---
@@ -54,7 +85,15 @@ private[spark] class HttpBroadcast[T](@transient var
value_ :
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374594
--- Diff:
core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala ---
@@ -54,7 +85,15 @@ private[spark] class HttpBroadcast[T](@transient var
valu
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374596
--- Diff:
core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala ---
@@ -17,34 +17,65 @@
package org.apache.spark.broadcast
-impo
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374568
--- Diff:
core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala ---
@@ -17,34 +17,65 @@
package org.apache.spark.broadcast
-
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374564
--- Diff:
core/src/main/scala/org/apache/spark/broadcast/BroadcastFactory.scala ---
@@ -27,7 +27,8 @@ import org.apache.spark.SparkConf
* entire Spark job.
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374533
--- Diff: core/src/main/scala/org/apache/spark/broadcast/Broadcast.scala ---
@@ -51,49 +51,80 @@ import org.apache.spark._
* @tparam T Type of the data conta
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374527
--- Diff:
core/src/main/scala/org/apache/spark/broadcast/BroadcastFactory.scala ---
@@ -27,7 +27,8 @@ import org.apache.spark.SparkConf
* entire Spark j
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374505
--- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala ---
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under on
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374503
--- Diff: core/src/main/scala/org/apache/spark/broadcast/Broadcast.scala ---
@@ -51,49 +51,80 @@ import org.apache.spark._
* @tparam T Type of the data c
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374454
--- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala ---
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under on
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374450
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -233,6 +233,13 @@ class SparkContext(
@volatile private[spark] var dagScheduler = n
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374414
--- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala ---
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under on
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374381
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -233,6 +233,13 @@ class SparkContext(
@volatile private[spark] var dagScheduler
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374398
--- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala ---
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under on
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374288
--- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala ---
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) unde
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374262
--- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala ---
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) unde
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11374136
--- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala ---
@@ -0,0 +1,203 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) unde
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39803550
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13868/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39803548
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39801074
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39801064
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39800537
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13864/
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39800536
Build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your p
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39795108
Build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this fe
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39795100
Build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11370112
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMaster.scala ---
@@ -125,6 +156,51 @@ class BlockManagerMaster(var driverActor: ActorRef,
conf
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39793773
Build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this f
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39793775
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13858/
---
If your project is set up for it, you can r
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11369285
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMaster.scala ---
@@ -125,6 +156,51 @@ class BlockManagerMaster(var driverActor: ActorRef,
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39785421
Build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this fe
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39785403
Build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39784950
Jenkins, retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39780833
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13853/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39780831
Build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this f
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39779735
Build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this fe
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39779720
Build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11357471
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerSlaveActor.scala ---
@@ -26,14 +29,60 @@ import org.apache.spark.storage.BlockManagerMess
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11357667
--- Diff:
core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala ---
@@ -47,6 +47,7 @@ private[spark] class DiskBlockManager(shuffleManager:
S
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11357428
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerSlaveActor.scala ---
@@ -26,14 +29,60 @@ import org.apache.spark.storage.BlockManagerMess
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11332469
--- Diff: core/src/test/scala/org/apache/spark/util/JsonProtocolSuite.scala
---
@@ -108,8 +108,7 @@ class JsonProtocolSuite extends FunSuite {
// B
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39697606
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13836/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39697605
Build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this f
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39695749
Build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this fe
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39695744
Build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39692913
Build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this f
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39692914
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13834/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39692834
Build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39692842
Build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this fe
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39588578
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13760/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39588576
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39588422
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39588439
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39567828
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39567830
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13759/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39561674
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39561682
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39544120
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39544122
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13757/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39543928
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39543917
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39541500
I think I like reference tracking. Its more evident what it means.
Automatic is a little too generic.
---
If your project is set up for it, you can reply to this email and
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39533531
`spark.cleaner.referenceTracking`?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does no
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11283611
--- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala ---
@@ -0,0 +1,196 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) unde
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39530511
How about `spark.cleaner.automatic`?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project doe
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39529917
One high level comment - would it make sense to add a configuration flag
for whether GC is done at all. For now we could not document it (and by default
would be set to "
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39529014
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39529015
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13751/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39525845
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/126#issuecomment-39525851
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11280365
--- Diff: core/src/main/scala/org/apache/spark/SparkEnv.scala ---
@@ -180,12 +180,24 @@ object SparkEnv extends Logging {
}
}
+
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11280351
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -641,7 +643,11 @@ class SparkContext(
* [[org.apache.spark.broadcast.Broadca
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11280327
--- Diff:
core/src/main/scala/org/apache/spark/broadcast/HttpBroadcast.scala ---
@@ -183,20 +197,48 @@ private object HttpBroadcast extends Logging {
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11280307
--- Diff: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ---
@@ -194,17 +194,43 @@ private[spark] class MapOutputTracker(conf:
SparkConf) exten
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11278756
--- Diff: core/src/main/scala/org/apache/spark/ContextCleaner.scala ---
@@ -0,0 +1,196 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) un
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11269931
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMasterActor.scala ---
@@ -144,6 +155,25 @@ class BlockManagerMasterActor(val isLocal: Boole
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11268425
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMaster.scala ---
@@ -125,6 +141,34 @@ class BlockManagerMaster(var driverActor: ActorRef,
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11267282
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -80,13 +80,13 @@ class DAGScheduler(
private[scheduler] def numTotal
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11266861
--- Diff: core/src/main/scala/org/apache/spark/broadcast/Broadcast.scala ---
@@ -51,49 +50,37 @@ import org.apache.spark._
* @tparam T Type of the data c
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/126#discussion_r11266739
--- Diff: core/src/main/scala/org/apache/spark/broadcast/Broadcast.scala ---
@@ -51,49 +50,37 @@ import org.apache.spark._
* @tparam T Type of the data c
1 - 100 of 198 matches
Mail list logo
