Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r157640250
--- Diff: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ---
@@ -38,10 +39,12 @@ import org.apache.spark.util.kvstore.KVStore
*/
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r157640073
--- Diff: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ---
@@ -38,10 +39,12 @@ import org.apache.spark.util.kvstore.KVStore
*/
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r157639788
--- Diff:
core/src/main/scala/org/apache/spark/status/ElementTrackingStore.scala ---
@@ -0,0 +1,160 @@
+/*
+ * Licensed to the Apache Software
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r157639499
--- Diff:
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ---
@@ -68,10 +69,25 @@ private[spark] class AppStatusListener(
private
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r157639533
--- Diff:
core/src/main/scala/org/apache/spark/status/ElementTrackingStore.scala ---
@@ -0,0 +1,160 @@
+/*
+ * Licensed to the Apache Software
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r157639459
--- Diff:
core/src/main/scala/org/apache/spark/status/ElementTrackingStore.scala ---
@@ -0,0 +1,160 @@
+/*
+ * Licensed to the Apache Software
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r157639397
--- Diff:
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ---
@@ -727,8 +769,8 @@ private[spark] class AppStatusListener(
}
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r157639162
--- Diff:
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ---
@@ -68,10 +69,25 @@ private[spark] class AppStatusListener(
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/19751
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r157046378
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -318,24 +319,23 @@ private[history] class
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156813342
--- Diff: core/src/main/scala/org/apache/spark/status/KVUtils.scala ---
@@ -68,6 +69,19 @@ private[spark] object KVUtils extends Logging {
db
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156811638
--- Diff:
core/src/test/scala/org/apache/spark/status/AppStatusListenerSuite.scala ---
@@ -851,6 +842,97 @@ class AppStatusListenerSuite extends
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156809149
--- Diff:
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ---
@@ -772,4 +813,118 @@ private[spark] class AppStatusListener(
}
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156808475
--- Diff:
core/src/main/scala/org/apache/spark/status/ElementTrackingStore.scala ---
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156775928
--- Diff:
core/src/main/scala/org/apache/spark/status/ElementTrackingStore.scala ---
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156718870
--- Diff:
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ---
@@ -772,4 +813,118 @@ private[spark] class AppStatusListener(
}
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156732445
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -318,24 +319,23 @@ private[history] class
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156706018
--- Diff: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ---
@@ -40,8 +41,10 @@ private[spark] abstract class LiveEntity {
var
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156730008
--- Diff:
core/src/test/scala/org/apache/spark/status/AppStatusListenerSuite.scala ---
@@ -851,6 +842,97 @@ class AppStatusListenerSuite extends
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156716551
--- Diff: core/src/main/scala/org/apache/spark/status/KVUtils.scala ---
@@ -68,6 +69,19 @@ private[spark] object KVUtils extends Logging {
db
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156710644
--- Diff:
core/src/main/scala/org/apache/spark/status/ElementTrackingStore.scala ---
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156709663
--- Diff:
core/src/main/scala/org/apache/spark/status/ElementTrackingStore.scala ---
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r156711461
--- Diff:
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ---
@@ -772,4 +813,118 @@ private[spark] class AppStatusListener(
}
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r153939785
--- Diff:
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ---
@@ -727,8 +769,8 @@ private[spark] class AppStatusListener(
}
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r151607724
--- Diff:
core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ---
@@ -727,8 +769,8 @@ private[spark] class AppStatusListener(
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r151607855
--- Diff: core/src/main/scala/org/apache/spark/status/LiveEntity.scala ---
@@ -40,8 +41,8 @@ private[spark] abstract class LiveEntity {
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r151603481
--- Diff:
core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala ---
@@ -93,9 +93,9 @@ class JobProgressListener(conf: SparkConf) extends
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r151324714
--- Diff:
core/src/main/scala/org/apache/spark/status/ElementTrackingStore.scala ---
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r151445965
--- Diff:
core/src/main/scala/org/apache/spark/ui/jobs/JobProgressListener.scala ---
@@ -93,9 +93,9 @@ class JobProgressListener(conf: SparkConf)
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r151510043
--- Diff:
core/src/main/scala/org/apache/spark/status/ElementTrackingStore.scala ---
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache Software
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/19751#discussion_r151321285
--- Diff:
core/src/main/scala/org/apache/spark/status/ElementTrackingStore.scala ---
@@ -0,0 +1,168 @@
+/*
+ * Licensed to the Apache
GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/19751
[SPARK-20653][core] Add cleaning of old elements from the status store.
This change restores the functionality that keeps a limited number of
different types (jobs, stages, etc) depending on
32 matches
Mail list logo
