Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19981#discussion_r157829182
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -322,15 +321,18 @@ private[history] class FsHistoryProvider(conf:
SparkConf, clock: Clock)
(new InMemoryStore(), true)
}
+ val plugins = ServiceLoader.load(
+ classOf[AppHistoryServerPlugin],
Utils.getContextOrSparkClassLoader).asScala
val trackingStore = new ElementTrackingStore(kvstore, conf)
--- End diff --
Yes, both because it's the old behavior, and to limit the app's history
data growth. Also because the UI code itself doesn't scale to arbitrarily large
lists of things like jobs and stages.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
