GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/20952
[SPARK-6951][core] Speed up parsing of event logs during listing.
This change introduces two optimizations to help speed up generation
of listing data when parsing events logs.
The first
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20952#discussion_r180197210
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -417,15 +419,23 @@ private[history] class FsHistoryProvider(conf
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20952#discussion_r180187517
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -125,6 +126,7 @@ private[history] class FsHistoryProvider(conf:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20952
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org