Repository: spark Updated Branches: refs/heads/branch-1.4 894214f9e -> 8d8876d3b
[SPARK-7643] [UI] use the correct size in RDDPage for storage info and partitions `dataDistribution` and `partitions` are `Option[Seq[_]]`. andrewor14 squito Author: Xiangrui Meng <[email protected]> Closes #6157 from mengxr/SPARK-7643 and squashes the following commits: 99fe8a4 [Xiangrui Meng] use the correct size in RDDPage for storage info and partitions (cherry picked from commit 57ed16cf9372c109e84bd51b728f2c82940949a7) Signed-off-by: Andrew Or <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8d8876d3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/8d8876d3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/8d8876d3 Branch: refs/heads/branch-1.4 Commit: 8d8876d3b3223557629ba4d9a4e71857755da6ea Parents: 894214f Author: Xiangrui Meng <[email protected]> Authored: Thu May 14 16:56:32 2015 -0700 Committer: Andrew Or <[email protected]> Committed: Thu May 14 16:56:38 2015 -0700 ---------------------------------------------------------------------- core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/8d8876d3/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala ---------------------------------------------------------------------- diff --git a/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala b/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala index 05f94a7..fbce917 100644 --- a/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala +++ b/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala @@ -77,14 +77,17 @@ private[ui] class RDDPage(parent: StorageTab) extends WebUIPage("rdd") { <div class="row-fluid"> <div class="span12"> - <h4> Data Distribution on {rddStorageInfo.dataDistribution.size} Executors </h4> + <h4> + Data Distribution on {rddStorageInfo.dataDistribution.map(_.size).getOrElse(0)} + Executors + </h4> {workerTable} </div> </div> <div class="row-fluid"> <div class="span12"> - <h4> {rddStorageInfo.partitions.size} Partitions </h4> + <h4> {rddStorageInfo.partitions.map(_.size).getOrElse(0)} Partitions </h4> {blockTable} </div> </div>; --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
