Hi, all
Running the following code snippet through spark-shell, however cannot see any
cached storage partitions in web ui.
Does this mean that cache now working ? Cause if we issue person.count again
that we cannot say any time consuming
performance upgrading. Hope anyone can explain this for a little.
Best,
Sun.
case class Person(id: Int, col1: String)
val person =
sc.textFile("hdfs://namenode_host:8020/user/person.txt").map(_.split(",")).map(p
=> Person(p(0).trim.toInt, p(1)))
person.cache
person.count
[email protected]