Query about checkpointing time

2015-09-30 Thread jatinganhotra
. scheduler delay, GC time and save them programmatically? I want to log some of the above metrics for every action invoked on an RDD. Please let me know if you need more information. Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Query-about-check

Fwd: Query about checkpointing time

2015-09-29 Thread Jatin Ganhotra
Hi, I started doing the amp-camp 5 exercises . I tried the following 2 scenarios: *Scenario #1* val pagecounts = sc.textFile("data/pagecounts") pagecounts.checkpoint pagecounts.count *Scenario #2* val pagecounts =