Thank you for your reply.
> 1. Which version of Spark do you use now? I use Spark 1.2.0. (CDH 5.3.1) > 2. Why don't you check whether `productJavaRDD ` and `userJavaRDD ` are > cached with Web UI or not? I checked SparkUI. Task was stopped at 1/2 (Succeeded/Total tasks). Here is stacktrace: org.apache.spark.rdd.PairRDDFunctions.lookup(PairRDDFunctions.scala:840) org.apache.spark.mllib.recommendation.MatrixFactorizationModel.recommendUsers(MatrixFactorizationModel.scala:126) ... > 3. You can check a RDD cached or not with `getStorageLevel()` method, such > as `model .userFeatures.getStorageLevel()`. I printed the return value of getStorageLevel() "userFeatures" and "productFeatures", both were "Memory Deserialized 1x Replicated" . I think, two variables were configured to cache, but didn't cache at that time. (delayed ?) Thanks, Yuichiro Sakamoto -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Can-t-cache-RDD-of-collaborative-filtering-on-MLlib-tp21962p21990.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
