Many OutOfMemoryErrors in the log. Is your data distributed evenly? -Xiangrui
On Wed, May 21, 2014 at 11:23 AM, yxzhao <[email protected]> wrote: > I run the pagerank example processing a large data set, 5GB in size, using 48 > machines. The job got stuck at the time point: 14/05/20 21:32:17, as the > attached log shows. It was stuck there for more than 10 hours and then I > killed it at last. But I did not find any information explaining why it was > stuck. Any suggestions? Thanks. > > > Spark_OK_48_pagerank.log > <http://apache-spark-user-list.1001560.n3.nabble.com/file/n6185/Spark_OK_48_pagerank.log> > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Job-Processing-Large-Data-Set-Got-Stuck-tp6185.html > Sent from the Apache Spark User List mailing list archive at Nabble.com.
