RE: Issues on schemaRDD's function got stuck

2014-12-09 Thread LinQili
: PermGen space 14/12/09 17:29:35 ERROR actor.ActorSystemImpl: Uncaught fatal error from thread [sparkDriver-akka.actor.default-dispatcher-2] shutting down ActorSystem [sparkDriver] From: lin_q...@outlook.com To: u...@spark.incubator.apache.org Subject: Issues on schemaRDD's function got stuck

RE: Issues on schemaRDD's function got stuck

2014-12-09 Thread LinQili
Subject: Issues on schemaRDD's function got stuck Date: Tue, 9 Dec 2014 15:54:14 +0800 Hi all:I was running HiveFromSpark on yarn-cluster. While I got the hive select's result schemaRDD and tried to run `collect()` on it, the application got stuck and don't know what's wrong with it. Here is my

Issues on schemaRDD's function got stuck

2014-12-08 Thread LinQili
Hi all:I was running HiveFromSpark on yarn-cluster. While I got the hive select's result schemaRDD and tried to run `collect()` on it, the application got stuck and don't know what's wrong with it. Here is my code: val sqlStat = sSELECT * FROM $TABLE_NAME val result = hiveContext.hql(sqlStat)