Re: OutOfMemoryError when using DataFrame created by Spark SQL

2015-03-25 Thread Michael Armbrust
er > the hood” and the convention from an R/julia user, I really hope this error > is able to be tackled, and DataFrame is robust enough to depend. > > Thanks in advance! > > REGARDS, > Todd > ​ > > -------------- > View this message in context: OutOfMe

Re: OutOfMemoryError when using DataFrame created by Spark SQL

2015-03-25 Thread Ted Yu
and DataFrame is robust enough to depend. > > Thanks in advance! > > REGARDS, > Todd > > > View this message in context: OutOfMemoryError when using DataFrame created > by Spark SQL > Sent from the Apache Spark User List mailing list archive at Nabble.com.

OutOfMemoryError when using DataFrame created by Spark SQL

2015-03-25 Thread Todd Leo
is robust enough to depend. Thanks in advance! REGARDS, Todd ​ -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/OutOfMemoryError-when-using-DataFrame-created-by-Spark-SQL-tp22219.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

OutOfMemoryError when using DataFrame created by Spark SQL

2015-03-25 Thread SLiZn Liu
Hi, I am using *Spark SQL* to query on my *Hive cluster*, following Spark SQL and DataFrame Guide step by step. However, my HiveQL via sqlContext.sql() fails and java.lang.OutOfMemoryError was raised. The expected result of such que