Error when get data from hive table. Use python code.

2015-01-29 Thread QiuxuanZhu
*Dear all,* *I have no idea when it raises an error when I run the following code.* def getRow(data): return data.msg first_sql = select * from logs.event where dt = '20150120' and et = 'ppc' LIMIT 10#error #first_sql = select * from hivecrawler.vip_crawler where src='xx' and dt=' +

Re: Error when get data from hive table. Use python code.

2015-01-29 Thread Cheng Lian
What version of Spark and Hive are you using? Spark 1.1.0 and prior version /only/ support Hive 0.12.0. Spark 1.2.0 supports Hive 0.12.0 /or/ 0.13.1. Cheng On 1/29/15 6:36 PM, QiuxuanZhu wrote: *Dear all, * *I have no idea when it raises an error when I run the following code.* * * def

Re: Error when get data from hive table. Use python code.

2015-01-29 Thread Zhan Zhang
You are running yarn-client mode. How about increase the --driver-memory and give it a try? Thanks. Zhan Zhang On Jan 29, 2015, at 6:36 PM, QiuxuanZhu ilsh1...@gmail.commailto:ilsh1...@gmail.com wrote: Dear all, I have no idea when it raises an error when I run the following code. def

Re: Error when get data from hive table. Use python code.

2015-01-29 Thread Davies Liu
On Thu, Jan 29, 2015 at 6:36 PM, QiuxuanZhu ilsh1...@gmail.com wrote: Dear all, I have no idea when it raises an error when I run the following code. def getRow(data): return data.msg first_sql = select * from logs.event where dt = '20150120' and et = 'ppc' LIMIT 10#error