import data from s3 which region supports AWS4-HMAC-SHA256 only

2016-04-12 Thread QiuxuanZhu
Dear all, Is it possible for now that spark could import data from s3 which supports AWS4-HMAC-SHA256 only? such as frankfurt or beijing? I check the issues in github. It seems that upgrade jets3t failed in UT for now. https://github.com/apache/spark/pull/9306 So, any help? Thanks. --

Error when get data from hive table. Use python code.

2015-01-29 Thread QiuxuanZhu
*Dear all,* *I have no idea when it raises an error when I run the following code.* def getRow(data): return data.msg first_sql = select * from logs.event where dt = '20150120' and et = 'ppc' LIMIT 10#error #first_sql = select * from hivecrawler.vip_crawler where src='xx' and dt=' +