question about Derby exception in Hive Server 2 log

2014-05-19 Thread Zhang Xiaoyu
Hi, guys, When I using Hive Server 2 (0.12), sometimes I got a Derby exception. Anyone know why the Derby exception showing up in Hive Server 2 log (I am using MySQL as metastore)? Thanks, Johnny 2014-05-17 02:25:42,344 INFO [main] org.apache.hadoop.hive.ql.exec.FileSinkOperator: 0 finished. clos

generating ORC file as output of a mapreduce job

2013-11-19 Thread Zhang Xiaoyu
Hi, I am writing a MR job to generate data for Hive. the code generates output with Text format pretty OK job.setOutputKeyClass(NullWritable.class); job.setOutputValueClass(Text.class); But when I change the value class from Text.class to OrcOutputFormat.class, it throw exception 2013-11-20

Re: [ANNOUNCE] New Hive Committer - Prasad Mujumdar

2013-11-11 Thread Zhang Xiaoyu
Congrats, Prasad! Johnny On Mon, Nov 11, 2013 at 10:01 AM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Congrats Prasad! > > Thanks > Prasanth Jayachandran > > On Nov 10, 2013, at 10:16 PM, Vaibhav Gumashta > wrote: > > > Congrats Prasad! > > > > > > On Sun, Nov 10, 2013 at

Re: exception when build Hive from source then start Hive CLI

2013-11-06 Thread Zhang Xiaoyu
n > > For example: > > jj@hellojinjie hive :) $ cd cli/ > jj@hellojinjie cli :) $ mvn exec:java > -Dexec.mainClass=org.apache.hadoop.hive.cli.CliDriver > > > > > Best Regards > 金杰 (Jay Jin) > > > On Wed, Nov 6, 2013 at 11:11 AM, Zhang Xiaoyu wrote: > >&

Re: exception when build Hive from source then start Hive CLI

2013-11-05 Thread Zhang Xiaoyu
so looks like jline jar is maven dependency which is pulled to ~/.m2 folder. The question here is what is the right way to build a Hive tarball by maven command? looks like mvn clean install -DskipTests is not.. Thanks, Johnny On Tue, Nov 5, 2013 at 6:14 PM, Zhang Xiaoyu wrote: > Hi,

exception when build Hive from source then start Hive CLI

2013-11-05 Thread Zhang Xiaoyu
Hi, all, I am trying to build hive from source and start CLI. What I did is (1) git clone the source (2) mvn clean install -DskipTests (3) cp */target/*.jar lib/ this step basically copy all jar files to lib (4) start cli by ./bin/hive I got exception ./bin/hive: line 80: [: /Users/admin/D

Re: [ANNOUNCE] New Hive Committer - Xuefu Zhang

2013-11-03 Thread Zhang Xiaoyu
Congratulations! Xuefu, well deserved! Johnny On Sun, Nov 3, 2013 at 8:06 PM, Carl Steinbach wrote: > The Apache Hive PMC has voted to make Xuefu Zhang a committer on the > Apache Hive project. > > Please join me in congratulating Xuefu! > > Thanks. > > Carl > >

Re: zookeeper error when using HS2 in Hive 0.12

2013-11-02 Thread Zhang Xiaoyu
(Driver.java:174) at org.apache.hadoop.hive.ql.Driver.checkLockManager(Driver.java:146) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:985) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888) On Sat, Nov 2, 2013 at 2:21 AM, Zhang Xiaoyu wrote: > anyone seen this before? BTW, I

Re: zookeeper error when using HS2 in Hive 0.12

2013-11-02 Thread Zhang Xiaoyu
anyone seen this before? BTW, I am using a tarball, not sure if any additional configuration is needed. Thanks in advance. Johnny On Tue, Oct 22, 2013 at 5:38 PM, Zhang Xiaoyu wrote: > Hi, all, > I set up below property in hive-site.xml. > > hive.support.conc

zookeeper error when using HS2 in Hive 0.12

2013-10-22 Thread Zhang Xiaoyu
Hi, all, I set up below property in hive-site.xml. hive.support.concurrency=true hive.zookeeper.quorum= But when I HiveServer2 got multiple concurrent query. I see zookeeper exception in hive.log. Anyone has idea about it? Is there any additional configuration properties in hive 0.12 ? Si

Re: exception when using Hive 0.12 with MySQL metastore

2013-10-19 Thread Zhang Xiaoyu
Hi, Jov, Thanks. I understand turn on those two properties resolve the problems. But I run the hive 0.12 scheme script. I assume it should create all required tables. Johnny On Sat, Oct 19, 2013 at 7:44 PM, Jov wrote: > jov > > On Oct 20, 2013 8:07 AM, "Zhang Xiaoyu" wro

exception when using Hive 0.12 with MySQL metastore

2013-10-19 Thread Zhang Xiaoyu
Hi, all, When I using Hive 0.12 with MySQL metastore. I set those properties in hive-site.xml. datanucleus.autoCreateSchema = false datanucleus.autoCreateTables= false In beeline, "show tables" is fine, but create a new table got below exception, any idea? Since I create the metastore table by the

Re: Google ProtocolBufferException exception when using ORC file format

2013-10-17 Thread Zhang Xiaoyu
test select * from temptest > > > > On Thu, Oct 17, 2013 at 12:04 PM, Zhang Xiaoyu > wrote: > >> Hi, all, >> I am simply using ORC file to store the data and get below exception. Any >> idea what's wrong with it? >> >> create table test (f1 int) stor

Google ProtocolBufferException exception when using ORC file format

2013-10-16 Thread Zhang Xiaoyu
Hi, all, I am simply using ORC file to store the data and get below exception. Any idea what's wrong with it? create table test (f1 int) stored as orc tblproperties ("orc.compress"="NONE"); load data local inpath '/home/athena/test.txt' into table test; select * from test; ===> Error: java.io.I

Re: is that possible to use Hive 0.11 with libthrift 0.7

2013-10-10 Thread Zhang Xiaoyu
wed. Thrift is wire-compatible in many cases but not >> API compatible. You can not have two applications build off two versions of >> thrift in the same classpath without something like OSGI. To insulate the >> class loaders from each other. >> >> Your best bet is upgradin

Re: is that possible to use Hive 0.11 with libthrift 0.7

2013-10-10 Thread Zhang Xiaoyu
t have two applications build off two versions of > thrift in the same classpath without something like OSGI. To insulate the > class loaders from each other. > > Your best bet is upgrading "other component" to thrift 9 > > > On Thu, Oct 10, 2013 at 3:09 PM, Zhang Xiaoyu

is that possible to use Hive 0.11 with libthrift 0.7

2013-10-10 Thread Zhang Xiaoyu
Hi, all, I am writing a piece of code talking to Hive 0.11 Hive Server 2. The JDBC code depends on libthrift 0.9. However one component which depends on libthrift 0.7 and not binary compatible with libthrift 0.9. When I downgrade to 0.7, I got below NoClassDefFoundError: org/apache/thrift/scheme/S

Re: Hive doesn't support special characters in column name

2013-10-08 Thread Zhang Xiaoyu
pha-numeric and _ (and not > beginning with _) > > Why it was done ? For my understanding, to avoid the unnecessary > complexity in query parsing or grammer building. > > hive dev will have definite answer :) > > > On Tue, Oct 8, 2013 at 11:56 PM, Zhang Xiaoyu wrote: > >&

Hive doesn't support special characters in column name

2013-10-08 Thread Zhang Xiaoyu
Hi, The columns in my Hive table had better include some special characters like / # - However, I found Hive doesn't allow it, and doesn't allow using \ as escape character. all below query fail (1) create table test ( "user\/hive" String); create table test ( "user\\/hive" String); create table