Re: Understanding distributed Hive server and Hive Metastore setup

2011-08-26 Thread Christian Kurz
Ashutosh, thank you for the explanation. I have changed the setup from embedded Derby to stand-alone Derby. Neither the hiveserver nor the metastore service open any Derby files any longer and things are working fine. Thanks again for your help, Christian On 26.08.2011 01:00, Ashutosh Chauha

Re: Understanding distributed Hive server and Hive Metastore setup

2011-08-25 Thread Ashutosh Chauhan
Christian, Looks like its not possible to do the setup that you are looking for. Problem arises since HiveServer extends HMSHandler directly instead of accessing Metastore through HiveMetaStoreClient and because of this metastore thrift interface is missed entirely. Hiveserver will contact mysql d

Re: Understanding distributed Hive server and Hive Metastore setup

2011-08-24 Thread Christian Kurz
Thanks, Edward and Ashutosh Ashutosh, yes, I do not understand why the service "hiveserver" still uses a Derby instance even through it should be talking to the service "metastore". Btw, if I run the hiveserver without having started the metastore service, the hiveserver complains when I try t

Re: Understanding distributed Hive server and Hive Metastore setup

2011-08-24 Thread Ashutosh Chauhan
Edward, Apart from recommended best practices what Christian is asking for is why HiveServer is still trying to interact with local db instance even after setting the config variables. AFAIK it should not. Christian, you found that out by looking at files opened by HiveServer jvm. Can you provide

Re: Understanding distributed Hive server and Hive Metastore setup

2011-08-24 Thread Edward Capriolo
On Wed, Aug 24, 2011 at 3:02 PM, Christian Kurz wrote: > > Thanks for the quick reply, Edward > > I am not sure I got you: My HiveService has been started with > hive.metastore.local=false. > So shouldn't it use thrift instead of its own local Derby instance? > > Thanks, > Christian > > Am 24.08

Re: Understanding distributed Hive server and Hive Metastore setup

2011-08-24 Thread Christian Kurz
Thanks for the quick reply, Edward I am not sure I got you: My HiveService has been started with hive.metastore.local=false. So shouldn't it use thrift instead of its own local Derby instance? Thanks, Christian Am 24.08.2011 um 19:33 schrieb Edward Capriolo : > > > On Wed, Aug 24, 2011 at

Re: Understanding distributed Hive server and Hive Metastore setup

2011-08-24 Thread Edward Capriolo
On Wed, Aug 24, 2011 at 10:53 AM, Christian Kurz wrote: > Greetings, > > could somebody confirm/correct my understanding of a fully distributed Hive > setup, please? > > My setup is as follows > >- *Java application using Hive JDBC driver *connects to > - *hive --service hiveserver*, whi