Re: Files does not exist error: concurrency control on hive queries...

2009-09-08 Thread He Yongqiang
Hi Eva, Can you open a new jira for this? And let’s discuss and resolve this issue. I guess this is because the partition metadata is added before the data is available. Thanks Yongqiang On 09-9-9 下午1:18, "Eva Tse" wrote: > > We are planning to start enabling ad-hoc querying on our hive

Re: Files does not exist error: concurrency control on hive queries...

2009-09-09 Thread He Yongqiang
Hi Eva, After a close at the code, I think this is not a bug. We need to find out how to avoid this. Thanks, Yongqiang On 09-9-9 下午1:31, "He Yongqiang" wrote: > Hi Eva, > Can you open a new jira for this? And let’s discuss and resolve this > issue. > I guess this is because the partiti

Re: Files does not exist error: concurrency control on hive queries...

2009-09-09 Thread Prasad Chakka
From: Yongqiang He Reply-To: Date: Wed, 9 Sep 2009 04:07:31 -0700 To: Subject: Re: Files does not exist error: concurrency control on hive queries... Hi Eva, After a close at the code, I think this is not a bug. We need to find out how to avoid this. Thanks, Yongqiang

Re: Files does not exist error: concurrency control on hive queries...

2009-09-09 Thread Eva Tse
lse. > Eva, Does the same job succeed on a second try? Ie. Is the file/dir available > eventually? What is the replication factor? > > Prasad > > > > From: Yongqiang He > Reply-To: > Date: Wed, 9 Sep 2009 04:07:31 -0700 > To: > Subject: Re: Files does no

Re: Files does not exist error: concurrency control on hive queries...

2009-09-09 Thread Prasad Chakka
: Wed, 9 Sep 2009 10:19:24 -0700 To: Subject: Re: Files does not exist error: concurrency control on hive queries... Prasad, We believe the problem is that one of the query is doing an ‘insert overwrite ... select from’ which actually is deleting and merging the small files. The other query somehow

Re: Files does not exist error: concurrency control on hive queries...

2009-09-09 Thread Cliff Resnick
--- > *From: *Eva Tse > *Reply-To: * > *Date: *Wed, 9 Sep 2009 10:19:24 -0700 > *To: * > *Subject: *Re: Files does not exist error: concurrency control on hive > queries... > > > Prasad, > We believe the problem is that one of th

Re: Files does not exist error: concurrency control on hive queries...

2009-09-09 Thread Eva Tse
second try? Ie. Is the file/dir available >> eventually? What is the replication factor? >> >> Prasad >> >> >> >> From: Yongqiang He >> Reply-To: >> Date: Wed, 9 Sep 2009 04:07:31 -0700 >> To: >> Subject: Re: Files does

Re: Files does not exist error: concurrency control on hive queries...

2009-09-09 Thread Prasad Chakka
: Date: Wed, 9 Sep 2009 12:36:11 -0700 To: , Dhruba Borthakur Subject: Re: Files does not exist error: concurrency control on hive queries... Hi Prasad, Are you implying the expected behavior for these queries should be run sequentially by hive because one is r/w and one is read-only ? For

Re: Files does not exist error: concurrency control on hive queries...

2009-09-09 Thread Eva Tse
locking (possibly with HDFS files) to prevent > queries being executed simultaneously. > > Any other ideas? > > Prasad > > > > From: Eva Tse > Reply-To: > Date: Wed, 9 Sep 2009 12:36:11 -0700 > To: , Dhruba Borthakur > Subject: Re: Files does not e

Re: Files does not exist error: concurrency control on hive queries...

2009-09-09 Thread Prasad Chakka
From: Eva Tse Reply-To: Date: Wed, 9 Sep 2009 14:32:20 -0700 To: Subject: Re: Files does not exist error: concurrency control on hive queries... Regardless of whether the user uses a HiveServer, looks like the logical place to do locking or concurrency control would be at the metastore DB

Re: Files does not exist error: concurrency control on hive queries...

2009-09-10 Thread Eva Tse
uted simultaneously. >> >> Any other ideas? >> >> Prasad >> >> >> >> From: Eva Tse >> Reply-To: >> Date: Wed, 9 Sep 2009 12:36:11 -0700 >> To: , Dhruba Borthakur >> Subject: Re: Files does not exist error: concurrency control on

Re: Files does not exist error: concurrency control on hive queries...

2009-09-10 Thread Edward Capriolo
Prasad > > > > From: Eva Tse > Reply-To: > Date: Wed, 9 Sep 2009 14:32:20 -0700 > To: > Subject: Re: Files does not exist error: concurrency control on hive > queries... > > > Regardless of whether the user uses a HiveServer, l

RE: Files does not exist error: concurrency control on hive queries...

2009-09-11 Thread Ashish Thusoo
From: Eva Tse Reply-To: Date: Wed, 9 Sep 2009 14:32:20 -0700 To: Subject: Re: Files does not exist error: concurrency control on hive queries... Regardless of whether the user uses a HiveServer, looks like the logical place to do locking or concurrency control would be at the metastore D

Re: Files does not exist error: concurrency control on hive queries...

2009-09-11 Thread Eva Tse
e/HIVE-718 > > Ashish > > From: Eva Tse [e...@netflix.com] > Sent: Wednesday, September 09, 2009 10:45 PM > To: hive-user@hadoop.apache.org > Subject: Re: Files does not exist error: concurrency control on hive > queries... > > Zookeeper sou