Re: Exception: Unable to find clone for op Project 4-16 Projections

2010-05-19 Thread Yonggang Qiao
18, 2010 at 12:34 PM, Ashutosh Chauhan > wrote: >>> we do have multiple threads, >> This is what I suspected from beginning :) >> >> PigServer is not thread-safe, yet. >> >> Ashutosh >> >> On Tue, May 18, 2010 at 12:04, Yonggang Qiao wrote: >&

Re: Exception: Unable to find clone for op Project 4-16 Projections

2010-05-18 Thread Yonggang Qiao
On Tue, May 18, 2010 at 5:43 AM, Ashutosh Chauhan >> wrote: >>> if you are creating new instance for each query.. you should be fine.. >>> which Pig version are you using ? can you paste the snippet of java >>> code where you are creating new pig server instan

Re: Exception: Unable to find clone for op Project 4-16 Projections

2010-05-17 Thread Yonggang Qiao
wrote: > if you are creating new instance for each query.. you should be fine.. > which Pig version are you using ? can you paste the snippet of java > code where you are creating new pig server instance and then using it > for a new query ? > > Ashutosh > On Mon, May 17, 2010

Re: Exception: Unable to find clone for op Project 4-16 Projections

2010-05-17 Thread Yonggang Qiao
sorry, actually yes. no, we use new instance for each script. On Mon, May 17, 2010 at 2:13 PM, Yonggang Qiao wrote: > yes. yes. > > On Mon, May 17, 2010 at 2:03 PM, Ashutosh Chauhan > wrote: >> Are you using PigServer java api to run your Pig queries ? If so, are >> yo

Re: Exception: Unable to find clone for op Project 4-16 Projections

2010-05-17 Thread Yonggang Qiao
yes. yes. On Mon, May 17, 2010 at 2:03 PM, Ashutosh Chauhan wrote: > Are you using PigServer java api to run your Pig queries ? If so, are > you trying to run multiple queries in different threads against same > Pig server  instance? > > Ashutosh > > On Mon, May 17, 2010 at

Exception: Unable to find clone for op Project 4-16 Projections

2010-05-17 Thread Yonggang Qiao
Hi, anyone has seen this error before? normally our script runs fine, but sometime recently it began to throw this exception. also usually it will go away if I rerun it. Caused by: java.lang.RuntimeException: Unable to find clone for op Project 4-16 Projections: [9] Overloaded: false at

Re: how to set pig job name?

2009-12-17 Thread Yonggang Qiao
googled it. seems pigServer.getPigContext().getProperties().setProperty(PigContext.JOB_NAME, jobName); works. Thanks! On Thu, Dec 17, 2009 at 4:07 PM, Yonggang Qiao wrote: > how can I do it by using PigServier? I got "Unrecognized alias set" > exception when I wa

Re: how to set pig job name?

2009-12-17 Thread Yonggang Qiao
9 at 3:09 PM, buping du wrote: >  in your pig script. > >  set job.name "your jobname" > > On Thu, Dec 17, 2009 at 2:41 PM, Yonggang Qiao wrote: > >> pigServer.setJobName() does not work for me. Now it always shows >> something like Job5377610087230523458.jar f

how to set pig job name?

2009-12-17 Thread Yonggang Qiao
pigServer.setJobName() does not work for me. Now it always shows something like Job5377610087230523458.jar for Hadoop jobs. Is there any way to give them more meaningful names? Thanks, Yonggang

Re: a dummy question

2009-10-14 Thread Yonggang Qiao
> grunt> dump b; > (a,aa) > (c,cc) > grunt> dump ret; > (a,1,a,aa) > (b,2,,) > (c,3,c,cc) > grunt> store ret into '/tmp/res'; > grunt> quit > > dvrya...@abacus:~/src/pig$ cat /tmp/res > a       1       a       aa > b       2 > c       3

a dummy question

2009-10-14 Thread Yonggang Qiao
new to pig, I want to do an out join using pig, but cannot the result I want. did I do something wrong? --1.txt a 1 b 2 c 3 ---2.txt a aa c cc A = LOAD '1.txt' USING PigStorage('\t') as (a1,a2); B = LOAD '2.txt' USING PigStorage('\t') as (a1,a2); ret = JOIN A by a1

Re: join multiple dataset on different key sets

2009-08-07 Thread yonggang . qiao
; A join takes an arbitrary number of relations. >>> >>> So yes. >>> >>> D = Join A on a, B on b, C on c [PARALLEL n] >>> >>> you really want to specify the number of reducers using the parallel >>> keyword if you are running on a

join multiple dataset on different key sets

2009-08-07 Thread Yonggang Qiao
Hello there, Is it possible to do something like this by using one join? Thanks! select * from tbl_a, tbl_b, tbl_c where tbl_a.b = tbl_b.b and tbl_a.c= tbl_c.c

join multiple dataset on different key sets

2009-08-07 Thread Yonggang Qiao
Hello there, Is it possible to do something like this by using one join? Thanks! select * from tbl_a, tbl_b, tbl_c where tbl_a.b = tbl_b.b and tbl_a.c= tbl_c.c