Re: FOREACH GENERATE after if else condition

2011-02-22 Thread sonia gehlot
We found the patch for this issue: Revision: http://svn.apache.org/viewvc?view=revision&revision=1057974 JIRA: https://issues.apache.org/jira/browse/PIG-1785 Sonia On Tue, Feb 22, 2011 at 2:22 PM, Daniel Dai wrote: > I just tried your script. I can see the wrong output in 0.8 release, but it >

Re: FOREACH GENERATE after if else condition

2011-02-22 Thread Daniel Dai
I just tried your script. I can see the wrong output in 0.8 release, but it is fixed on current 0.8 branch (http://svn.apache.org/repos/asf/pig/branches/branch-0.8). Check out the 0.8 branch and try again. Daniel Bill Graham wrote: Our version (I work with Sonia) is this: Apache Pig version

Re: FOREACH GENERATE after if else condition

2011-02-22 Thread Bill Graham
Our version (I work with Sonia) is this: Apache Pig version 0.8.0-SNAPSHOT (rexported) Which is not very helpful. It's basically the 0.8.0 release with an early patch of PIG-1680 applied. I've tested with an unpatched 0.8.0 and I can reproduce. Testing against the current trunk, the issue seems t

Re: FOREACH GENERATE after if else condition

2011-02-22 Thread Dmitriy Ryaboy
I am not sure where that version came from. Is this some CDH thing? Here's the output of my pig -version: Apache Pig version 0.8.0-SNAPSHOT (r1073123) -D On Tue, Feb 22, 2011 at 9:54 AM, sonia gehlot wrote: > Thanks Dimitriy, > > I am using pig.version=0.8.0_0.20.1_1-1 Version of Pig. Are you a

Re: FOREACH GENERATE after if else condition

2011-02-22 Thread sonia gehlot
Thanks Dimitriy, I am using pig.version=0.8.0_0.20.1_1-1 Version of Pig. Are you also using the same one? Sonia On Mon, Feb 21, 2011 at 2:39 PM, Dmitriy Ryaboy wrote: > Sonia, check the svn revision. > > w-mbp13-dryaboy:pig-0.8 dmitriy$ svn info > Path: . > URL: https://svn.apache.org/repos/as

Re: FOREACH GENERATE after if else condition

2011-02-21 Thread Dmitriy Ryaboy
Sonia, check the svn revision. w-mbp13-dryaboy:pig-0.8 dmitriy$ svn info Path: . URL: https://svn.apache.org/repos/asf/pig/branches/branch-0.8 Repository Root: https://svn.apache.org/repos/asf Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68 Revision: 1073123 Node Kind: directory Schedule: no

Re: FOREACH GENERATE after if else condition

2011-02-21 Thread sonia gehlot
Hey Dmitriy, I tried running this again but getting same error. I will double check my Pig version. I knw it sounds dumb question, but can you tell how can I see which version of Pig I am using? On Mon, Feb 21, 2011 at 11:57 AM, Dmitriy Ryaboy wrote: > Sonia, > I just tried your script using th

Re: FOREACH GENERATE after if else condition

2011-02-21 Thread Dmitriy Ryaboy
Sonia, I just tried your script using the version of Pig 8 in the 0.8 branch (didn't try it with the release), and got correct results. Please try that. dump case_abc: (John,USA,1234,) (Ron,California,,1432) (Sam,NY,,5432) (Bill,UK,5647,) dump gen_case: (John,USA,1234,) (Ron,California,,1432) (Sa

Re: FOREACH GENERATE after if else condition

2011-02-21 Thread Jonathan Coveney
I do not know about sonia, but I know that when I ran into a similar bug it was on trunk. 2011/2/21 Ramesh, Amit > > This very much looks like a result of the bug that dropped schemas in the > release version. I was bitten by it a couple of times, but have everything > working now by pulling dow

Re: FOREACH GENERATE after if else condition

2011-02-21 Thread Ramesh, Amit
This very much looks like a result of the bug that dropped schemas in the release version. I was bitten by it a couple of times, but have everything working now by pulling down a recent snapshot of the code from the svn 0.8 release branch. Quite a few major bug fixes have gone in since the orig

Re: FOREACH GENERATE after if else condition

2011-02-21 Thread Jonathan Coveney
Sonia, I absolutely have seen this bug, just couldn't find an easy way to replicate it as it was buried in a bunch of code. The use case was similar: multiple embedded ifs, some nulls, and then instead of getting the expected output, it just repeats one. I know dmitriy said he'd look into it I jus

Re: FOREACH GENERATE after if else condition

2011-02-20 Thread Dmitriy Ryaboy
This sounds like a bug. I'll check it out tomorrow. On Sat, Feb 19, 2011 at 7:04 PM, sonia gehlot wrote: > Here is an example, Hope this will help. I am running this on Pig 0.8 > version. > > Sample data in text file > sample1.txt > > John USA www.google.com 1234 900 > Ron California www.facebook

Re: FOREACH GENERATE after if else condition

2011-02-20 Thread sonia gehlot
Is anyone is facing this kind of issue.. or I am doing anything wrong. Thanks, Sonia On Sat, Feb 19, 2011 at 7:04 PM, sonia gehlot wrote: > Here is an example, Hope this will help. I am running this on Pig 0.8 > version. > > Sample data in text file > sample1.txt > > John USA www.google.com 1234

Re: FOREACH GENERATE after if else condition

2011-02-19 Thread sonia gehlot
Here is an example, Hope this will help. I am running this on Pig 0.8 version. Sample data in text file sample1.txt John USA www.google.com 1234 900 Ron California www.facebook.com 1432 400 Sam NY www.orkut.com 5432 400 Bill UK www.google.com 5647 645 abc = LOAD '/user/sgehlot/test_data/sample1

Re: FOREACH GENERATE after if else condition

2011-02-19 Thread Dmitriy Ryaboy
Hi Sonia, Looks like something went wrong in your pasting of the Pig code. Could you try again, and also add some sample inputs/outputs? As in, contents of join_pe_pre, contents of case_state, and contents of gen_values that illustrate the problem and allow us to reproduce it. Also please tell us

FOREACH GENERATE after if else condition

2011-02-19 Thread sonia gehlot
Hi Guys, I getting wired error while running my pig script. *case_state = FOREACH join_pe_pre GENERATE* * f1, f2, f3, f4, (* * (f5 '.*.facebook..*')* * ? f10* * : null* * ) as facebook_referrals,* * * * (* *