Re: How to divide by the minimum number in a set in Pig?

2010-12-14 Thread Alan Gates
You can download the release candidate for 0.8 from http://people.apache.org/~olga/pig-0.8.0-candidate-0 . If you want to build your own I'd build off the 0.8 branch, which we know to be stable. We're pouring all kinds of cool new features into trunk at the moment so it may not be as stable

Re: How to divide by the minimum number in a set in Pig?

2010-12-14 Thread Jonathan Coveney
Thanks guys 2010/12/14 Daniel Dai > This is what you need (on 0.8): > > > loaded = LOAD 'whatever' AS (whatever:chararray, icare:int); > min_generated = FOREACH loaded GENERATE icare; > min_group = GROUP min_generated ALL; > min = FOREACH min_group GENERATE MIN(min_generated) as m; > generated =

Re: How to divide by the minimum number in a set in Pig?

2010-12-14 Thread Daniel Dai
This is what you need (on 0.8): loaded = LOAD 'whatever' AS (whatever:chararray, icare:int); min_generated = FOREACH loaded GENERATE icare; min_group = GROUP min_generated ALL; min = FOREACH min_group GENERATE MIN(min_generated) as m; generated = FOREACH loaded GENERATE whatever, icare/min.m; Da

Re: How to divide by the minimum number in a set in Pig?

2010-12-14 Thread Jonathan Coveney
Also, where would the cast go? 2010/12/14 Jonathan Coveney > I can use new code, yes. If I simply use the dev version of pig, will it > support this then? > > 2010/12/14 Alan Gates > > Actually, in 0.8 the code you give will work, if you cast min_generated to >> an int. 0.8 Is in the release p

Re: How to divide by the minimum number in a set in Pig?

2010-12-14 Thread Jonathan Coveney
I can use new code, yes. If I simply use the dev version of pig, will it support this then? 2010/12/14 Alan Gates > Actually, in 0.8 the code you give will work, if you cast min_generated to > an int. 0.8 Is in the release process now. Are you in a position to use > new code? > > Alan. > > > O

Re: How to divide by the minimum number in a set in Pig?

2010-12-14 Thread Alan Gates
Actually, in 0.8 the code you give will work, if you cast min_generated to an int. 0.8 Is in the release process now. Are you in a position to use new code? Alan. On Dec 14, 2010, at 10:32 AM, Jonathan Coveney wrote: I'm not sure if Pig can handle this...perhaps in this specific case th

How to divide by the minimum number in a set in Pig?

2010-12-14 Thread Jonathan Coveney
I'm not sure if Pig can handle this...perhaps in this specific case there is something more clever that can be done, although I think it points to a bigger question. Basically, let's say I have (whatever:chararray, icare:int) I want to get whatever, icare/min(all_of_icare), for each touple. Basica