Re: CONCAT multiple fields

2010-05-14 Thread Russell Jurney
https://issues.apache.org/jira/browse/PIG-1420 Patch soon. On Fri, May 14, 2010 at 9:10 AM, Alan Gates wrote: > > On May 14, 2010, at 12:20 AM, Russell Jurney wrote: > > >> >> Should I make a JIRA then submit the patch? >> >> Yes. > > Alan. >

Re: CONCAT multiple fields

2010-05-14 Thread Alan Gates
On May 14, 2010, at 12:20 AM, Russell Jurney wrote: Should I make a JIRA then submit the patch? Yes. Alan.

Re: CONCAT multiple fields

2010-05-14 Thread Russell Jurney
Scratch that, grep is my friend. On Fri, May 14, 2010 at 12:20 AM, Russell Jurney wrote: > I wrote the patch, but looking around, I'm not sure where the unit tests > for this stuff is. Can someone point me in the right direction? I added an > append() method to DataByteArray, as that seemed the

Re: CONCAT multiple fields

2010-05-14 Thread Russell Jurney
I wrote the patch, but looking around, I'm not sure where the unit tests for this stuff is. Can someone point me in the right direction? I added an append() method to DataByteArray, as that seemed the cleanest way to do this. Should I make a JIRA then submit the patch? Russ On Wed, May 12, 201

Re: CONCAT multiple fields

2010-05-12 Thread Russell Jurney
Yeah, that sounds like a good idea. I can do that patch. On Wed, May 12, 2010 at 5:04 PM, Alan Gates wrote: > Can't we just change the built-in CONCAT to accept additional fields? This > would be totally backward compatible. I know it won't help now. > > Alan. > > > On May 12, 2010, at 4:15 P

Re: CONCAT multiple fields

2010-05-12 Thread Alan Gates
Can't we just change the built-in CONCAT to accept additional fields? This would be totally backward compatible. I know it won't help now. Alan. On May 12, 2010, at 4:15 PM, Russell Jurney wrote: The CONCAT in the oink project (LinkedIn's UDFs) does concatenation of any number of string ar

Re: CONCAT multiple fields

2010-05-12 Thread Russell Jurney
The CONCAT in the oink project (LinkedIn's UDFs) does concatenation of any number of string arguments: http://github.com/criccomini/oink/blob/master/src/java/oink/udf/CONCAT.java We're going to merge this with elephant-bird when we get a chance, and this UDF could use a new name like MULTI_CONCAT,

Re: CONCAT multiple fields

2010-05-12 Thread Dmitriy Ryaboy
It's not the prettiest thing, but: FOREACH file GENERATE CONCAT(CONCAT( CONCAT(house, ' '), CONCAT(predir, ' ')), street) (and so on) A better solution would be to write a UDF that wraps StringBuilder, and simply call GENERATE StringBuilder(house, ' ', predir, ' ', street ); -D On Wed, M

CONCAT multiple fields

2010-05-12 Thread Scott Wine
Hello, I am trying to create a full address and full location field in Pig by combining multiple fields. file = LOAD 'file.txt' USING PigStorage() AS (house:chararray, predir:chararray, street:chararray, streettype:chararray, postdir:chararray city:chararray, state:chararray, zip