PigPen Source

2009-06-15 Thread Russell Jurney
I want to play with PigPen, but although I can find the patches here: https://issues.apache.org/jira/browse/PIG-366 on the Jira, I cannot find the source in trunk/contrib/pigpen, or in any path in any branch. Where does the PigPen source reside? Does it exist only as a patch? Russell

Re: requirements for Pig 1.0?

2009-06-24 Thread Russell Jurney
For 1.0 - complete Owl? http://wiki.apache.org/pig/Metadata Russell Jurney rjur...@cloudstenography.com On Jun 23, 2009, at 4:40 PM, Alan Gates wrote: I don't believe there's a solid list of want to haves for 1.0. The big issue I see is that there are too many interfaces that

Re: [jira] Commented: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-03-30 Thread Russell Jurney
IG-1310 > > URL: https://issues.apache.org/jira/browse/PIG-1310 > > Project: Pig > > Issue Type: New Feature > > Components: impl > >Reporter: Russell Jurney > >Assignee: Russell Jurney > >

Re: What should FLATTEN do?

2010-04-02 Thread Russell Jurney
Not sure if this is exactly the same, but when I've created tuples within tuples in UDFs (to preserve order of pairs), from bag input, Pig has allowed it - but I can't work with that data in subsequent steps. On Fri, Apr 2, 2010 at 12:37 PM, hc busy wrote: > Yeah, I'm sure it has nested tuples.

Making a patch Hudson will eat with git?

2010-05-18 Thread Russell Jurney
How do you make a patch with git that hudson will eat? git diff/git diff -p don't cut the mustard. Russ

Re: Making a patch Hudson will eat with git?

2010-05-18 Thread Russell Jurney
Have tried --no-prefix, and it still will not apply without -p1. Strangeness. Anyone got any ideas? Russ On Tue, May 18, 2010 at 11:31 AM, Russell Jurney wrote: > How do you make a patch with git that hudson will eat? git diff/git diff > -p don't cut the mustard. > > Russ >

Re: Making a patch Hudson will eat with git?

2010-05-18 Thread Russell Jurney
for me, > > if it doesn't work maybe post a (fragment of a) patch so that we can take > a look/compare? > >ero > > > On 05/18/2010 12:36 PM, Russell Jurney wrote: > >> Have tried --no-prefix, and it still will not apply without -p1. >> Strangene

Re: [jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-27 Thread Russell Jurney
; Key: PIG-1420 > > URL: https://issues.apache.org/jira/browse/PIG-1420 > > Project: Pig > > Issue Type: Improvement > > Components: impl > >Affects Versions: 0.8.0 > >Reporter: Russell Jur

Re: [jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-27 Thread Russell Jurney
't worry about it, this patch is already in trunk. > > -D > > On Thu, May 27, 2010 at 11:22 AM, Russell Jurney > wrote: > > > Arg, I am terrible at making patches :( > > > > On Thu, May 27, 2010 at 5:24 AM, Hadoop QA (JIRA) > wrote: > > > &g

SIZE() of relation

2010-06-11 Thread Russell Jurney
Would it be possible, and not a ton of work to make the builtin SIZE() work on a relation? Reason being, I frequently do this: B = GROUP A ALL; C = FOREACH B GENERATE SIZE(A) AS total; DUMP C; And I would rather do this: DUMP SIZE(A); Russ

Re: SIZE() of relation

2010-06-11 Thread Russell Jurney
e obvious users-doing-dumb-stuff scenarios that arise though. > I guess the Pig philosophy is that the user is the optimizer, though.. so > maybe it's ok. > > -D > > On Fri, Jun 11, 2010 at 6:42 PM, Russell Jurney >wrote: > > > Would it be possible, and not a ton of w

Re: Avoiding serialization/de-serialization in pig

2010-06-28 Thread Russell Jurney
I don't fully understand the repercussions of this, but I like it. We're moving from our VoldemortStorage stuff to Avro and it would be great to pipe Avro all the way through. Russ On Mon, Jun 28, 2010 at 5:51 PM, Dmitriy Ryaboy wrote: > For what it's worth, I saw very significant speed improv

Fwd: FW:

2010-07-07 Thread Russell Jurney
This is my most common error as well. Is it possible to check this when creating a plan/parsing a script? Does the availability of mkdir mess this up? Russ Date: Wed, 7 Jul 2010 14:16:30 -0700 To: Russell Jurney I've realized that the most common mistake I make in pig scripts is to t

Re: [jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-08-17 Thread Russell Jurney
> > URL: https://issues.apache.org/jira/browse/PIG-1420 > > Project: Pig > > Issue Type: Improvement > > Components: impl > >Affects Versions: 0.8.0 > >Reporter: Russell Jurney > >Assig

Re: August Pig contributor workshop

2010-08-18 Thread Russell Jurney
Confirming Richard and I are attending. On Wed, Aug 18, 2010 at 4:45 PM, Dmitriy Ryaboy wrote: > Hi folks, > Please do RSVP so that we know how many people are coming. > > Thanks, > -Dmitriy > > On Tue, Aug 17, 2010 at 4:04 PM, Alan Gates wrote: > > > All, > > > > We will be holding the next Pi

Re: [VOTE] Pig to become a top level Apache project

2010-08-19 Thread Russell Jurney
Not much of a contributor lately, but +1 from me. Seems reasonable. On Wed, Aug 18, 2010 at 7:11 PM, Chaitanya Krishna < chaitanyavv.ii...@gmail.com> wrote: > +1. > > On Thu, Aug 19, 2010 at 7:33 AM, Santhosh Srinivasan >wrote: > > > +1 > > > > Kudos to Alan and Olga for this amazing milestone.

Re: August Pig contributor workshop

2010-08-19 Thread Russell Jurney
Oh, +2 more - Pete Skomoroch and Sam Shah will also attend, for a total of 4 LinkedIners. On Wed, Aug 18, 2010 at 9:18 PM, Alan Gates wrote: > Confirming Olga and I will be there. > > Alan. > > > On Aug 18, 2010, at 4:45 PM, Dmitriy Ryaboy wrote: > > Hi folks, >> Please do RSVP so that we know

Re: Pig Contributor meeting notes

2010-08-26 Thread Russell Jurney
Slides about Azkaban and Pig: http://www.slideshare.net/rjurney/azkaban-pig-5057793 On Thu, Aug 26, 2010 at 12:55 AM, Jeff Zhang wrote: > Wonderful, Dmitriy, It's pity for me missing the contributor meeting. > And any ppt shared ? > > > > On Wed, Aug 25, 2010 at 8:32 PM, Dmitriy Ryaboy > wrote:

Does Pig Re-Use FileInputLoadFuncs Objects?

2010-08-31 Thread Russell Jurney
Pardon the cross-post: Does Pig ever re-use FileInputLoadFunc objects? We suspect state is being retained between different stores, but we don't actually know this. Figured I'd ask to verify the hunch. Our load func for our in-house format works fine with Pig scripts normally... but I have a pig

[jira] Commented: (PIG-896) Pig doesnt run on Mac OSX

2009-07-27 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12735729#action_12735729 ] Russell Jurney commented on PIG-896: Not sure if you're able to get it runni

[jira] Created: (PIG-1150) VAR() Variance UDF

2009-12-14 Thread Russell Jurney (JIRA)
/ Reporter: Russell Jurney Fix For: 0.5.0 I've implemented a UDF in Pig 0.5 that implements Algebraic and calculates variance in a distributed manner, based on the AVG() builtin. It works by calculating the count, sum and sum of squares, as described here: http://en.wikipedia.org

[jira] Updated: (PIG-1150) VAR() Variance UDF

2009-12-16 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1150: Attachment: var.patch This patch will not cut the mustard - it lacks Javadoc, and test cases and its

[jira] Commented: (PIG-1150) VAR() Variance UDF

2009-12-16 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12791582#action_12791582 ] Russell Jurney commented on PIG-1150: - Oh - one other thing - I've read that t

[jira] Created: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-19 Thread Russell Jurney (JIRA)
Reporter: Russell Jurney Fix For: 0.7.0 I've written UDFs to handle loading unix times, datemonth values and ISO 8601 formatted date strings, and working with them as ISO datetimes using jodatime. The working code is here: http://github.com/rjurney/oink/tree/master/src/java

[jira] Commented: (PIG-1150) VAR() Variance UDF

2010-03-19 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12847600#action_12847600 ] Russell Jurney commented on PIG-1150: - Yes, this sounds like the thing to do :) On

[jira] Commented: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-20 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12847874#action_12847874 ] Russell Jurney commented on PIG-1310: - I'm thinking it would be good if DateT

[jira] Created: (PIG-1314) Add DateTime Support to Pig

2010-03-22 Thread Russell Jurney (JIRA)
Add DateTime Support to Pig --- Key: PIG-1314 URL: https://issues.apache.org/jira/browse/PIG-1314 Project: Pig Issue Type: Bug Components: data Affects Versions: 0.8.0 Reporter: Russell

[jira] Commented: (PIG-1314) Add DateTime Support to Pig

2010-03-22 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848356#action_12848356 ] Russell Jurney commented on PIG-1314: - Thanks, Alan. That is quite helpful. Le

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-23 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Fix Version/s: (was: 0.8.0) 0.7.0 Release Note: Can this get in 0.7? I&#

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-23 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: datetime.patch Patch to add datetime UDFs > ISO Date UDFs: Conversion, Rounding

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-23 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: (was: datetime.patch) > ISO Date UDFs: Conversion, Rounding and Date M

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-23 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: datetime.patch Whoops, minor fix - attached patch again. > ISO Date UDFs: Convers

[jira] Commented: (PIG-1314) Add DateTime Support to Pig

2010-03-23 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848618#action_12848618 ] Russell Jurney commented on PIG-1314: - I would not say this blocks PIG-1310 at all -

[jira] Commented: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-23 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848958#action_12848958 ] Russell Jurney commented on PIG-1310: - Alan, yes jodatime is on a maven repo - I hav

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-23 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: datetime2.patch Added checks for null/ < foo sized tuples. Added CustomFormatTo

[jira] Commented: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-24 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849528#action_12849528 ] Russell Jurney commented on PIG-1310: - Thanks, Alan, I'll add all those change

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-25 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: (was: datetime.patch) > ISO Date UDFs: Conversion, Rounding and Date M

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-25 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: (was: datetime2.patch) > ISO Date UDFs: Conversion, Rounding and Date M

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-25 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: datetime3.patch This patch addresses all issues raised: I have pulled DateMonthToISO

[jira] Commented: (PIG-1310) ISO Date UDFs: Conversion, Rounding and Date Math

2010-03-25 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849623#action_12849623 ] Russell Jurney commented on PIG-1310: - Oh, I'm allergic to XML. Seriously

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-03-25 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Summary: ISO Date UDFs: Conversion, Trucation and Date Math (was: ISO Date UDFs: Conversion

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-03-25 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: tests.patch Tests attached. > ISO Date UDFs: Conversion, Trucation and Date M

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-03-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: (was: datetime3.patch) > ISO Date UDFs: Conversion, Trucation and Date M

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-03-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: combined.patch All inclusive patch from pig root, includes all classes and tests, and

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-03-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: (was: tests.patch) > ISO Date UDFs: Conversion, Trucation and Date M

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-03-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: (was: combined.patch) > ISO Date UDFs: Conversion, Trucation and Date M

[jira] Commented: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-03-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12851063#action_12851063 ] Russell Jurney commented on PIG-1310: - Good god, how I long for git. This is actu

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-03-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: deargod.patch Last shot at a patch - this builds and tests ok against a fresh checkout

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-03-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: (was: deargod.patch) > ISO Date UDFs: Conversion, Trucation and Date M

[jira] Updated: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-03-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1310: Attachment: pass.patch Ok, this patch works. > ISO Date UDFs: Conversion, Trucation and D

[jira] Commented: (PIG-1310) ISO Date UDFs: Conversion, Trucation and Date Math

2010-03-30 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12851542#action_12851542 ] Russell Jurney commented on PIG-1310: - Cool - one thing though - Piggybank itself

[jira] Created: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-14 Thread Russell Jurney (JIRA)
Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.8.0 Reporter: Russell Jurney Fix For: 0.7.0 org.apache.pig.builtin.CONCAT (which acts on DataByteArray's internally) and org.apache.pig.builtin.StringConcat (which ac

[jira] Updated: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-14 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1420: Attachment: concat.patch Patch that adds: 1) CONCAT handles all fields in the supplied tuple

[jira] Updated: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-14 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1420: Status: Patch Available (was: Open) Release Note: CONCAT handles all fields in the

[jira] Updated: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-16 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1420: Status: Open (was: Patch Available) Redoing CONCAT of DataByteArrays using java.nio.ByteBuffer

[jira] Updated: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-16 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1420: Status: Patch Available (was: Open) Re-submitting original, java.nio.ByteBuffer isn't very he

[jira] Updated: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-17 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1420: Status: In Progress (was: Patch Available) I don't know what resume progress does, but I'

[jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-18 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12868765#action_12868765 ] Russell Jurney commented on PIG-1420: - Dmitriy, it applies with -p1 > Make CON

[jira] Updated: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-18 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1420: Attachment: addconcat.patch New, working patch made with git diff --no-prefix, applies with -p0

[jira] Updated: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-18 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1420: Attachment: (was: concat.patch) > Make CONCAT act on all fields of a tuple, instead of just

[jira] Updated: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-18 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1420: Patch Info: [Patch Available] > Make CONCAT act on all fields of a tuple, instead of just the fi

[jira] Updated: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-19 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1420: Attachment: (was: addconcat.patch) > Make CONCAT act on all fields of a tuple, instead of j

[jira] Updated: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-05-19 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1420: Attachment: addconcat2.patch Fixed bad comment re: copying bytes. > Make CONCAT act on all fie

[jira] Commented: (PIG-1150) VAR() Variance UDF

2010-05-25 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871505#action_12871505 ] Russell Jurney commented on PIG-1150: - What do y'all think about making this

[jira] Created: (PIG-1429) Add Boolean Data Type to Pig

2010-05-28 Thread Russell Jurney (JIRA)
: Russell Jurney Fix For: 0.8.0 Pig needs a Boolean data type. Pig-1097 is dependent on doing this. I volunteer. Is there anything beyond the work in src/org/apache/pig/data/ plus unit tests to make this work? -- This message is automatically generated by JIRA. - You can reply

[jira] Created: (PIG-1430) ISODateTime -> DateTime: DateTime UDFs Should Also Support int/second Unix Times in All Operations

2010-05-28 Thread Russell Jurney (JIRA)
PIG-1430 Project: Pig Issue Type: Improvement Components: impl Affects Versions: 0.7.0 Reporter: Russell Jurney Fix For: 0.8.0 All functions in contrib.piggybank.java.src.main.java.org.apache.pig.piggybank.evaluation.datetime sho

[jira] Commented: (PIG-1430) ISODateTime -> DateTime: DateTime UDFs Should Also Support int/second Unix Times in All Operations

2010-05-28 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12873217#action_12873217 ] Russell Jurney commented on PIG-1430: - Actually, I think it should interpret int as

[jira] Created: (PIG-1431) Current DateTime UDFs: ISONOW(), UNIXNOW()

2010-05-28 Thread Russell Jurney (JIRA)
: 0.7.0 Reporter: Russell Jurney Fix For: 0.8.0 Need a NOW() for getting datetime diffs between now and a prior or future date. Will use the system timezone. Will make one for ISO datetime and one for Unix time. -- This message is automatically generated by JIRA. - You

[jira] Commented: (PIG-1430) ISODateTime -> DateTime: DateTime UDFs Should Also Support int/second Unix Times in All Operations

2010-05-28 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12873233#action_12873233 ] Russell Jurney commented on PIG-1430: - Good idea, will do! > ISODateTime ->

[jira] Commented: (PIG-1314) Add DateTime Support to Pig

2010-05-28 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12873234#action_12873234 ] Russell Jurney commented on PIG-1314: - As a first pass, I am going to add Boolean, w

[jira] Updated: (PIG-1429) Add Boolean Data Type to Pig

2010-05-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1429: Attachment: boolean.patch Broken patch that adds boolean type. > Add Boolean Data Type to

[jira] Commented: (PIG-1429) Add Boolean Data Type to Pig

2010-05-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12873363#action_12873363 ] Russell Jurney commented on PIG-1429: - Did the work I think is required based on Al

[jira] Commented: (PIG-1314) Add DateTime Support to Pig

2010-05-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12873382#action_12873382 ] Russell Jurney commented on PIG-1314: - Ok, thinking about really doing this soon, a

[jira] Updated: (PIG-1429) Add Boolean Data Type to Pig

2010-05-30 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1429: Attachment: boolean.patch > Add Boolean Data Type to

[jira] Updated: (PIG-1429) Add Boolean Data Type to Pig

2010-05-30 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1429: Attachment: (was: boolean.patch) > Add Boolean Data Type to

[jira] Commented: (PIG-1429) Add Boolean Data Type to Pig

2010-05-30 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12873474#action_12873474 ] Russell Jurney commented on PIG-1429: - Did some more work, have a new patch... seems

[jira] Updated: (PIG-1429) Add Boolean Data Type to Pig

2010-05-30 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1429: Attachment: working_boolean.patch Attached patch can LOAD/DUMP a boolean type :D I'll work on

[jira] Updated: (PIG-1429) Add Boolean Data Type to Pig

2010-05-30 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1429: Attachment: (was: boolean.patch) > Add Boolean Data Type to

[jira] Commented: (PIG-1429) Add Boolean Data Type to Pig

2010-05-31 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12873629#action_12873629 ] Russell Jurney commented on PIG-1429: - Some more work to be done with operators. &

[jira] Commented: (PIG-1314) Add DateTime Support to Pig

2010-05-31 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12873664#action_12873664 ] Russell Jurney commented on PIG-1314: - Hmmm not sure if I should use duration

[jira] Created: (PIG-1436) Print number of records outputted at each step of a Pig script

2010-06-03 Thread Russell Jurney (JIRA)
Components: grunt Affects Versions: 0.7.0 Reporter: Russell Jurney Priority: Minor Fix For: 0.8.0 I often run a script multiple times, or have to go and look through Hadoop task logs, to figure out where I broke a long script in such a way that I get 0

[jira] Commented: (PIG-1429) Add Boolean Data Type to Pig

2010-06-10 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12877544#action_12877544 ] Russell Jurney commented on PIG-1429: - The patch needs more work. Should knock it

[jira] Commented: (PIG-1429) Add Boolean Data Type to Pig

2010-06-20 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12880731#action_12880731 ] Russell Jurney commented on PIG-1429: - I'll be able to wrap this up next weeken

[jira] Created: (PIG-1476) Add trailing flag to commands to prevent retention of relation name in field names: STRIP ?

2010-06-29 Thread Russell Jurney (JIRA)
Project: Pig Issue Type: New Feature Affects Versions: 0.7.0 Environment: sunny, 60% humidity with a chance of rain. Reporter: Russell Jurney Fix For: 0.8.0 After doing a JOIN or a GROUP/FOREACH, one often ends up with data looking like: > DESCR

[jira] Updated: (PIG-1476) Add trailing flag to commands to prevent retention of relation name in field names: STRIP ?

2010-06-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1476: Description: After doing a JOIN or a GROUP/FOREACH, one often ends up with data looking like

[jira] Updated: (PIG-1476) Add trailing flag to commands to prevent retention of relation name in field names: STRIP ?

2010-06-29 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1476: Description: After doing a JOIN or a GROUP/FOREACH, one often ends up with data looking like

[jira] Commented: (PIG-1430) ISODateTime -> DateTime: DateTime UDFs Should Also Support int/second Unix Times in All Operations

2010-07-01 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884557#action_12884557 ] Russell Jurney commented on PIG-1430: - I've been thinking about the feedba

[jira] Commented: (PIG-1314) Add DateTime Support to Pig

2010-07-01 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884558#action_12884558 ] Russell Jurney commented on PIG-1314: - Been thinking about this... I don't

[jira] Commented: (PIG-1314) Add DateTime Support to Pig

2010-07-01 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884562#action_12884562 ] Russell Jurney commented on PIG-1314: - I suck at JIRA. See proposal in PIG-

[jira] Resolved: (PIG-1476) Add trailing flag to commands to prevent retention of relation name in field names: STRIP ?

2010-07-06 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney resolved PIG-1476. - Resolution: Fixed This is actually ok. > Add trailing flag to commands to prevent retention

[jira] Created: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

2010-07-12 Thread Russell Jurney (JIRA)
Type: New Feature Components: impl Affects Versions: 0.7.0 Reporter: Russell Jurney Fix For: 0.8.0 rjurney$ pig -q default This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs. Patch attached

[jira] Updated: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

2010-07-12 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1495: Attachment: set_queue.patch > Add -q command line option to set queue name for Pig jobs from comm

[jira] Updated: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

2010-07-12 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1495: Status: Patch Available (was: Open) > Add -q command line option to set queue name for Pig j

[jira] Updated: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

2010-07-12 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-1495: Status: Open (was: Patch Available) > Add -q command line option to set queue name for Pig j

[jira] Commented: (PIG-1495) Add -q command line option to set queue name for Pig jobs from command line

2010-07-12 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887585#action_12887585 ] Russell Jurney commented on PIG-1495: - This doesn't work yet. Doh! > Ad