[jira] [Updated] (PIG-3170) Pig keeps static references to Hadoop's Context after end of task

2013-03-18 Thread Johnny Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Zhang updated PIG-3170: -- Attachment: PIG-3170.patch.txt the old patch doesn't clean on trunk already. I just uploaded the new patc

[jira] [Commented] (PIG-3208) [zebra] TFile should not set io.compression.codec.lzo.buffersize

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606028#comment-13606028 ] Daniel Dai commented on PIG-3208: - Thanks Xuefu chime in. I am happy to check in any Zebra p

[jira] [Commented] (PIG-3208) [zebra] TFile should not set io.compression.codec.lzo.buffersize

2013-03-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606023#comment-13606023 ] Xuefu Zhang commented on PIG-3208: -- Eugene, If we remove the two lines, will Zebra take wh

[jira] [Commented] (PIG-3208) [zebra] TFile should not set io.compression.codec.lzo.buffersize

2013-03-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13606016#comment-13606016 ] Xuefu Zhang commented on PIG-3208: -- I guess Daniel meant to say that Zebra isn't in active

Can we commit PIG-3015 (Rewrite of AvroStorage) to trunk?

2013-03-18 Thread Cheolsoo Park
Hello, Thanks to Joseph Adler's contribution, we have a new AvroStorage ready. Although there are additional requests that we would like to address, I think we can implement them incrementally after we commit the current patches. As of now, - The core features are fully implemented. - All the uni

[jira] [Updated] (PIG-3110) pig corrupts chararrays with trailing whitespace when converting them to long

2013-03-18 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi updated PIG-3110: - Fix Version/s: 0.12 Status: Patch Available (was: Open) > pig corrupts char

[jira] [Updated] (PIG-3110) pig corrupts chararrays with trailing whitespace when converting them to long

2013-03-18 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi updated PIG-3110: - Attachment: PIG-3110.patch Patch contains changes to Utf8StorageConverter and TestConversio

[jira] [Assigned] (PIG-3110) pig corrupts chararrays with trailing whitespace when converting them to long

2013-03-18 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi reassigned PIG-3110: Assignee: Prashant Kommireddi > pig corrupts chararrays with trailing whitespace

[jira] [Updated] (PIG-3252) AvroStorage gives wrong schema for schemas with named records

2013-03-18 Thread Mark Wagner (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Wagner updated PIG-3252: - Fix Version/s: 0.11.1 0.12 Status: Patch Available (was: Open) > AvroSto

[jira] [Updated] (PIG-3252) AvroStorage gives wrong schema for schemas with named records

2013-03-18 Thread Mark Wagner (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Wagner updated PIG-3252: - Attachment: PIG-3252.1.patch This was introduced with the added support for recursive schemas in [PIG-2875]

[jira] [Assigned] (PIG-3252) AvroStorage gives wrong schema for schemas with named records

2013-03-18 Thread Mark Wagner (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Wagner reassigned PIG-3252: Assignee: Mark Wagner > AvroStorage gives wrong schema for schemas with named records > -

[jira] [Created] (PIG-3252) AvroStorage gives wrong schema for schemas with named records

2013-03-18 Thread Mark Wagner (JIRA)
Mark Wagner created PIG-3252: Summary: AvroStorage gives wrong schema for schemas with named records Key: PIG-3252 URL: https://issues.apache.org/jira/browse/PIG-3252 Project: Pig Issue Type: Bu

[jira] Subscription: PIG patch available

2013-03-18 Thread jira
Issue Subscription Filter: PIG patch available (31 issues) Subscriber: pigdaily Key Summary PIG-3249Pig startup script prints out a wrong version of hadoop when using fat jar https://issues.apache.org/jira/browse/PIG-3249 PIG-3247Piggybank functions to mimic O

[jira] [Commented] (PIG-3251) Bzip2TextInputFormat requires double the memory of maximum record size

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605874#comment-13605874 ] Daniel Dai commented on PIG-3251: - Looks good. Seems the reason why we use ByteArrayOutputSt

[jira] [Commented] (PIG-2388) Make shim for Hadoop 0.20 and 0.23 support dynamic

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605870#comment-13605870 ] Daniel Dai commented on PIG-2388: - [~dvryaboy] Hive does not has illustrate. It is the illus

[jira] [Commented] (PIG-2388) Make shim for Hadoop 0.20 and 0.23 support dynamic

2013-03-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605849#comment-13605849 ] Dmitriy V. Ryaboy commented on PIG-2388: Hive does this, and back in the day there w

[jira] [Commented] (PIG-2451) Pig should not mandate hadoop-site.xml or core-site.xml to be on the classpath

2013-03-18 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605841#comment-13605841 ] Prashant Kommireddi commented on PIG-2451: -- Hi [~julienledem], does PIG-3135 addres

[jira] [Commented] (PIG-3208) [zebra] TFile should not set io.compression.codec.lzo.buffersize

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605835#comment-13605835 ] Daniel Dai commented on PIG-3208: - Ok, I am not objecting to that. My concern is if a fix in

[jira] [Commented] (PIG-2602) packageImportList should be configurable

2013-03-18 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605833#comment-13605833 ] Prashant Kommireddi commented on PIG-2602: -- [~ashutoshc] should this be closed out

[jira] [Commented] (PIG-3110) pig corrupts chararrays with trailing whitespace when converting them to long

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605826#comment-13605826 ] Daniel Dai commented on PIG-3110: - Agree, in case of parseLong fail, we can try to do a trim

[jira] [Resolved] (PIG-3217) Add support for DateTime type in Groovy UDFs

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-3217. - Resolution: Fixed Fix Version/s: 0.12 Hadoop Flags: Reviewed Committed to trunk. Thanks Mathias

[jira] [Resolved] (PIG-3218) Add support for biginteger/bigdecimal type in Groovy UDFs

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-3218. - Resolution: Fixed Hadoop Flags: Reviewed Committed to trunk. Thanks Mathias! > Add s

[jira] [Commented] (PIG-3222) New UDFContextSignature assignments in Pig 0.11 breaks HCatalog.HCatStorer

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605788#comment-13605788 ] Daniel Dai commented on PIG-3222: - [~pengfeng] I tried a similar query using HCatStorer, I d

[jira] [Commented] (PIG-3110) pig corrupts chararrays with trailing whitespace when converting them to long

2013-03-18 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605785#comment-13605785 ] Prashant Kommireddi commented on PIG-3110: -- I think the difference between Double a

[jira] [Updated] (PIG-3251) Bzip2TextInputFormat requires double the memory of maximum record size

2013-03-18 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3251: -- Attachment: pig-3251-trunk-v01.patch In Bzip2TextInputFormat, it says {code} /** * Prov

[jira] [Commented] (PIG-2527) ILLUSTRATE fails for relations LOADed with the AvroStorage UDF

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605767#comment-13605767 ] Daniel Dai commented on PIG-2527: - [~rohini], I didn't investigate which jira fix the issue.

[jira] [Commented] (PIG-3208) [zebra] TFile should not set io.compression.codec.lzo.buffersize

2013-03-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605765#comment-13605765 ] Dmitriy V. Ryaboy commented on PIG-3208: [~daijy] why wouldn't we commit fixes provi

[jira] [Created] (PIG-3251) Bzip2TextInputFormat requires double the memory of maximum record size

2013-03-18 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-3251: - Summary: Bzip2TextInputFormat requires double the memory of maximum record size Key: PIG-3251 URL: https://issues.apache.org/jira/browse/PIG-3251 Project: Pig Iss

[jira] [Commented] (PIG-3208) [zebra] TFile should not set io.compression.codec.lzo.buffersize

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605754#comment-13605754 ] Daniel Dai commented on PIG-3208: - Hi, Eugene, Zebra is no longer supported except for compi

[jira] [Commented] (PIG-3049) Cannot sort on a bag in nested foreach

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605749#comment-13605749 ] Daniel Dai commented on PIG-3049: - This syntax should be supported. The error stack is on ma

Jenkins build is back to normal : Pig-trunk #1438

2013-03-18 Thread Apache Jenkins Server
See

[jira] [Updated] (PIG-3172) Partition filter push down does not happen when there is a non partition key map column filter

2013-03-18 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3172: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk (0.12).

[jira] [Commented] (PIG-3238) Pig current releases lack a UDF Stuff(). This UDF deletes a specified length of characters and inserts another set of characters at a specified starting point.

2013-03-18 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605629#comment-13605629 ] Prashant Kommireddi commented on PIG-3238: -- Also, if you could add the Apache licen

[jira] [Resolved] (PIG-3248) Upgrade hadoop-2.0.0-alpha to hadoop-2.0.3-alpha

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-3248. - Resolution: Fixed Hadoop Flags: Reviewed Committed to trunk. > Upgrade hadoop-2.0.0-

[jira] [Commented] (PIG-3163) Pig current releases lack a UDF endsWith.This UDF tests if a given string ends with the specified suffix.

2013-03-18 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605620#comment-13605620 ] Prashant Kommireddi commented on PIG-3163: -- [~anuroopa george] would you like to ta

[jira] [Updated] (PIG-3163) Pig current releases lack a UDF endsWith.This UDF tests if a given string ends with the specified suffix.

2013-03-18 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Kommireddi updated PIG-3163: - Issue Type: New Feature (was: Bug) > Pig current releases lack a UDF endsWith.This UDF

[jira] [Commented] (PIG-3248) Upgrade hadoop-2.0.0-alpha to hadoop-2.0.3-alpha

2013-03-18 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605615#comment-13605615 ] Thejas M Nair commented on PIG-3248: +1 > Upgrade hadoop-2.0.0-alpha to

Re: Are we ready for 0.11.1 release?

2013-03-18 Thread Bill Graham
Sure, I can get a RC out this week. On Mon, Mar 18, 2013 at 10:51 AM, Dmitriy Ryaboy wrote: > Yeah adding new types seems like a big thing, would prefer for it to be > 0.12 only. > > > Sounds like we are ready to roll 0.11.1.. Bill, want to do the honors > again? > > > On Mon, Mar 18, 2013 at

[jira] [Commented] (PIG-3248) Upgrade hadoop-2.0.0-alpha to hadoop-2.0.3-alpha

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605610#comment-13605610 ] Daniel Dai commented on PIG-3248: - Yes, otherwise I need to add "-Xss" option to increase th

[jira] [Commented] (PIG-3015) Rewrite of AvroStorage

2013-03-18 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605589#comment-13605589 ] Prashant Kommireddi commented on PIG-3015: -- [~jadler] note the "tagsource" option o

[jira] [Commented] (PIG-3248) Upgrade hadoop-2.0.0-alpha to hadoop-2.0.3-alpha

2013-03-18 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605584#comment-13605584 ] Thejas M Nair commented on PIG-3248: bq. This is actually a different issue. TestPigSpli

[jira] [Commented] (PIG-3248) Upgrade hadoop-2.0.0-alpha to hadoop-2.0.3-alpha

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605580#comment-13605580 ] Daniel Dai commented on PIG-3248: - This is actually a different issue. TestPigSplit always f

[jira] [Commented] (PIG-3015) Rewrite of AvroStorage

2013-03-18 Thread Joseph Adler (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605579#comment-13605579 ] Joseph Adler commented on PIG-3015: --- I like the -tagsource option idea. Should we allow th

[jira] [Commented] (PIG-3248) Upgrade hadoop-2.0.0-alpha to hadoop-2.0.3-alpha

2013-03-18 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605460#comment-13605460 ] Thejas M Nair commented on PIG-3248: Daniel, Is the following change relevant for the ha

Re: Are we ready for 0.11.1 release?

2013-03-18 Thread Dmitriy Ryaboy
Yeah adding new types seems like a big thing, would prefer for it to be 0.12 only. Sounds like we are ready to roll 0.11.1.. Bill, want to do the honors again? On Mon, Mar 18, 2013 at 10:40 AM, Julien Le Dem wrote: > Agreed with Daniel, > PIG-2764 will go in Pig 0.12 > Julien > > On Mar 18,

Re: Are we ready for 0.11.1 release?

2013-03-18 Thread Julien Le Dem
Agreed with Daniel, PIG-2764 will go in Pig 0.12 Julien On Mar 18, 2013, at 10:32 AM, Daniel Dai wrote: > Dimitry: Just committed PIG-3132. > > Richard: PIG-2764 is new feature, we usually don't include new feature > in minor release. > > Daniel > > On Mon, Mar 18, 2013 at 10:21 AM, Richard Di

Re: Are we ready for 0.11.1 release?

2013-03-18 Thread Daniel Dai
Dimitry: Just committed PIG-3132. Richard: PIG-2764 is new feature, we usually don't include new feature in minor release. Daniel On Mon, Mar 18, 2013 at 10:21 AM, Richard Ding wrote: > How about PIG-2764? It would be nice to include this feature. > > > On Mon, Mar 18, 2013 at 1:04 AM, Dmitriy

[jira] [Resolved] (PIG-3132) NPE when illustrating a relation with HCatLoader

2013-03-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-3132. - Resolution: Fixed Fix Version/s: (was: 0.12) 0.11.1 Hadoop Flags: Reviewe

Re: Are we ready for 0.11.1 release?

2013-03-18 Thread Richard Ding
How about PIG-2764? It would be nice to include this feature. On Mon, Mar 18, 2013 at 1:04 AM, Dmitriy Ryaboy wrote: > Just +1'd it. > I think after this one we are good to go? > > > On Sun, Mar 17, 2013 at 9:09 PM, Daniel Dai wrote: > > > Can I include PIG-3132? > > > > Thanks, > > Daniel > >

[jira] [Updated] (PIG-3205) Passing arguments to python script does not work with -f option

2013-03-18 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3205: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks

Build failed in Jenkins: Pig-trunk #1437

2013-03-18 Thread Apache Jenkins Server
See Changes: [daijy] PIG-2507: Semicolon in paramenters for UDF results in parsing error (tnachen via daijy) -- [...truncated 6813 lines...] [ivy:resolve] found org.apache.httpcomponents#httpclient;

[jira] [Commented] (PIG-3132) NPE when illustrating a relation with HCatLoader

2013-03-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604929#comment-13604929 ] Dmitriy V. Ryaboy commented on PIG-3132: +1 > NPE when illustratin

Re: Are we ready for 0.11.1 release?

2013-03-18 Thread Dmitriy Ryaboy
Just +1'd it. I think after this one we are good to go? On Sun, Mar 17, 2013 at 9:09 PM, Daniel Dai wrote: > Can I include PIG-3132? > > Thanks, > Daniel > > On Fri, Mar 15, 2013 at 5:57 PM, Julien Le Dem wrote: > > +1 for a new release > > > > Julien > > > > On Mar 15, 2013, at 17:08, Dmitriy

[jira] [Commented] (PIG-3015) Rewrite of AvroStorage

2013-03-18 Thread Frederic Rechtenstein (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604910#comment-13604910 ] Frederic Rechtenstein commented on PIG-3015: Hi, This looks very nice, I am rea