[jira] [Updated] (PIG-4059) Pig on Spark

2014-09-05 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-4059: --- Labels: spork (was: ) > Pig on Spark > > > Key: PIG-4059 >

[jira] [Commented] (PIG-3558) ORC support for Pig

2014-07-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067289#comment-14067289 ] Dmitriy V. Ryaboy commented on PIG-3558: Nice. How much does this increase the weig

[jira] [Commented] (PIG-2620) Customizable Error Handling in Pig

2014-06-05 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14019121#comment-14019121 ] Dmitriy V. Ryaboy commented on PIG-2620: Hi Qinghao, When looking at tickets in JIRA

[jira] [Updated] (PIG-3558) ORC support for Pig

2014-04-10 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3558: --- Labels: porc (was: ) > ORC support for Pig > --- > > Key: PIG-

[jira] [Commented] (PIG-3558) ORC support for Pig

2014-02-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904663#comment-13904663 ] Dmitriy V. Ryaboy commented on PIG-3558: Help me understand this. My understanding i

[jira] [Commented] (PIG-3558) ORC support for Pig

2014-02-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904627#comment-13904627 ] Dmitriy V. Ryaboy commented on PIG-3558: [~daijy] not quite: {code} - conf="te

[jira] [Commented] (PIG-3558) ORC support for Pig

2014-02-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904590#comment-13904590 ] Dmitriy V. Ryaboy commented on PIG-3558: So that's a -1. I would +1 this if it was

[jira] [Comment Edited] (PIG-3558) ORC support for Pig

2014-02-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904574#comment-13904574 ] Dmitriy V. Ryaboy edited comment on PIG-3558 at 2/18/14 8:55 PM: -

[jira] [Commented] (PIG-3558) ORC support for Pig

2014-02-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904574#comment-13904574 ] Dmitriy V. Ryaboy commented on PIG-3558: I am pro adding ORC support in Pig, but aga

[jira] [Commented] (PIG-3456) Reduce threadlocal conf access in backend for each record

2014-02-09 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13896199#comment-13896199 ] Dmitriy V. Ryaboy commented on PIG-3456: Added a couple minor comments. Good change

[jira] [Commented] (PIG-3347) Store invocation brings side effect

2014-01-30 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13887114#comment-13887114 ] Dmitriy V. Ryaboy commented on PIG-3347: Yikes. [~aniket486] & [~julienledem] this

[jira] [Updated] (PIG-3347) Store invocation brings side effect

2014-01-30 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3347: --- Priority: Critical (was: Major) > Store invocation brings side effect > --

[jira] [Commented] (PIG-3299) Provide support for LazyOutputFormat to avoid creating empty files

2014-01-30 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13887109#comment-13887109 ] Dmitriy V. Ryaboy commented on PIG-3299: [~daijy] shall we commit this? > Provide s

[jira] [Updated] (PIG-3672) pig should not hardcode "hdfs://" path in code, should be configurable to other file system implementations

2014-01-30 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3672: --- Status: Open (was: Patch Available) cancelling patch available status given Rohini's comments

[jira] [Commented] (PIG-3456) Reduce threadlocal conf access in backend for each record

2014-01-30 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13887098#comment-13887098 ] Dmitriy V. Ryaboy commented on PIG-3456: Could you post a patch without the whitespa

[jira] [Commented] (PIG-3722) Udf deserialization for registered classes fails in local_mode

2014-01-30 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13886991#comment-13886991 ] Dmitriy V. Ryaboy commented on PIG-3722: +1 > Udf deserialization for registered cl

[jira] [Commented] (PIG-2672) Optimize the use of DistributedCache

2014-01-27 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883478#comment-13883478 ] Dmitriy V. Ryaboy commented on PIG-2672: [~knoguchi] in the spirit of keeping things

[jira] [Commented] (PIG-2672) Optimize the use of DistributedCache

2014-01-23 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880084#comment-13880084 ] Dmitriy V. Ryaboy commented on PIG-2672: Seems like there is a lot of effort being s

[jira] [Commented] (PIG-3621) Python Avro library can't read Avros made with builtin AvroStorage

2013-12-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852500#comment-13852500 ] Dmitriy V. Ryaboy commented on PIG-3621: +1 > Python Avro library can't read Avros

[jira] [Commented] (PIG-3621) Python Avro library can't read Avros made with builtin AvroStorage

2013-12-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852441#comment-13852441 ] Dmitriy V. Ryaboy commented on PIG-3621: Sorry, that was a "no" to the assignment. C

[jira] [Assigned] (PIG-3621) Python Avro library can't read Avros made with builtin AvroStorage

2013-12-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy reassigned PIG-3621: -- Assignee: (was: Dmitriy V. Ryaboy) Uh, no thanks :) > Python Avro library can't read

[jira] [Commented] (PIG-3630) Macros that work in Pig 0.11 fail in Pig 0.12 :(

2013-12-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852299#comment-13852299 ] Dmitriy V. Ryaboy commented on PIG-3630: Now that registers are in place, it works i

[jira] [Commented] (PIG-3630) Macros that work in Pig 0.11 fail in Pig 0.12 :(

2013-12-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852281#comment-13852281 ] Dmitriy V. Ryaboy commented on PIG-3630: Actually that failed in 11 due to missing r

[jira] [Commented] (PIG-3630) Macros that work in Pig 0.11 fail in Pig 0.12 :(

2013-12-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852272#comment-13852272 ] Dmitriy V. Ryaboy commented on PIG-3630: That one fails in both 0.11 and 0.12. Do y

[jira] [Commented] (PIG-3630) Macros that work in Pig 0.11 fail in Pig 0.12 :(

2013-12-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852221#comment-13852221 ] Dmitriy V. Ryaboy commented on PIG-3630: Sure enough. Once I add that, everything

[jira] [Commented] (PIG-3630) Macros that work in Pig 0.11 fail in Pig 0.12 :(

2013-12-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13852133#comment-13852133 ] Dmitriy V. Ryaboy commented on PIG-3630: Is this a AvroStorage or data issue? grun

[jira] [Commented] (PIG-3630) Macros that work in Pig 0.11 fail in Pig 0.12 :(

2013-12-17 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851412#comment-13851412 ] Dmitriy V. Ryaboy commented on PIG-3630: That macro does not refer to a field called

[jira] [Commented] (PIG-3630) Macros that work in Pig 0.11 fail in Pig 0.12 :(

2013-12-17 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13851239#comment-13851239 ] Dmitriy V. Ryaboy commented on PIG-3630: Could you link to the code directly, rather

[jira] [Commented] (PIG-3453) Implement a Storm backend to Pig

2013-11-04 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813150#comment-13813150 ] Dmitriy V. Ryaboy commented on PIG-3453: Oh I absolutely just meant collaboration on

[jira] [Commented] (PIG-3453) Implement a Storm backend to Pig

2013-11-04 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813080#comment-13813080 ] Dmitriy V. Ryaboy commented on PIG-3453: Mridul: In our experience at Twitter, Trid

[jira] [Commented] (PIG-3453) Implement a Storm backend to Pig

2013-11-01 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13811726#comment-13811726 ] Dmitriy V. Ryaboy commented on PIG-3453: I don't see why Jacob can't keep working in

[jira] [Commented] (PIG-3549) Print hadoop jobids for failed, killed job

2013-10-29 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13808007#comment-13808007 ] Dmitriy V. Ryaboy commented on PIG-3549: OMG. Thanks. +1. > Print hadoop jobids for

[jira] [Commented] (PIG-3453) Implement a Storm backend to Pig

2013-10-28 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13807458#comment-13807458 ] Dmitriy V. Ryaboy commented on PIG-3453: [~azaroth]: may I suggest https://github.co

[jira] [Commented] (PIG-3082) outputSchema of a UDF allows two usages when describing a Tuple schema

2013-10-02 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784720#comment-13784720 ] Dmitriy V. Ryaboy commented on PIG-3082: So... that's a breaking change, a bunch of

[jira] [Commented] (PIG-3445) Make Parquet format available out of the box in Pig

2013-10-02 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784627#comment-13784627 ] Dmitriy V. Ryaboy commented on PIG-3445: That's a great addition, thanks Lorand. Th

[jira] [Commented] (PIG-3445) Make Parquet format available out of the box in Pig

2013-10-01 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783614#comment-13783614 ] Dmitriy V. Ryaboy commented on PIG-3445: [~lbendig] might be more succinct to use St

[jira] [Commented] (PIG-3480) TFile-based tmpfile compression crashes in some cases

2013-09-30 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782112#comment-13782112 ] Dmitriy V. Ryaboy commented on PIG-3480: That is fine with me, lets make sequence fi

[jira] [Commented] (PIG-3445) Make Parquet format available out of the box in Pig

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776879#comment-13776879 ] Dmitriy V. Ryaboy commented on PIG-3445: Other loaders like csv, avro, json, xml, et

[jira] [Updated] (PIG-3479) Fix BigInt, BigDec, Date serialization. Improve perf of PigNullableWritable deserilization

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3479: --- Resolution: Fixed Release Note: Skewed join internals improved to get 10% or better impro

[jira] [Updated] (PIG-3479) Fix BigInt, BigDec, Date serialization. Improve perf of PigNullableWritable deserilization

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3479: --- Attachment: PIG-3479.whitespace.patch Same patch, but with whitespace changes. Committing this.

[jira] [Commented] (PIG-3480) TFile-based tmpfile compression crashes in some cases

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776728#comment-13776728 ] Dmitriy V. Ryaboy commented on PIG-3480: Rohini I suspect this might be something ab

[jira] [Commented] (PIG-3480) TFile-based tmpfile compression crashes in some cases

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776732#comment-13776732 ] Dmitriy V. Ryaboy commented on PIG-3480: Rohini, do you guys use lzo or gz compressi

[jira] [Commented] (PIG-3480) TFile-based tmpfile compression crashes in some cases

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1377#comment-1377 ] Dmitriy V. Ryaboy commented on PIG-3480: [~knoguchi] yeah, I'm not sure the stack tr

[jira] [Updated] (PIG-3480) TFile-based tmpfile compression crashes in some cases

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3480: --- Attachment: PIG-3480.patch Attaching a rough patch which replaces use of TFile with SequenceFil

[jira] [Comment Edited] (PIG-3480) TFile-based tmpfile compression crashes in some cases

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776602#comment-13776602 ] Dmitriy V. Ryaboy edited comment on PIG-3480 at 9/24/13 6:36 PM: -

[jira] [Commented] (PIG-3480) TFile-based tmpfile compression crashes in some cases

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776602#comment-13776602 ] Dmitriy V. Ryaboy commented on PIG-3480: For most of the tasks that fail, no stack t

[jira] [Created] (PIG-3480) TFile-based tmpfile compression crashes in some cases

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
Dmitriy V. Ryaboy created PIG-3480: -- Summary: TFile-based tmpfile compression crashes in some cases Key: PIG-3480 URL: https://issues.apache.org/jira/browse/PIG-3480 Project: Pig Issue Type:

[jira] [Updated] (PIG-3445) Make Parquet format available out of the box in Pig

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3445: --- Fix Version/s: 0.12 > Make Parquet format available out of the box in Pig > ---

[jira] [Commented] (PIG-3445) Make Parquet format available out of the box in Pig

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776172#comment-13776172 ] Dmitriy V. Ryaboy commented on PIG-3445: The size of the dependency introduced by th

[jira] [Updated] (PIG-3325) Adding a tuple to a bag is slow

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3325: --- Fix Version/s: 0.12 > Adding a tuple to a bag is slow > --- > >

[jira] [Updated] (PIG-3479) Fix BigInt, BigDec, Date serialization. Improve perf of PigNullableWritable deserilization

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3479: --- Fix Version/s: 0.12 > Fix BigInt, BigDec, Date serialization. Improve perf of PigNullableWr

[jira] [Updated] (PIG-3325) Adding a tuple to a bag is slow

2013-09-24 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3325: --- Affects Version/s: 0.12 > Adding a tuple to a bag is slow > ---

[jira] [Updated] (PIG-3479) Fix BigInt, BigDec, Date serialization. Improve perf of PigNullableWritable deserilization

2013-09-23 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3479: --- Status: Patch Available (was: Open) > Fix BigInt, BigDec, Date serialization. Improve perf

[jira] [Assigned] (PIG-3479) Fix BigInt, BigDec, Date serialization. Improve perf of PigNullableWritable deserilization

2013-09-23 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy reassigned PIG-3479: -- Assignee: Dmitriy V. Ryaboy > Fix BigInt, BigDec, Date serialization. Improve perf of

[jira] [Updated] (PIG-3479) Fix BigInt, BigDec, Date serialization. Improve perf of PigNullableWritable deserilization

2013-09-23 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3479: --- Attachment: PIG-3479.patch Attaching a patch. I extended an existing test to test the serialzi

[jira] [Created] (PIG-3479) Fix BigInt, BigDec, Date serialization. Improve perf of PigNullableWritable deserilization

2013-09-23 Thread Dmitriy V. Ryaboy (JIRA)
Dmitriy V. Ryaboy created PIG-3479: -- Summary: Fix BigInt, BigDec, Date serialization. Improve perf of PigNullableWritable deserilization Key: PIG-3479 URL: https://issues.apache.org/jira/browse/PIG-3479

[jira] [Commented] (PIG-2672) Optimize the use of DistributedCache

2013-09-20 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13773636#comment-13773636 ] Dmitriy V. Ryaboy commented on PIG-2672: Aniket, can we prefix the properties with "

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-09-16 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768649#comment-13768649 ] Dmitriy V. Ryaboy commented on PIG-3419: +1 to marking the interfaces as evolving.

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-09-13 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13767220#comment-13767220 ] Dmitriy V. Ryaboy commented on PIG-3419: This is not just for Tez. The point is to e

[jira] [Commented] (PIG-2965) RANDOM should allow seed initialization for ease of testing

2013-09-06 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13760313#comment-13760313 ] Dmitriy V. Ryaboy commented on PIG-2965: A UDF essentially has a constructor and an

[jira] [Commented] (PIG-2965) RANDOM should allow seed initialization for ease of testing

2013-09-05 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759609#comment-13759609 ] Dmitriy V. Ryaboy commented on PIG-2965: [~sdeneefe] are you sure you are using it r

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-29 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13754235#comment-13754235 ] Dmitriy V. Ryaboy commented on PIG-3419: [~billgraham] looping you in for Ambrose.

[jira] [Commented] (PIG-3048) Add mapreduce workflow information to job configuration

2013-08-29 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13753942#comment-13753942 ] Dmitriy V. Ryaboy commented on PIG-3048: no objections. after all, usage of the conf

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-29 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13753863#comment-13753863 ] Dmitriy V. Ryaboy commented on PIG-3419: Cheolsoo thanks so much for helping with th

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-23 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749190#comment-13749190 ] Dmitriy V. Ryaboy commented on PIG-3419: Olga, first commit to the spork branch is f

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-23 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749014#comment-13749014 ] Dmitriy V. Ryaboy commented on PIG-3419: Rohini, I want to reiterate that this patch

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-21 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747065#comment-13747065 ] Dmitriy V. Ryaboy commented on PIG-3419: I'd like this patch in trunk since it's not

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-13 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13738288#comment-13738288 ] Dmitriy V. Ryaboy commented on PIG-3419: oh 3 more things :) I thought you found you

[jira] [Commented] (PIG-3419) Pluggable Execution Engine

2013-08-13 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13738285#comment-13738285 ] Dmitriy V. Ryaboy commented on PIG-3419: Hi Achal, That's a large patch. Can you giv

[jira] [Commented] (PIG-3325) Adding a tuple to a bag is slow

2013-07-29 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13723065#comment-13723065 ] Dmitriy V. Ryaboy commented on PIG-3325: Urgh, you are right of course. I can move t

[jira] [Updated] (PIG-3325) Adding a tuple to a bag is slow

2013-07-26 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3325: --- Assignee: Dmitriy V. Ryaboy (was: Mark Wagner) Status: Patch Available (was: Open) mark

[jira] [Updated] (PIG-3325) Adding a tuple to a bag is slow

2013-06-29 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3325: --- Attachment: PIG-3325.3.patch Slight update -- resetting all counters on clear(), and getting ri

[jira] [Updated] (PIG-3325) Adding a tuple to a bag is slow

2013-06-29 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3325: --- Attachment: PIG-3325.2.patch Updating with a patch. Results: ||Num Tuples in Bag || Trunk avg

[jira] [Commented] (PIG-3325) Adding a tuple to a bag is slow

2013-06-29 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13696209#comment-13696209 ] Dmitriy V. Ryaboy commented on PIG-3325: Ok I started looking at this, will update w

[jira] [Commented] (PIG-3015) Rewrite of AvroStorage

2013-06-27 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13695279#comment-13695279 ] Dmitriy V. Ryaboy commented on PIG-3015: +1 if we find more stuff, we can open othe

[jira] [Commented] (PIG-3325) Adding a tuple to a bag is slow

2013-06-20 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13689465#comment-13689465 ] Dmitriy V. Ryaboy commented on PIG-3325: What if instead of figuring out size based

[jira] [Commented] (PIG-3325) Adding a tuple to a bag is slow

2013-06-19 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13688911#comment-13688911 ] Dmitriy V. Ryaboy commented on PIG-3325: [~mwagner] I was loading complex thrift str

[jira] [Commented] (PIG-3325) Adding a tuple to a bag is slow

2013-06-17 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13686100#comment-13686100 ] Dmitriy V. Ryaboy commented on PIG-3325: The previous behavior (having SMM check all

[jira] [Commented] (PIG-3325) Adding a tuple to a bag is slow

2013-06-10 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679862#comment-13679862 ] Dmitriy V. Ryaboy commented on PIG-3325: [~mwagner] thanks for catching this perf re

[jira] [Comment Edited] (PIG-3325) Adding a tuple to a bag is slow

2013-06-10 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679862#comment-13679862 ] Dmitriy V. Ryaboy edited comment on PIG-3325 at 6/10/13 8:23 PM: -

[jira] [Commented] (PIG-3341) Improving performance of loading datetime values

2013-06-03 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13673780#comment-13673780 ] Dmitriy V. Ryaboy commented on PIG-3341: I don't think we are completely consistent,

[jira] [Assigned] (PIG-3284) Document PIG-3198 and PIG-2643

2013-04-19 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy reassigned PIG-3284: -- Assignee: Jonathan Coveney :-) > Document PIG-3198 and PIG-2643 > --

[jira] [Commented] (PIG-3198) Let users use any function from PigType -> PigType as if it were builtlin

2013-04-19 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13636681#comment-13636681 ] Dmitriy V. Ryaboy commented on PIG-3198: Please add docs! > Let use

[jira] [Commented] (PIG-3267) HCatStorer fail in limit query

2013-04-11 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629603#comment-13629603 ] Dmitriy V. Ryaboy commented on PIG-3267: (+1) > HCatStorer fail in

[jira] [Commented] (PIG-3267) HCatStorer fail in limit query

2013-04-11 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13629601#comment-13629601 ] Dmitriy V. Ryaboy commented on PIG-3267: Should we apply this to 0.11 too?

[jira] [Updated] (PIG-3264) mvn signanddeploy target broken for pigunit, pigsmoke and piggybank

2013-04-04 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3264: --- Fix Version/s: 0.11.2 > mvn signanddeploy target broken for pigunit, pigsmoke and piggybank

[jira] [Commented] (PIG-2769) a simple logic causes very long compiling time on pig 0.10.0

2013-04-04 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13622756#comment-13622756 ] Dmitriy V. Ryaboy commented on PIG-2769: in 0.11 branch now. > a si

[jira] [Updated] (PIG-2769) a simple logic causes very long compiling time on pig 0.10.0

2013-04-04 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-2769: --- Fix Version/s: 0.11.2 > a simple logic causes very long compiling time on pig 0.10.0 >

[jira] [Resolved] (PIG-3151) No documentation for Pig 0.10.1

2013-04-04 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy resolved PIG-3151. Resolution: Won't Fix Release Note: we're past this now.. resolving so I can "release" t

[jira] [Commented] (PIG-2769) a simple logic causes very long compiling time on pig 0.10.0

2013-04-04 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13621897#comment-13621897 ] Dmitriy V. Ryaboy commented on PIG-2769: Didn't see earlier that this only went into

[jira] [Commented] (PIG-3222) New UDFContextSignature assignments in Pig 0.11 breaks HCatalog.HCatStorer

2013-03-28 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13616999#comment-13616999 ] Dmitriy V. Ryaboy commented on PIG-3222: This is pretty confusing. Any ideas on how

[jira] [Commented] (PIG-2586) A better plan/data flow visualizer

2013-03-22 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611490#comment-13611490 ] Dmitriy V. Ryaboy commented on PIG-2586: Hm I guess we can add logical plan if we wa

[jira] [Commented] (PIG-2586) A better plan/data flow visualizer

2013-03-22 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611478#comment-13611478 ] Dmitriy V. Ryaboy commented on PIG-2586: It does with the linked patch (it also visu

[jira] [Commented] (PIG-2586) A better plan/data flow visualizer

2013-03-22 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611472#comment-13611472 ] Dmitriy V. Ryaboy commented on PIG-2586: Do we need this given Ambrose (and from wha

[jira] [Commented] (PIG-3258) Patch to allow MultiStorage to use more than one index to generate output tree

2013-03-22 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13611467#comment-13611467 ] Dmitriy V. Ryaboy commented on PIG-3258: please generate patch against the project r

[jira] [Commented] (PIG-3254) Fail a failed Pig script quicker

2013-03-20 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13608070#comment-13608070 ] Dmitriy V. Ryaboy commented on PIG-3254: Can I add a request for whoever will work o

[jira] [Commented] (PIG-2388) Make shim for Hadoop 0.20 and 0.23 support dynamic

2013-03-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605849#comment-13605849 ] Dmitriy V. Ryaboy commented on PIG-2388: Hive does this, and back in the day there w

[jira] [Commented] (PIG-3208) [zebra] TFile should not set io.compression.codec.lzo.buffersize

2013-03-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13605765#comment-13605765 ] Dmitriy V. Ryaboy commented on PIG-3208: [~daijy] why wouldn't we commit fixes provi

[jira] [Commented] (PIG-3132) NPE when illustrating a relation with HCatLoader

2013-03-18 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13604929#comment-13604929 ] Dmitriy V. Ryaboy commented on PIG-3132: +1 > NPE when illustratin

[jira] [Updated] (PIG-3194) Changes to ObjectSerializer.java break compatibility with Hadoop 0.20.2

2013-03-15 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-3194: --- Resolution: Fixed Fix Version/s: 0.12 Status: Resolved (was: Patch Available)

  1   2   3   4   5   6   7   8   9   10   >