[jira] [Updated] (PIG-2909) Add a new option for ignoring corrupted files to AvroStorage load func

2012-09-12 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-2909: --- Attachment: PIG-2909-2.patch > Add a new option for ignoring corrupted files to AvroStorage load fu

[jira] [Commented] (PIG-2917) SpillableMemoryManager memory leak for WeakReference

2012-09-12 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454671#comment-13454671 ] Dmitriy V. Ryaboy commented on PIG-2917: Haitao, I am curious what your script is do

[jira] [Commented] (PIG-2900) Streaming should provide conf settings in the environment

2012-09-12 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454665#comment-13454665 ] Dmitriy V. Ryaboy commented on PIG-2900: Alan, I'll add the release notes. That's i

[jira] [Updated] (PIG-2918) Avoid Spillable bag overhead where possible

2012-09-12 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-2918: --- Attachment: PIG-2918.patch Attaching a quick pass over builtin functions. > Av

[jira] [Updated] (PIG-2918) Avoid Spillable bag overhead where possible

2012-09-12 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-2918: --- Status: Patch Available (was: Open) > Avoid Spillable bag overhead where possible > --

[jira] [Assigned] (PIG-2918) Avoid Spillable bag overhead where possible

2012-09-12 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy reassigned PIG-2918: -- Assignee: Dmitriy V. Ryaboy > Avoid Spillable bag overhead where possible > -

[jira] [Created] (PIG-2918) Avoid Spillable bag overhead where possible

2012-09-12 Thread Dmitriy V. Ryaboy (JIRA)
Dmitriy V. Ryaboy created PIG-2918: -- Summary: Avoid Spillable bag overhead where possible Key: PIG-2918 URL: https://issues.apache.org/jira/browse/PIG-2918 Project: Pig Issue Type: Bug

[jira] [Commented] (PIG-2909) Add a new option for ignoring corrupted files to AvroStorage load func

2012-09-12 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454653#comment-13454653 ] Cheolsoo Park commented on PIG-2909: Thank you very much sir! I agree with your suggesti

[jira] [Commented] (PIG-2909) Add a new option for ignoring corrupted files to AvroStorage load func

2012-09-12 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454641#comment-13454641 ] Alan Gates commented on PIG-2909: - A couple of small comments posted on review board. They'

[jira] [Commented] (PIG-2900) Streaming should provide conf settings in the environment

2012-09-12 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454636#comment-13454636 ] Alan Gates commented on PIG-2900: - In general it looks good. I had a couple of questions/co

[jira] [Commented] (PIG-2887) Macro cannot handle negative number

2012-09-12 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454632#comment-13454632 ] Alan Gates commented on PIG-2887: - Code looks good. I'll run the relevant tests and check i

Re: POCollectedGroup and LoadFunc indicator interface

2012-09-12 Thread Alan Gates
You are correct, this would be better named OrderedCollectableLoadFunc. I suspect the way this happened is that this is usually used on the output of MapReduce jobs. In that case (at least in MR1) the keys are sorted as well as guaranteed to be in a particular part file. Alan. On Sep 7, 20

[jira] [Updated] (PIG-2917) SpillableMemoryManager memory leak for WeakReference

2012-09-12 Thread Haitao Yao (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haitao Yao updated PIG-2917: Attachment: aa.jpg here's the screenshots of MemoryAnalyzer. > SpillableMemoryManager memor

[jira] [Updated] (PIG-2917) SpillableMemoryManager memory leak for WeakReference

2012-09-12 Thread Haitao Yao (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haitao Yao updated PIG-2917: Attachment: SpillableMemoryManager.patch here's the patch > SpillableMemoryManager memory l

[jira] [Created] (PIG-2917) SpillableMemoryManager memory leak for WeakReference

2012-09-12 Thread Haitao Yao (JIRA)
Haitao Yao created PIG-2917: --- Summary: SpillableMemoryManager memory leak for WeakReference Key: PIG-2917 URL: https://issues.apache.org/jira/browse/PIG-2917 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-2917) SpillableMemoryManager memory leak for WeakReference

2012-09-12 Thread Haitao Yao (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haitao Yao updated PIG-2917: Patch Info: Patch Available > SpillableMemoryManager memory leak for WeakReference >

[jira] [Commented] (PIG-2916) Add script file name for logging with log4j MDC

2012-09-12 Thread Haitao Yao (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454580#comment-13454580 ] Haitao Yao commented on PIG-2916: - But i think the MDC is better, because we may log more in

[jira] [Updated] (PIG-2778) Add 'matches' operator to predicate pushdown

2012-09-12 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-2778: --- Attachment: PIG-2778.patch Updating a patch that adds the 'matches' op to predicate pushdown. I added

[jira] [Updated] (PIG-2778) Add 'matches' operator to predicate pushdown

2012-09-12 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-2778: --- Assignee: Cheolsoo Park Status: Patch Available (was: Open) > Add 'matches' operator to pred

[jira] [Commented] (PIG-2914) Logs from MiniCluster are too verbose in tests

2012-09-12 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454438#comment-13454438 ] Rohini Palaniswamy commented on PIG-2914: - Looks like it uses the property {{log4jco

[jira] [Commented] (PIG-2914) Logs from MiniCluster are too verbose in tests

2012-09-12 Thread Julien Le Dem (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454343#comment-13454343 ] Julien Le Dem commented on PIG-2914: I started with a log4j.properties but then I realiz

[jira] [Updated] (PIG-259) allow store to overwrite existing directroy

2012-09-12 Thread Gianmarco De Francisci Morales (JIRA)
[ https://issues.apache.org/jira/browse/PIG-259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gianmarco De Francisci Morales updated PIG-259: --- Status: Open (was: Patch Available) Canceling because the patch is stal

[jira] [Commented] (PIG-2645) PigSplit does not handle the case where SerializationFactory returns null

2012-09-12 Thread Alex Levenson (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454183#comment-13454183 ] Alex Levenson commented on PIG-2645: The change should be something more like this: {cod

[jira] [Updated] (PIG-2898) Parallel execution of e2e tests

2012-09-12 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Klochkov updated PIG-2898: - Summary: Parallel execution of e2e tests (was: Multithreaded execution of e2e tests) changing the

[jira] [Updated] (PIG-2887) Macro cannot handle negative number

2012-09-12 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-2887: -- Status: Patch Available (was: Open) > Macro cannot handle negative number >

[jira] [Updated] (PIG-2915) Builtin TOP udf is sensitive to null input bags

2012-09-12 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-2915: --- Resolution: Fixed Fix Version/s: 0.11 Status: Resolved (was: Patch Available)

[jira] [Updated] (PIG-2898) Multithreaded execution of e2e tests

2012-09-12 Thread Ivan A. Veselovsky (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan A. Veselovsky updated PIG-2898: Attachment: PIG-2898-fix-sub-prototypes.patch "PIG-2898-fix-sub-prototypes.patch" (attached):

[jira] [Commented] (PIG-2645) PigSplit does not handle the case where SerializationFactory returns null

2012-09-12 Thread Shami B (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454022#comment-13454022 ] Shami B commented on PIG-2645: -- The code change required at line 254 is : if (s != null) {

[jira] [Commented] (PIG-2645) PigSplit does not handle the case where SerializationFactory returns null

2012-09-12 Thread Shami B (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454011#comment-13454011 ] Shami B commented on PIG-2645: -- We can add a NULL check before the line s.open((OutputStream)

[jira] Subscription: PIG patch available

2012-09-12 Thread jira
Issue Subscription Filter: PIG patch available (40 issues) Subscriber: pigdaily Key Summary PIG-2915Builtin TOP udf is sensitive to null input bags https://issues.apache.org/jira/browse/PIG-2915 PIG-2909Add a new option for ignoring corrupted files to AvroStora

Re: Review Request: RANK function like in SQL

2012-09-12 Thread aavendan
> On Sept. 12, 2012, 10:23 a.m., Gianmarco De Francisci Morales wrote: > > http://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceOper.java, > > line 517 > >

[jira] [Updated] (PIG-2898) Multithreaded execution of e2e tests

2012-09-12 Thread Ilya Katsov (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Katsov updated PIG-2898: - Labels: test (was: ) Affects Version/s: 0.10.0 Status: Patch Available (was:

Re: Review Request: RANK function like in SQL

2012-09-12 Thread Gianmarco De Francisci Morales
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5523/#review11396 --- http://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/backend

Build failed in Jenkins: Pig-trunk #1315

2012-09-12 Thread Apache Jenkins Server
See Changes: [dvryaboy] PIG-2915: Builtin TOP udf is sensitive to null input bags [julien] PIG-2844: ant makepom is misconfigured (julien) -- [...truncated 6519 lines...] [findbugs] com.google.comm

[jira] [Updated] (PIG-2353) RANK function like in SQL

2012-09-12 Thread JIRA
[ https://issues.apache.org/jira/browse/PIG-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan AvendaƱo updated PIG-2353: Attachment: PIG-2353-5.txt New approach to set counter into the MapReduce Job with PORank operator, o

[jira] [Updated] (PIG-2898) Multithreaded execution of e2e tests

2012-09-12 Thread Ivan A. Veselovsky (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan A. Veselovsky updated PIG-2898: Attachment: (was: xmlReport-fixed-duration.pl) > Multithreaded execution of e2e tests

Review Request: PIG-2898: allow to run pig e2e tests in parallel mode.

2012-09-12 Thread Ivan Veselovsky
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/7053/ --- Review request for pig and Rohini Palaniswamy. Description --- Please see h