[jira] [Commented] (PIG-4621) Enable Illustrate in spark

2017-09-01 Thread Adam Szita (JIRA)
load a patch with these fixes? > Enable Illustrate in spark > -- > > Key: PIG-4621 > URL: https://issues.apache.org/jira/browse/PIG-4621 > Project: Pig > Issue Type: Sub-task > Comp

[jira] [Commented] (PIG-4621) Enable Illustrate in spark

2017-08-30 Thread Adam Szita (JIRA)
ooks good, I'm currently running unit tests across all execution modes for verification. I believe we could create a subjira to this one to add the missing features like union, as it doesn't look trivial at all. I'll update once the test results are back. > Enab

[jira] [Comment Edited] (PIG-4621) Enable Illustrate in spark

2017-08-25 Thread Jakov Rabinovits (JIRA)
5 AM: - Uploaded a patch. Knows issues: This patch is mostly done for executing commands in Grunt and calling illustrate on an alias. Some of the tests don't produce the desired output because if there are multiple store commands they may invoke the illustrate markup for the same operator

[jira] [Updated] (PIG-4621) Enable Illustrate in spark

2017-08-25 Thread Jakov Rabinovits (JIRA)
Grunt and calling illustrate on an alias. Some of the tests don't produce the desired output because if there are multiple store commands they may invoke the illustrate markup for the same operator multiple times, in turn that operator will have duplicated data in it's illustrator ob

[jira] [Updated] (PIG-4621) Enable Illustrate in spark

2017-08-25 Thread Jakov Rabinovits (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakov Rabinovits updated PIG-4621: -- Attachment: (was: PIG-4621.patch) > Enable Illustrate in sp

[jira] [Updated] (PIG-4621) Enable Illustrate in spark

2017-08-25 Thread Jakov Rabinovits (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakov Rabinovits updated PIG-4621: -- Attachment: PIG-4621.patch > Enable Illustrate in sp

[jira] [Updated] (PIG-3993) Implement illustrate in Tez

2017-08-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3993: Labels: MissingFeature (was: ) > Implement illustrate in

[jira] [Updated] (PIG-4621) Enable Illustrate in spark

2017-08-21 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4621: Labels: MissingFeature (was: ) > Enable Illustrate in sp

[jira] [Assigned] (PIG-4621) Enable Illustrate in spark

2017-07-19 Thread Jakov Rabinovits (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakov Rabinovits reassigned PIG-4621: - Assignee: Jakov Rabinovits (was: Adam Szita) > Enable Illustrate in sp

[jira] [Assigned] (PIG-4621) Enable Illustrate in spark

2017-06-01 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita reassigned PIG-4621: --- Assignee: Adam Szita (was: Prateek Vaishnav) > Enable Illustrate in sp

[jira] [Updated] (PIG-3993) Implement illustrate in Tez

2017-05-26 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3993: Fix Version/s: (was: 0.17.0) 0.18.0 > Implement illustrate in

[jira] [Resolved] (PIG-5204) Implement illustrate in Spark

2017-05-24 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita resolved PIG-5204. - Resolution: Duplicate > Implement illustrate in Sp

[jira] [Assigned] (PIG-5204) Implement illustrate in Spark

2017-05-24 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita reassigned PIG-5204: --- Assignee: (was: Adam Szita) > Implement illustrate in Sp

[jira] [Commented] (PIG-4621) Enable Illustrate in spark

2017-05-24 Thread Adam Szita (JIRA)
~kellyzly] shall I reassign to myself? > Enable Illustrate in spark > -- > > Key: PIG-4621 > URL: https://issues.apache.org/jira/browse/PIG-4621 > Project: Pig > Issue Type: Sub-task > Compon

[jira] [Assigned] (PIG-5204) Implement illustrate in Spark

2017-05-04 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita reassigned PIG-5204: --- Assignee: Adam Szita > Implement illustrate in Sp

[jira] [Updated] (PIG-5204) Implement illustrate in Spark

2017-03-29 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5204: --- Priority: Minor (was: Major) > Implement illustrate in Sp

[jira] [Created] (PIG-5204) Implement illustrate in Spark

2017-03-29 Thread Nandor Kollar (JIRA)
Nandor Kollar created PIG-5204: -- Summary: Implement illustrate in Spark Key: PIG-5204 URL: https://issues.apache.org/jira/browse/PIG-5204 Project: Pig Issue Type: Improvement

[jira] [Assigned] (PIG-3993) Implement illustrate in Tez

2017-01-26 Thread Satish Subhashrao Saley (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Subhashrao Saley reassigned PIG-3993: Assignee: Satish Subhashrao Saley > Implement illustrate in

[jira] [Updated] (PIG-3993) Implement illustrate in Tez

2016-04-25 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-3993: Fix Version/s: (was: 0.16.0) 0.17.0 > Implement illustrate in

[jira] [Commented] (PIG-4621) Enable Illustrate in spark

2016-02-25 Thread prateek vaishnav (JIRA)
r is only used in ExampleGenerator, risk is fairly low. Any thoughts or concerns are welcome. > Enable Illustrate in spark > -- > > Key: PIG-4621 > URL: https://issues.apache.org/jira/browse/PIG-4621 > Project

[jira] [Assigned] (PIG-4621) Enable Illustrate in spark

2016-02-24 Thread prateek vaishnav (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] prateek vaishnav reassigned PIG-4621: - Assignee: prateek vaishnav (was: Syed Zulfiqar Ali) > Enable Illustrate in sp

[jira] [Commented] (PIG-4621) Enable Illustrate in spark

2015-12-08 Thread liyunzhang_intel (JIRA)
efuz]: The patch modified the code in JobControlCompiler.java. I don't know whether this change can be accepted by the community. Let's use an example to show why script with illustrate fails in spark mode: {code} visits = LOAD './visits' AS (user:chararray, ulr:chararr

[jira] [Commented] (PIG-4621) Enable Illustrate in spark

2015-12-03 Thread Mohit Sabharwal (JIRA)
cc [~kellyzly] > Enable Illustrate in spark > -- > > Key: PIG-4621 > URL: https://issues.apache.org/jira/browse/PIG-4621 > Project: Pig > Issue Type: Sub-task > Components: spark >

Re: Review Request 40692: PIG-4621: Enable Illustrate in spark

2015-12-03 Thread Mohit Sabharwal
Spark specific changes here. What is the point of adding addSettingsToConf() to base class if we are not implementing it in this patch ? Does Tez ILLUSTRATE work ? src/org/apache/pig/tools/pigstats/mapreduce/MRScriptState.java (line 70) <https://reviews.apache.org/r/40692/#comment168396>

[jira] [Commented] (PIG-4621) Enable Illustrate in spark

2015-11-25 Thread Syed Zulfiqar Ali (JIRA)
Enable Illustrate in spark > -- > > Key: PIG-4621 > URL: https://issues.apache.org/jira/browse/PIG-4621 > Project: Pig > Issue Type: Sub-task > Components: spark >

[jira] [Commented] (PIG-4621) Enable Illustrate in spark

2015-11-24 Thread Syed Zulfiqar Ali (JIRA)
ttps://reviews.apache.org/r/40692/ > Enable Illustrate in spark > -- > > Key: PIG-4621 > URL: https://issues.apache.org/jira/browse/PIG-4621 > Project: Pig > Issue Type: Sub-task > Components:

Review Request 40692: PIG-4621: Enable Illustrate in spark

2015-11-24 Thread Zulfi
: Enable Illustrate in spark Diffs - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java 88e3d5b src/org/apache/pig/tools/pigstats/ScriptState.java bf17490 src/org/apache/pig/tools/pigstats/mapreduce/MRScriptState.java 1aca7d8 src/org/apache/pig

[jira] [Work started] (PIG-4621) Enable Illustrate in spark

2015-11-11 Thread Syed Zulfiqar Ali (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on PIG-4621 started by Syed Zulfiqar Ali. -- > Enable Illustrate in sp

[jira] [Updated] (PIG-4621) Enable Illustrate in spark

2015-10-30 Thread Syed Zulfiqar Ali (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Syed Zulfiqar Ali updated PIG-4621: --- Assignee: Syed Zulfiqar Ali > Enable Illustrate in sp

[jira] [Created] (PIG-4621) Enable Illustrate in spark

2015-07-05 Thread liyunzhang_intel (JIRA)
liyunzhang_intel created PIG-4621: - Summary: Enable Illustrate in spark Key: PIG-4621 URL: https://issues.apache.org/jira/browse/PIG-4621 Project: Pig Issue Type: Sub-task

[jira] [Updated] (PIG-3993) Implement illustrate in Tez

2015-04-28 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3993: Fix Version/s: (was: 0.15.0) 0.16.0 > Implement illustrate in

[jira] [Updated] (PIG-3993) Implement illustrate in Tez

2015-03-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3993: Issue Type: Improvement (was: Sub-task) Parent: (was: PIG-3446) > Implement illustrate in

[jira] [Updated] (PIG-3993) Implement illustrate in Tez

2014-10-01 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3993: Fix Version/s: (was: 0.14.0) 0.15.0 > Implement illustrate in

[jira] [Created] (PIG-3993) Implement illustrate in Tez

2014-06-08 Thread Rohini Palaniswamy (JIRA)
Rohini Palaniswamy created PIG-3993: --- Summary: Implement illustrate in Tez Key: PIG-3993 URL: https://issues.apache.org/jira/browse/PIG-3993 Project: Pig Issue Type: Sub-task

[jira] [Commented] (PIG-502) Limit and Illustrate do not work together

2014-04-02 Thread Nadav Weissman (JIRA)
d an illustrate of limit in a nested foreach statement gives a wrong presentation (doing dump to it - gave the correct results) example: b = group a by aid; c_min = foreach b{ o = order a by start_ts ASC; l = limit o 1; generate flatt

Re: Illustrate Refactoring and Pig 0.12

2013-09-16 Thread Jeremy Karn
While there are a lot of changes to Pig core code - most of those changes are made on code paths that only run in illustrate mode [inside of "if (illustrator != null)" checks]. I still understand not wanting to rush it out though. -- Jeremy Karn / Lead Developer MORTAR DATA / 51

[jira] [Resolved] (PIG-2351) Casting Exception in Illustrate for POForEach

2013-09-15 Thread Jeremy Karn (JIRA)
ion in Illustrate for POForEach > - > > Key: PIG-2351 > URL: https://issues.apache.org/jira/browse/PIG-2351 > Project: Pig > Issue Type: Bug >Affects Versions: 0.9.0, 0.10.0 >

Re: Illustrate Refactoring and Pig 0.12

2013-09-15 Thread major seitan
Cc On Sep 15, 2013 1:28 PM, "Jeremy Karn" wrote: > I've opened PIG-3460 which has a preliminary patch with all of the changes > we've made to illustrate over at Mortar. I still have a few things I need > to do this week to get the patch ready to be merged but I wa

Re: Illustrate Refactoring and Pig 0.12

2013-09-15 Thread Daniel Dai
Unlike StreamingUDF which is mostly independent, illustrate patch made quite a few changes to the Pig core code and definitely need sometime to review and stabilize. I don't want to rush it into 0.12.0, since it is coming very soon. Thanks, Daniel On Sun, Sep 15, 2013 at 12:33 PM, Ru

Re: Illustrate Refactoring and Pig 0.12

2013-09-15 Thread major seitan
On Sep 15, 2013 1:28 PM, "Jeremy Karn" wrote: >exec x 1 > I've opened PIG-3460 which has a preliminary patch with all of the changes > we've made to illustrate over at Mortar. I still have a few things I need > to do this week to get the patch ready to be merged b

Re: Illustrate Refactoring and Pig 0.12

2013-09-15 Thread Russell Jurney
This has been a long time coming. I'd like if it were in 0.12 Sent from my iPhone On Sep 15, 2013, at 10:28 AM, Jeremy Karn wrote: > I've opened PIG-3460 which has a preliminary patch with all of the changes > we've made to illustrate over at Mortar. I still have a few

[jira] [Commented] (PIG-3460) Illustrate Refactoring

2013-09-15 Thread Jeremy Karn (JIRA)
h: https://reviews.apache.org/r/14146/ > Illustrate Refactoring > -- > > Key: PIG-3460 > URL: https://issues.apache.org/jira/browse/PIG-3460 > Project: Pig > Issue Type: Improveme

Review Request 14146: Diff of PIG-3460, a large refactoring of the Pig illustrate code.

2013-09-15 Thread Jeremy Karn
-3460, a large refactoring of the Pig illustrate code. Diffs - src/org/apache/pig/PigServer.java 2306ff0 src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java 9341153 src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer

Illustrate Refactoring and Pig 0.12

2013-09-15 Thread Jeremy Karn
I've opened PIG-3460 which has a preliminary patch with all of the changes we've made to illustrate over at Mortar. I still have a few things I need to do this week to get the patch ready to be merged but I wanted to get the jira up for general feedback. Given that illustrate isn&

[jira] [Updated] (PIG-3460) Illustrate Refactoring

2013-09-15 Thread Jeremy Karn (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Karn updated PIG-3460: - Attachment: PIG-illustrate.patch > Illustrate Refactor

[jira] [Created] (PIG-3460) Illustrate Refactoring

2013-09-15 Thread Jeremy Karn (JIRA)
Jeremy Karn created PIG-3460: Summary: Illustrate Refactoring Key: PIG-3460 URL: https://issues.apache.org/jira/browse/PIG-3460 Project: Pig Issue Type: Improvement Affects Versions: 0.12

[jira] [Commented] (PIG-3460) Illustrate Refactoring

2013-09-15 Thread Jeremy Karn (JIRA)
t its not ready to be merged. I still need to do some testing with this patch, fix a few findbugs/java warnings, and remove the synthetic/omittable changes to the Tuple interface. > Illustrate Refactoring > -- > > Key: PIG-3460 >

[jira] [Commented] (PIG-2527) ILLUSTRATE fails for relations LOADed with the AvroStorage UDF

2013-03-18 Thread Daniel Dai (JIRA)
the issue. I did a trivial illustrate and it works. If you have a script which fail, can you open a new ticket and provide more details? > ILLUSTRATE fails for relations LOADed with the Avr

[jira] [Commented] (PIG-2527) ILLUSTRATE fails for relations LOADed with the AvroStorage UDF

2013-02-27 Thread Rohini Palaniswamy (JIRA)
jira incorporates this fix? I don't see any patch attached to this jira. One of our users encountered a similar stacktrace with illustrate and PigStorage. > ILLUSTRATE fails for relations LOADed with the Avr

[jira] [Updated] (PIG-2527) ILLUSTRATE fails for relations LOADed with the AvroStorage UDF

2012-12-19 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2527: Fix Version/s: 0.10.1 > ILLUSTRATE fails for relations LOADed with the AvroStorage

[jira] [Resolved] (PIG-2527) ILLUSTRATE fails for relations LOADed with the AvroStorage UDF

2012-12-19 Thread Daniel Dai (JIRA)
. > ILLUSTRATE fails for relations LOADed with the AvroStorage UDF > -- > > Key: PIG-2527 > URL: https://issues.apache.org/jira/browse/PIG-2527 > Project: Pig >

[jira] [Updated] (PIG-2527) ILLUSTRATE fails for relations LOADed with the AvroStorage UDF

2012-12-19 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2527: Fix Version/s: (was: 0.10.1) > ILLUSTRATE fails for relations LOADed with the AvroStorage

[jira] [Updated] (PIG-2989) Illustrate for Rank Operator

2012-11-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-2989: --- Fix Version/s: 0.12 > Illustrate for Rank Opera

[jira] [Resolved] (PIG-2989) Illustrate for Rank Operator

2012-11-18 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-2989. Resolution: Fixed > Illustrate for Rank Opera

[jira] [Commented] (PIG-2989) Illustrate for Rank Operator

2012-11-13 Thread Alan Gates (JIRA)
lied the patch. See http://svn.apache.org/viewvc?view=revision&revision=1408827 for a record of what was committed. > Illustrate for Rank Operator > > > Key: PIG-2989 > URL: https://issue

[jira] [Commented] (PIG-2989) Illustrate for Rank Operator

2012-11-13 Thread Gianmarco De Francisci Morales (JIRA)
ied) patch detected! Assume -R? [n] n Apply anyway? [n] y Hunk #1 FAILED at 156. 1 out of 1 hunk FAILED -- saving rejects to file src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PORank.java.rej {code} > Illustrate for

[jira] [Commented] (PIG-2989) Illustrate for Rank Operator

2012-11-13 Thread JIRA
[ https://issues.apache.org/jira/browse/PIG-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496322#comment-13496322 ] Allan Avendaño commented on PIG-2989: - Thanks to you! > Illustr

[jira] [Commented] (PIG-2989) Illustrate for Rank Operator

2012-11-13 Thread Alan Gates (JIRA)
llan. > Illustrate for Rank Operator > > > Key: PIG-2989 > URL: https://issues.apache.org/jira/browse/PIG-2989 > Project: Pig > Issue Type: Bug > Components: build >Affects Versi

[jira] [Commented] (PIG-2989) Illustrate for Rank Operator

2012-11-06 Thread JIRA
g it! > Illustrate for Rank Operator > > > Key: PIG-2989 > URL: https://issues.apache.org/jira/browse/PIG-2989 > Project: Pig > Issue Type: Bug > Components: build >Affects Versi

[jira] [Commented] (PIG-2989) Illustrate for Rank Operator

2012-11-06 Thread Alan Gates (JIRA)
l run the e2e tests and commit if all is well. > Illustrate for Rank Operator > > > Key: PIG-2989 > URL: https://issues.apache.org/jira/browse/PIG-2989 > Project: Pig > Issue T

[jira] [Updated] (PIG-2989) Illustrate for Rank Operator

2012-10-22 Thread JIRA
[ https://issues.apache.org/jira/browse/PIG-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Avendaño updated PIG-2989: Priority: Minor (was: Major) > Illustrate for Rank Opera

[jira] [Updated] (PIG-2989) Illustrate for Rank Operator

2012-10-18 Thread JIRA
rator use. (was: A small update for rank operator, specifically the implementation of illustrate command.) > Illustrate for Rank Operator > > > Key: PIG-2989 > URL: https://issues.apache.org/jira/browse/PIG-2989 >

[jira] [Updated] (PIG-2989) Illustrate for Rank Operator

2012-10-18 Thread JIRA
[ https://issues.apache.org/jira/browse/PIG-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Avendaño updated PIG-2989: Issue Type: Bug (was: Improvement) > Illustrate for Rank Opera

[jira] [Updated] (PIG-2989) Illustrate for Rank Operator

2012-10-18 Thread JIRA
[ https://issues.apache.org/jira/browse/PIG-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Avendaño updated PIG-2989: Priority: Major (was: Minor) > Illustrate for Rank Opera

[jira] [Updated] (PIG-2989) Illustrate for Rank Operator

2012-10-17 Thread JIRA
[ https://issues.apache.org/jira/browse/PIG-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Avendaño updated PIG-2989: Attachment: patch_1 All junit and e2e tests passed. > Illustrate for Rank Opera

[jira] [Created] (PIG-2989) Illustrate for Rank Operator

2012-10-17 Thread JIRA
Allan Avendaño created PIG-2989: --- Summary: Illustrate for Rank Operator Key: PIG-2989 URL: https://issues.apache.org/jira/browse/PIG-2989 Project: Pig Issue Type: Improvement

[jira] [Commented] (PIG-2963) Illustrate command and POPackageLite

2012-10-16 Thread JIRA
for committing it! > Illustrate command and POPackageLite > > > Key: PIG-2963 > URL: https://issues.apache.org/jira/browse/PIG-2963 > Project: Pig > Issue Type: Bug >

Re: [jira] [Commented] (PIG-2963) Illustrate command and POPackageLite

2012-10-15 Thread Alan Gates
-- >> >> Allan: it comes down to pestering a committer to reviewing and committing, >> or just hoping they look at it. >> >> Which I just did. Thanks for the fix, Cheolsoo. It's in! >> >>> Illustrate command and POPackageLite >>> --

Re: [jira] [Commented] (PIG-2963) Illustrate command and POPackageLite

2012-10-15 Thread Curtis Strite
ment-13476372] > > Jonathan Coveney commented on PIG-2963: > --- > > Allan: it comes down to pestering a committer to reviewing and committing, > or just hoping they look at it. > > Which I just did. Thanks for the fix, Cheolsoo.

[jira] [Commented] (PIG-2963) Illustrate command and POPackageLite

2012-10-15 Thread Jonathan Coveney (JIRA)
ng a committer to reviewing and committing, or just hoping they look at it. Which I just did. Thanks for the fix, Cheolsoo. It's in! > Illustrate command and POPackageLite > > > Key: PIG-2963 > URL: h

[jira] [Updated] (PIG-2963) Illustrate command and POPackageLite

2012-10-15 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2963: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Illustrate command

[jira] [Commented] (PIG-2963) Illustrate command and POPackageLite

2012-10-15 Thread JIRA
Now, I'm wondering which is the process to include it into the trunk. Thanks again! > Illustrate command and POPackageLite > > > Key: PIG-2963 > URL: https://issues.apache.org/jira/browse/PIG-29

[jira] [Updated] (PIG-2963) Illustrate command and POPackageLite

2012-10-10 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated PIG-2963: --- Assignee: Cheolsoo Park Status: Patch Available (was: Open) > Illustrate command

[jira] [Updated] (PIG-2963) Illustrate command and POPackageLite

2012-10-10 Thread Cheolsoo Park (JIRA)
reverting it. What's happening is that illustrate adds to DefautAbstractBag a tuple that has a ReadOnceBag field. The problem is that PIG-2923 made DefautAbstractBag check whether or not it should spill to disk every time a new element is added to it. To compute the memory size of th

[jira] [Created] (PIG-2963) Illustrate command and POPackageLite

2012-10-10 Thread JIRA
Allan Avendaño created PIG-2963: --- Summary: Illustrate command and POPackageLite Key: PIG-2963 URL: https://issues.apache.org/jira/browse/PIG-2963 Project: Pig Issue Type: Bug

Re: illustrate

2012-08-12 Thread Gianmarco De Francisci Morales
t; > > > --- > > > > | | 1 | 6 | g | > > > > --- > > > > > > > > grunt> cat file.

Re: illustrate

2012-08-10 Thread Dmitriy Ryaboy
| id:int| value:chararray| > > --- > > | | 1 | 6 | g | > > --- > > > > grunt> cat file.txt > > 1 a > > 2 b > > 3 c > > 3 d > > 4 e >

Re: illustrate

2012-08-09 Thread Gianmarco De Francisci Morales
| g | --- grunt> cat file.txt 1 a 2 b 3 c 3 d 4 e 6 f 6 g 8 h grunt> a = load 'file.txt' as (id:int, value:chararray); grunt> b = rank a; grunt> illustrate b Hope it helps. Cheers, -- Gianmarco On Tu

Re: illustrate

2012-08-07 Thread Allan
ptions, I got a way to illustrate the rank operator, but I have some problems: 1.- I guess that due to the illustrator algorithm, resulting tuples after POCounter produces numbers high counters values two or three times than expected, for example: (0,38,1,n,5) (0,39,8,a,0) (0,40,0,b,9) 2.- Until now

Re: illustrate

2012-08-04 Thread Allan
command). It was quite easy to incorporate the illustrator command on it. * The second implementation is a chain of physical operators, and at the end are the POCounter, PORank and a POForEach. And I have some problems on illustrate it. This is what I got, while trying to illustrate here

Re: illustrate

2012-08-04 Thread Gianmarco De Francisci Morales
the illustrator code, so I am unable to answer his questions right now. Is there any up-to-date documentation on it? Or anybody already familiar with it willing to give a hand? Cheers, -- Gianmarco On Fri, Aug 3, 2012 at 11:30 PM, Thejas Nair wrote: > Yes, illustrate is still support

Re: illustrate

2012-08-03 Thread Thejas Nair
Yes, illustrate is still supported. We made lot of improvements in 0.9 in getting it working under more conditions. Can you forward Allan's question to the list ? Thanks, Thejas On 8/2/12 6:52 AM, Gianmarco De Francisci Morales wrote: Hi, The GSoC project that Allan is working on and

illustrate

2012-08-03 Thread Gianmarco De Francisci Morales
Hi, The GSoC project that Allan is working on and that I am mentoring is at the point where we are starting to refine things. One question Allan asked was about the illustrate command: Are we still supporting it? If so, is there anybody with experience that could give some suggestions on how to

[jira] [Updated] (PIG-2527) ILLUSTRATE fails for relations LOADed with the AvroStorage UDF

2012-07-23 Thread Russell Jurney (JIRA)
t go in 0.10.0? > ILLUSTRATE fails for relations LOADed with the AvroStorage UDF > -- > > Key: PIG-2527 > URL: https://issues.apache.org/jira/browse/PIG-2527 > Projec

[jira] [Reopened] (PIG-2527) ILLUSTRATE fails for relations LOADed with the AvroStorage UDF

2012-07-23 Thread Russell Jurney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney reopened PIG-2527: - Assignee: Jonathan Coveney The fix for AvroStorage that fixed ILLUSTRATE didn't go in Pig 0

Re: Are there any explanations of the implementation of illustrate?

2012-07-06 Thread Jonathan Coveney
Doug, Would definitely love for you guys to merge in your updates. Thejas, Thanks for providing more information. Good to know where to look. Between the paper and some info on where to look, I have some solid leads! Jon 2012/7/5 Thejas Nair > Earlier implementation of illustrate used

Re: Are there any explanations of the implementation of illustrate?

2012-07-05 Thread Thejas Nair
Earlier implementation of illustrate used the pig local mode execution engine (which corresponds to the time when paper was published) . As part of illustrate reword in PIG-1712, Yan replaced the default Map and Reduce context objects with a IllustratorContext. Look for IllustratorContext and

RE: Are there any explanations of the implementation of illustrate?

2012-07-05 Thread Doug Daniels
Hey Jonathan, We've done a bunch of updates to illustrate on a private 0.9 branch that we're looking to merge in as soon as we can, including making it much more testable and making far more of the pig operators work again. One thing to note on the algorithm is that the upst

Re: Are there any explanations of the implementation of illustrate?

2012-07-03 Thread Jonathan Coveney
are needed for illustrate, otherwise it can be > easily broken without notice. > > Jie > > On Tue, Jul 3, 2012 at 12:45 PM, Jon Coveney wrote: > > I was curious at a level slightly higher than "dig through the code" how > illustrate is so fast, and how it deals with joins ef

Re: Are there any explanations of the implementation of illustrate?

2012-07-03 Thread Jie Li
Some document here: http://wiki.apache.org/pig/PigIllustrate I agree that more tests are needed for illustrate, otherwise it can be easily broken without notice. Jie On Tue, Jul 3, 2012 at 12:45 PM, Jon Coveney wrote: > I was curious at a level slightly higher than "dig through the c

Are there any explanations of the implementation of illustrate?

2012-07-03 Thread Jon Coveney
I was curious at a level slightly higher than "dig through the code" how illustrate is so fast, and how it deals with joins effectively. Are there any resources on this (or does anyone at Hortonworks want to write a tech oriented blog post? :)

[jira] [Commented] (PIG-2478) Using Illustrate with Javascript UDF throws NEP

2012-06-20 Thread Julien Le Dem (JIRA)
t in that case. i.e.: Pig does not seem to call outputSchema in that case. > Using Illustrate with Javascript UDF throws NEP > --- > > Key: PIG-2478 > URL: https://issues.apache.org/j

Using ILLUSTRATE with mock.storage

2012-05-22 Thread Prasanth J
Hello all I am writing a testcase for illustrate (pigServer.getExamples()) using mock.storage. But I am getting IOException with message "No (valid) input data found". Does debugging operators work with mock.storage? Thanks -- Prasanth

[jira] [Resolved] (PIG-2527) ILLUSTRATE fails for relations LOADed with the AvroStorage UDF

2012-05-17 Thread Russell Jurney (JIRA)
! > ILLUSTRATE fails for relations LOADed with the AvroStorage UDF > -- > > Key: PIG-2527 > URL: https://issues.apache.org/jira/browse/PIG-2527 > Project: Pig >

[jira] [Commented] (PIG-2527) ILLUSTRATE fails for relations LOADed with the AvroStorage UDF

2012-02-29 Thread Russell Jurney (Commented) (JIRA)
es anyone remember how to do this? > ILLUSTRATE fails for relations LOADed with the AvroStorage UDF > -- > > Key: PIG-2527 > URL: https://issues.apache.org/jira/browse/PIG-2527 &g

[jira] [Created] (PIG-2527) ILLUSTRATE fails for relations LOADed with the AvroStorage UDF

2012-02-10 Thread Russell Jurney (Created) (JIRA)
ILLUSTRATE fails for relations LOADed with the AvroStorage UDF -- Key: PIG-2527 URL: https://issues.apache.org/jira/browse/PIG-2527 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-2481) Illustrate throws NullPointerException when custom load function uses counters

2012-01-18 Thread Matt Martin (Updated) (JIRA)
extra "REGISTER ..." statements which I had added in order to test the script with Pig 0.8.1. > Illustrate throws NullPointerException when custom load function uses counters > -- > &g

[jira] [Updated] (PIG-2481) Illustrate throws NullPointerException when custom load function uses counters

2012-01-18 Thread Matt Martin (Updated) (JIRA)
/13dda2a1de31844fe07bcf4a58e94fffcb9aa374)) > Illustrate throws NullPointerException when custom load function uses counters > -- > > Key: PIG-2481 > URL: https://issues.apache.org/jira/

[jira] [Updated] (PIG-2481) Illustrate throws NullPointerException when custom load function uses counters

2012-01-18 Thread Matt Martin (Updated) (JIRA)
One can use these files and the following command to recreate the bug: pig -x local -p INPUT=/Users/hadoop/illustrate_bug.txt /Users/hadoop/illustrate_bug.pig > Illustrate throws NullPointerException when custom load function uses count

[jira] [Created] (PIG-2481) Illustrate throws NullPointerException when custom load function uses counters

2012-01-18 Thread Matt Martin (Created) (JIRA)
Illustrate throws NullPointerException when custom load function uses counters -- Key: PIG-2481 URL: https://issues.apache.org/jira/browse/PIG-2481 Project: Pig

  1   2   >