[jira] [Commented] (PIG-2610) GC errors on using FILTER within nested FOREACH

2012-04-05 Thread Prashant Kommireddi (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248136#comment-13248136 ] Prashant Kommireddi commented on PIG-2610: -- How is this case different (from Pig La

Is there any reason why the private instance methods of BinInterSedes shouldn't be made protected static?

2012-04-05 Thread Jonathan Coveney
The vast majority don't use any state, and could be potentially useful to other classes that want to do serialization. I guess the other way to take it is that the logic of those classes should be put into BinInterSedes, but this isn't always reasonable or desirable. Thoughts? Any pitfalls I am m

[jira] [Commented] (PIG-2632) Create a SchemaTuple which generates efficient Tuples via code gen

2012-04-05 Thread jirapos...@reviews.apache.org (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248133#comment-13248133 ] jirapos...@reviews.apache.org commented on PIG-2632: bq. On 2012-04-0

[jira] [Commented] (PIG-2632) Create a SchemaTuple which generates efficient Tuples via code gen

2012-04-05 Thread jirapos...@reviews.apache.org (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13247999#comment-13247999 ] jirapos...@reviews.apache.org commented on PIG-2632: --

[jira] [Commented] (PIG-2397) Running TPC-H on Pig

2012-04-05 Thread alex gemini (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13247957#comment-13247957 ] alex gemini commented on PIG-2397: -- 600 map tasks: 2334 sec and 200 map tasks: 2157 sec,I g

Re: [gsoc2012] plan/data flow visualizer web interface - PIG-2586

2012-04-05 Thread Daniel Dai
Seems they changed the rule this year. Last year non-committer can mentor. I can be the backup if no one else want to mentor this. Daniel On Thu, Apr 5, 2012 at 5:13 PM, Russell Jurney wrote: > Ah, ok. I've been noodling on the problem and don't know Pig internals well > enough to figure out a c

Re: [gsoc2012] plan/data flow visualizer web interface - PIG-2586

2012-04-05 Thread Russell Jurney
Ah, ok. I've been noodling on the problem and don't know Pig internals well enough to figure out a clean way to get at the data that is needed for this task. Someone familiar with HCatalog and how y'all are handling accessing Pig ILLUSTRATE data there would be a more appropriate mentor. On Thu, Ap

Re: [gsoc2012] plan/data flow visualizer web interface - PIG-2586

2012-04-05 Thread Dmitriy Ryaboy
Do we have a committer who's signed up to mentor this issue? Russ can't according to apache's guidelines for gsoc (though he can certainly help advise / review code / etc -- just not be an official apache foundation rep to google regarding progress of the project) D On Thu, Apr 5, 2012 at 5:01 PM

Re: [gsoc2012] plan/data flow visualizer web interface - PIG-2586

2012-04-05 Thread Daniel Dai
Hi, Russell, You need to 1. send request to code-awa...@apache.org and priv...@pig.apache.org to become a mentor 2. create account at http://www.google-melange.com/gsoc/homepage/google/gsoc2012 3. apply mentor to Apache in google-melange 4. let me know your google-melange so I can update Melange id

Re: Welcome Pig's newest committer, Bill Graham!

2012-04-05 Thread Jonathan Coveney
Awesome! Well deserved. I'm excited at the energy on the project these days. Let's keep up that momentum! 2012/4/5 Aniket Mokashi > Congrats Bill... > > On Thu, Apr 5, 2012 at 3:04 PM, Prashant Kommireddi >wrote: > > > Congrats Bill. > > > > Sent from my iPhone > > > > On Apr 5, 2012, at 2:55 P

Re: [gsoc2012] plan/data flow visualizer web interface - PIG-2586

2012-04-05 Thread manu [ranga]
hi russell, I have submitted a proposal at melange. I am aware that the pig team has been very busy recently. Hope you’ll be able to provide some feedback soon. Thanks -- by,             Manu (R Chathura Manuranga Perera)

Build failed in Jenkins: Pig-trunk #1222

2012-04-05 Thread Apache Jenkins Server
See Changes: [daijy] PIG-2601: Additional document for 0.10 -- [...truncated 56240 lines...] [junit] javax.management.InstanceNotFoundException: Hadoop:service=DataNode,name=FSDatasetState-Undefin

Re: Schema mismatch for files with changing avro schemas

2012-04-05 Thread Bill Graham
No AvroStorage doesn't currently support projection push-down. Looking at the Avro integration code though, this seems feasible. On Thu, Apr 5, 2012 at 11:27 AM, Jonathan Coveney wrote: > For the Avro people, does AvroStorage support column pruning? > > 2012/4/5 Stan Rosenberg > > > AFAIK, by de

Re: Welcome Pig's newest committer, Bill Graham!

2012-04-05 Thread Aniket Mokashi
Congrats Bill... On Thu, Apr 5, 2012 at 3:04 PM, Prashant Kommireddi wrote: > Congrats Bill. > > Sent from my iPhone > > On Apr 5, 2012, at 2:55 PM, Dmitriy Ryaboy wrote: > > > Hi all, > > On behalf of the Pig PMC, I'm very happy to announce that Bill Graham > > has been invited to become a Pig

Re: Welcome Pig's newest committer, Bill Graham!

2012-04-05 Thread Prashant Kommireddi
Congrats Bill. Sent from my iPhone On Apr 5, 2012, at 2:55 PM, Dmitriy Ryaboy wrote: > Hi all, > On behalf of the Pig PMC, I'm very happy to announce that Bill Graham > has been invited to become a Pig committer. > > Bill's been involved in the Pig project for a long time now, and has > made a

Re: Welcome Pig's newest committer, Bill Graham!

2012-04-05 Thread Russell Jurney
Bravo! Now maybe we'll start talking about needing more non-Twitter committers :) On Thu, Apr 5, 2012 at 2:55 PM, Dmitriy Ryaboy wrote: > Hi all, > On behalf of the Pig PMC, I'm very happy to announce that Bill Graham > has been invited to become a Pig committer. > > Bill's been involved in the

Welcome Pig's newest committer, Bill Graham!

2012-04-05 Thread Dmitriy Ryaboy
Hi all, On behalf of the Pig PMC, I'm very happy to announce that Bill Graham has been invited to become a Pig committer. Bill's been involved in the Pig project for a long time now, and has made a number of significant contributions -- big improvements to HBase and Avro support, memory leak fixes

[jira] [Commented] (PIG-2634) JarManager fails for rsrc: jars

2012-04-05 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13247713#comment-13247713 ] Daniel Dai commented on PIG-2634: - Hi, Catalin, Do you have "register pig-0.9.2.jar" in your

[jira] [Resolved] (PIG-2601) Additional document for 0.10

2012-04-05 Thread Daniel Dai (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-2601. - Resolution: Fixed Fix Version/s: 0.11 Hadoop Flags: Reviewed Patch committed. Thanks for the pr

[jira] [Commented] (PIG-2599) Mavenize Pig

2012-04-05 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13247476#comment-13247476 ] Daniel Dai commented on PIG-2599: - Looks good, need to make sure current targets works: 1. b

Re: Schema mismatch for files with changing avro schemas

2012-04-05 Thread Jonathan Coveney
For the Avro people, does AvroStorage support column pruning? 2012/4/5 Stan Rosenberg > AFAIK, by default AvroStorage enforces that all input files have > exactly the same schema. I've submitted a patch to improve > this somewhat by allowing different input schemas so long as a union > schema c

Re: Cross Product of Two Tuples?

2012-04-05 Thread Scott Carey
"FLATTEN(TOBAG(t1)), FLATTEN(TOBAG(t2)) should give you the cross" Why? TOBAG(t1) should give you a bag with one tuple in it. FLATTEN on that gives you one tuple. If you want a bag with each tuple field, FLATTEN it first TOBAG(FLATTEN(t1)) or reference the fields: TOBAG(t1::$0, t1::$1, t1::$2

[jira] [Updated] (PIG-2634) JarManager fails for rsrc: jars

2012-04-05 Thread Catalin Alexandru Zamfir (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catalin Alexandru Zamfir updated PIG-2634: -- Priority: Blocker (was: Major) > JarManager fails for rsrc: jars > -

[jira] [Updated] (PIG-2634) JarManager fails for rsrc: jars

2012-04-05 Thread Catalin Alexandru Zamfir (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catalin Alexandru Zamfir updated PIG-2634: -- Labels: engine mapreducel merge parser pigserver (was: ) > JarManager fails

[jira] [Updated] (PIG-2634) JarManager fails for rsrc: jars

2012-04-05 Thread Catalin Alexandru Zamfir (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catalin Alexandru Zamfir updated PIG-2634: -- Attachment: pig_1333633836139.log Attaching log files while trying to use PigRunn

Re: Cross Product of Two Tuples?

2012-04-05 Thread Gianmarco De Francisci Morales
I would say the additional nesting level is a bug. But we should check if we break stuff with this change. Cheers, -- Gianmarco On Thu, Apr 5, 2012 at 01:36, Jonathan Coveney wrote: > Pig folks: it seems like it defies the expectation if TOBAG is run on a > single TUPLE and you don't get a ba