Re: Review Request: Pig creates too many instances of Load and Store Funcs. It should be 1 in the front-end and 1 in the backend

2012-05-21 Thread Bill Graham
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5159/#review8026 --- Ship it! One minor nit, but lgtm. /trunk/test/org/apache/pig/test/

[jira] [Commented] (PIG-2661) Pig uses an extra job for loading data in Pigmix L9

2012-05-21 Thread Jie Li (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13280683#comment-13280683 ] Jie Li commented on PIG-2661: - Here is the comparison between 0.8.1 and 0.9.0: || types || pig 0

[jira] [Updated] (PIG-2632) Create a SchemaTuple which generates efficient Tuples via code gen

2012-05-21 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2632: -- Attachment: schematuple benchmarking.pptx Powerpoint?! What is this, Wall Street? I know, I know.

[jira] [Created] (PIG-2715) Cannot specify schema field alias for map value via piglatin

2012-05-21 Thread Andy Schlaikjer (JIRA)
Andy Schlaikjer created PIG-2715: Summary: Cannot specify schema field alias for map value via piglatin Key: PIG-2715 URL: https://issues.apache.org/jira/browse/PIG-2715 Project: Pig Issue T

Jenkins build is back to normal : Pig-trunk #1250

2012-05-21 Thread Apache Jenkins Server
See

xerces error running junit tests on Pig trunk

2012-05-21 Thread Kumar Ravi
I am seeing the following problem while running junit tests after succesfully building pig jar files with Sun JDK 1.7 on an x86_64 platform on the pig trunk build. ERROR conf.Configuration: Failed to set setXIncludeAware(true) for parser org.apache.xerces.jaxp.DocumentBuilderFactoryImpl@5fd9398

[jira] [Resolved] (PIG-2600) Better Map support

2012-05-21 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney resolved PIG-2600. --- Resolution: Fixed > Better Map support > -- > > Key: PIG-26

[jira] [Commented] (PIG-2651) Provide a much easier to use accumulator interface

2012-05-21 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13280379#comment-13280379 ] Jonathan Coveney commented on PIG-2651: --- Woosh, PIG2066 is in, so I'd love a more thor

[jira] [Updated] (PIG-2066) Accumulators should be able to early-terminate

2012-05-21 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2066: -- Resolution: Fixed Fix Version/s: (was: 0.10.1) Status: Resolved (was: Patch

[jira] [Commented] (PIG-2066) Accumulators should be able to early-terminate

2012-05-21 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13280376#comment-13280376 ] Jonathan Coveney commented on PIG-2066: --- Awesome. Committed to trunk.

[jira] [Commented] (PIG-2706) Add clear to list of grunt commands

2012-05-21 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13280365#comment-13280365 ] Prashant Kommireddi commented on PIG-2706: -- Thanks for looking into this Allan. I

[jira] [Commented] (PIG-2600) Better Map support

2012-05-21 Thread Prashant Kommireddi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13280360#comment-13280360 ] Prashant Kommireddi commented on PIG-2600: -- Thanks Jon. Did you forget to change th

[jira] [Updated] (PIG-2711) e2e harness: cache benchmark results between test runs

2012-05-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2711: Fix Version/s: 0.10.1 Also commit to 0.10 branch as per Thomas' request. > e2e harness: cach

[jira] [Commented] (PIG-2600) Better Map support

2012-05-21 Thread Jonathan Coveney (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13280331#comment-13280331 ] Jonathan Coveney commented on PIG-2600: --- Prashant: it's in. Thanks for your patience!

Re: About the Pig Latin Implementation

2012-05-21 Thread Alan Gates
http://infolab.stanford.edu/~olston/publications/vldb09.pdf contains details of how we built Pig. This paper is old and does not include many of the newer optimizations. But the basic approach has not changed. Alan. On May 21, 2012, at 4:30 AM, Li Shengmei wrote: > Hi, all > > I am

About the Pig Latin Implementation

2012-05-21 Thread Li Shengmei
Hi, all I am new to Pig Latin. I have read the paper "Pig Latin: A not-so-foreign language for data processing" published in SIGMOD'08. But I want know more about how the Pig Latin program transferring to map reduce programs. Is it source to source transformation or through library? Can y

Build failed in Jenkins: Pig-trunk #1249

2012-05-21 Thread Apache Jenkins Server
See Changes: [daijy] PIG-2711: e2e harness: cache benchmark results between test runs -- [...truncated 37827 lines...] [junit] at org.apache.pig.test.MiniGenericCluster.shutdownMiniDfsClusters

[jira] [Resolved] (PIG-2711) e2e harness: cache benchmark results between test runs

2012-05-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-2711. - Resolution: Fixed Fix Version/s: 0.11 Hadoop Flags: Reviewed Patch committed to trunk. Thanks T

[jira] [Commented] (PIG-2705) outputSchema modification from scripting UDFs

2012-05-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13279991#comment-13279991 ] Daniel Dai commented on PIG-2705: - org.apache.pig.impl.logicalLayer.schema.Schema, which we

[jira] [Commented] (PIG-2166) UDFs to flatten a bag

2012-05-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13279988#comment-13279988 ] Daniel Dai commented on PIG-2166: - Hi, Hien, I don't think either. BagToTuple({(a),{(b,c)},(

[jira] [Updated] (PIG-2166) UDFs to join a bag

2012-05-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2166: Summary: UDFs to join a bag (was: UDFs to flatten a bag) > UDFs to join a bag > -- > >