[jira] [Commented] (PIG-2578) Multiple Store-commands mess up mapred.output.dir.

[ https://issues.apache.org/jira/browse/PIG-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440912#comment-13440912 ] Dmitriy V. Ryaboy commented on PIG-2578: Reverted in PIG-2890. I don't see a way to

[jira] [Commented] (PIG-2870) pigServer.openIterator fails for jobs with no input splits

[ https://issues.apache.org/jira/browse/PIG-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440911#comment-13440911 ] Dmitriy V. Ryaboy commented on PIG-2870: Reverted PIG-2578. Is there still a no-inpu

[jira] [Commented] (PIG-2872) StoreFuncInterface.setStoreLocation get's a copy of a Configuration object

[ https://issues.apache.org/jira/browse/PIG-2872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440910#comment-13440910 ] Dmitriy V. Ryaboy commented on PIG-2872: Reverted PIG-2578. Is still a problem, or d

[jira] [Created] (PIG-2890) Revert PIG-2578

Dmitriy V. Ryaboy created PIG-2890: -- Summary: Revert PIG-2578 Key: PIG-2890 URL: https://issues.apache.org/jira/browse/PIG-2890 Project: Pig Issue Type: Bug Reporter: Dmitriy V.

[jira] [Commented] (PIG-2890) Revert PIG-2578

[ https://issues.apache.org/jira/browse/PIG-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440909#comment-13440909 ] Dmitriy V. Ryaboy commented on PIG-2890: Reverting PIG-2578 given Daniel Dai's +1 in

[jira] [Resolved] (PIG-2890) Revert PIG-2578

[ https://issues.apache.org/jira/browse/PIG-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy resolved PIG-2890. Resolution: Fixed Fix Version/s: 0.11 > Revert PIG-2578 > > >

[jira] [Commented] (PIG-2662) skew join does not honor its config parameters

[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440905#comment-13440905 ] Koji Noguchi commented on PIG-2662: --- bq. Koji, What OS, JVM are you using ? It is failing

Re: Number of mappers in MRCompiler

Oh yeah.. This question is not related to our cube sampling stuff that we discussed.. wanted to know the reason behind that just out of curiosity :) Thanks -- Prasanth On Aug 23, 2012, at 11:20 PM, Dmitriy Ryaboy wrote: > I think we decided to instead stub in a special loader that reads a >

Re: Number of mappers in MRCompiler

I think we decided to instead stub in a special loader that reads a few records from each underlying split, in a single mapper (by using a single wrapping split), right? On Thu, Aug 23, 2012 at 7:55 PM, Prasanth J wrote: > I see. Thanks Alan for your reply. > Also one more question that I posted

[jira] [Resolved] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy resolved PIG-2850. Resolution: Fixed Fix Version/s: 0.11 Committed to trunk. > Pig shoul

Re: Number of mappers in MRCompiler

I see. Thanks Alan for your reply. Also one more question that I posted earlier was I used RandomSampleLoader and specified a sample size of 100. The number of map tasks that are executed is 110. So I am expecting total samples that are received on the reducer to be 110*100 = 11000 but its alwa

[jira] [Assigned] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy reassigned PIG-2850: -- Assignee: Matthew Hayes > Pig should support loading macro files as resources stored

[jira] [Updated] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Hayes updated PIG-2850: --- Attachment: import_macros_from_jar_5.diff yep i did, sorry, now fixed > Pig should sup

[jira] [Commented] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440890#comment-13440890 ] Dmitriy V. Ryaboy commented on PIG-2850: Fails to compile. Did you forget to add Res

[jira] [Commented] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440876#comment-13440876 ] Matthew Hayes commented on PIG-2850: Oops I should have done an svn up. I resolved the

[jira] [Updated] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Hayes updated PIG-2850: --- Attachment: import_macros_from_jar_4.diff > Pig should support loading macro files as resources sto

[jira] [Commented] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440862#comment-13440862 ] Dmitriy V. Ryaboy commented on PIG-2850: Ok.. it's actually a legit conflict, not ju

[jira] [Commented] (PIG-1314) Add DateTime Support to Pig

[ https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440860#comment-13440860 ] Zhijie Shen commented on PIG-1314: -- Hi Thejas, let me do that. > Add DateT

[jira] [Commented] (PIG-1314) Add DateTime Support to Pig

[ https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440858#comment-13440858 ] Thejas M Nair commented on PIG-1314: We also need to have some test cases that set the t

[jira] [Commented] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440857#comment-13440857 ] Dmitriy V. Ryaboy commented on PIG-2850: Patch isn't applying cleanly. I'll remediat

[jira] [Commented] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440853#comment-13440853 ] Dmitriy V. Ryaboy commented on PIG-2850: Perfect, thanks for the explanation. I like

[jira] [Commented] (PIG-1314) Add DateTime Support to Pig

[ https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440851#comment-13440851 ] Thejas M Nair commented on PIG-1314: PIG-1314-7.patch committed to trunk! Thanks Zhijie.

[jira] [Updated] (PIG-2811) Updating .eclipse.templates/.classpath with the Newest Jython Version

[ https://issues.apache.org/jira/browse/PIG-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated PIG-2811: --- Resolution: Fixed Status: Resolved (was: Patch Available) Fixed in the PIG-1314 patch.

[jira] [Commented] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440824#comment-13440824 ] Matthew Hayes commented on PIG-2850: The function could legitimately return null if the

[jira] [Updated] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Hayes updated PIG-2850: --- Attachment: import_macros_from_jar_3.diff > Pig should support loading macro files as resources sto

[jira] [Commented] (PIG-2662) skew join does not honor its config parameters

[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440789#comment-13440789 ] Thejas M Nair commented on PIG-2662: Koji, What OS, JVM are you using ?

[jira] [Commented] (PIG-2682) pig harness does not correctly count the number of stores for multiple invocations of the same macro

[ https://issues.apache.org/jira/browse/PIG-2682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440774#comment-13440774 ] Andrey Klochkov commented on PIG-2682: -- How about adding a parameter "expected_outfiles

[jira] [Commented] (PIG-2662) skew join does not honor its config parameters

[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440766#comment-13440766 ] Rajesh Balamohan commented on PIG-2662: --- With the trunk code, I quickly tried to run o

[jira] [Commented] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440764#comment-13440764 ] Dmitriy V. Ryaboy commented on PIG-2850: Looks good. In fetchResource, you check if

Build failed in Jenkins: Pig-trunk #1304

See Changes: [julien] PIG-2848: TestBuiltInBagToTupleOrString fails now that mock.Storage enforces not overwriting output (julien) -- [...truncated 36576 lines...] [junit] at org.apache.hadoo

Re: Number of mappers in MRCompiler

Sorry for the very slow response, but here it is, hopefully better late than never. On Jul 25, 2012, at 4:28 PM, Prasanth J wrote: > Thanks Alan. > The requirement for me is that I want to load N number of samples based on > the input file size and perform naive cube computation to determine th

[jira] [Commented] (PIG-2662) skew join does not honor its config parameters

[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440714#comment-13440714 ] Koji Noguchi commented on PIG-2662: --- bq. @Koji, which version of Pig are you using? Trunk.

[jira] [Commented] (PIG-2662) skew join does not honor its config parameters

[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440706#comment-13440706 ] Rajesh Balamohan commented on PIG-2662: --- @Koji, which version of Pig are you using?

[jira] [Commented] (PIG-2844) ant makepom is misconfigured

[ https://issues.apache.org/jira/browse/PIG-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440707#comment-13440707 ] Alan Gates commented on PIG-2844: - Ok, +1 I guess then. > ant makepom is mi

Re: Project the last field of a tuple

This is neat. This should maybe be a built in: Tuple.first and Tuple.last. Very convenient in Ruby. Russell Jurney http://datasyndrome.com On Aug 23, 2012, at 1:53 PM, Jonathan Coveney wrote: > here's a UDF to do it that took me about 10s to write, so may have errors: > > import java.io.IOExcep

[jira] [Commented] (PIG-2844) ant makepom is misconfigured

[ https://issues.apache.org/jira/browse/PIG-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440705#comment-13440705 ] Julien Le Dem commented on PIG-2844: I believe that the previously generated pom was inc

[jira] [Resolved] (PIG-2848) TestBuiltInBagToTupleOrString fails now that mock.Storage enforces not overwriting output

[ https://issues.apache.org/jira/browse/PIG-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem resolved PIG-2848. Resolution: Fixed Fix Version/s: 0.11 > TestBuiltInBagToTupleOrString fails now that mock.

[jira] [Commented] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440628#comment-13440628 ] Dmitriy V. Ryaboy commented on PIG-2850: Sorry, didn't notice you updated. Will revi

[jira] [Commented] (PIG-2662) skew join does not honor its config parameters

[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440550#comment-13440550 ] Koji Noguchi commented on PIG-2662: --- It seems like org.apache.pig.test.TestPoissonSampleLo

[jira] [Commented] (PIG-2848) TestBuiltInBagToTupleOrString fails now that mock.Storage enforces not overwriting output

[ https://issues.apache.org/jira/browse/PIG-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440548#comment-13440548 ] Jonathan Coveney commented on PIG-2848: --- +1 > TestBuiltInBagToTupleOr

[jira] [Commented] (PIG-2848) TestBuiltInBagToTupleOrString fails now that mock.Storage enforces not overwriting output

[ https://issues.apache.org/jira/browse/PIG-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440541#comment-13440541 ] Julien Le Dem commented on PIG-2848: I just got back from a trip. I need a +1 to check

[jira] [Commented] (PIG-2848) TestBuiltInBagToTupleOrString fails now that mock.Storage enforces not overwriting output

[ https://issues.apache.org/jira/browse/PIG-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440532#comment-13440532 ] Koji Noguchi commented on PIG-2848: --- What does it take to get this in? I want to see succ

[jira] [Commented] (PIG-2850) Pig should support loading macro files as resources stored in JAR files

[ https://issues.apache.org/jira/browse/PIG-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440488#comment-13440488 ] Matthew Hayes commented on PIG-2850: Is there anything else necessary for me to change?

[jira] [Commented] (PIG-2889) HBaseAvroStorage UDF

[ https://issues.apache.org/jira/browse/PIG-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440406#comment-13440406 ] Alan Gates commented on PIG-2889: - Hive has an AvroSerDe which I believe can read schema on

[jira] [Commented] (PIG-2886) Add Scan TimeRange to HBaseStorage

[ https://issues.apache.org/jira/browse/PIG-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440367#comment-13440367 ] Bill Graham commented on PIG-2886: -- Only a subset of tests run during test-commit. test wil

[jira] [Commented] (PIG-2886) Add Scan TimeRange to HBaseStorage

[ https://issues.apache.org/jira/browse/PIG-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440270#comment-13440270 ] Ted Malaska commented on PIG-2886: -- Question. I added the test cases and ran the followi

[jira] [Updated] (PIG-2353) RANK function like in SQL

[ https://issues.apache.org/jira/browse/PIG-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Avendaño updated PIG-2353: Attachment: PIG-2353-4.txt All unit and e2e tests passed. > RANK function like in S

Re: Review Request: RANK function like in SQL

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5523/ --- (Updated Aug. 23, 2012, 11:07 a.m.) Review request for pig, aavendan and Gianmar