StoreMetadata.storeStatistics

2011-12-19 Thread Vivek Padmanabhan
Hi, Can someone tell what is the exact use case of StoreMetadata.storeStatistics(ResourceStatistics stats, String location, Job job) throws IOException; I am not able to find any reference which is populating stats into ResourceStatistics. Thanks Vivek

[jira] [Commented] (PIG-2375) Incorrect outputSchema is invoked when overloading UDF in 0.9.1

2011-12-19 Thread Prashant Kommireddi (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172981#comment-13172981 ] Prashant Kommireddi commented on PIG-2375: -- On having thought some more, when getAr

[jira] [Updated] (PIG-2353) RANK function like in SQL

2011-12-19 Thread Jonathan Coveney (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2353: -- Attachment: PIG2353.patch This provides a rank function, which needs a sorted input. Equal tuples

[jira] [Commented] (PIG-2430) An EvalFunc which overrides getArgToFuncMapping with FuncSpec with constructor arguments is not properly instantiated with said arguments

2011-12-19 Thread Jonathan Coveney (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172925#comment-13172925 ] Jonathan Coveney commented on PIG-2430: --- Thejas, thanks again for taking a look. I see

[jira] [Commented] (PIG-2432) Eclipse .classpath file is out of date

2011-12-19 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172847#comment-13172847 ] Daniel Dai commented on PIG-2432: - +1 > Eclipse .classpath file is out of d

[jira] [Updated] (PIG-2431) Upgrade bundled hadoop version to 20.205

2011-12-19 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2431: Attachment: PIG-2431-1.patch > Upgrade bundled hadoop version to 20.205 > ---

[jira] [Updated] (PIG-2430) An EvalFunc which overrides getArgToFuncMapping with FuncSpec with constructor arguments is not properly instantiated with said arguments

2011-12-19 Thread Thejas M Nair (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated PIG-2430: --- Attachment: DummySize.patch {code} grunt> define SZ SIZE('10'); grunt> l = load 't.txt' as (a,b

[jira] [Resolved] (PIG-2369) Pig should easily expose version information

2011-12-19 Thread Jonathan Coveney (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney resolved PIG-2369. --- Resolution: Duplicate duplicate of https://issues.apache.org/jira/browse/PIG-2380

[jira] [Updated] (PIG-2267) Make the name of the columns in schema optional

2011-12-19 Thread Jonathan Coveney (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2267: -- Attachment: PIG2267_1.patch A slightly more recent version of this with some tests.

Pig unit tests failures due to expected results ordering

2011-12-19 Thread Cheung, Po
We are seeing a number of Pig 0.8.1 unit test failures with Apache Hadoop 0.22 due to differences in the ordering of the expected results. For example, in TestCombiner.testJiraPig746, the expected result is: "(pig1,75,{(pig1,18,2.1),(pig1,18,2.1),(pig1,19,2.1),(pig1,20,3.1)})",

Pig unit tests failures due to expected results ordering

2011-12-19 Thread Cheung, Po
We are seeing a number of Pig 0.8.1 unit test failures with Apache Hadoop 0.22 due to differences in the ordering of the expected results. For example, in TestCombiner.testJiraPig746, the expected result is: "(pig1,75,{(pig1,18,2.1),(pig1,18,2.1),(pig1,19,2.1),(pig1,20,3.1)})",

[jira] [Resolved] (PIG-2366) Utils.getSchemaFromString should give you reasonable names for fields if they aren't specified

2011-12-19 Thread Jonathan Coveney (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney resolved PIG-2366. --- Resolution: Duplicate This is fixed by https://issues.apache.org/jira/browse/PIG-2267

Re: Flatten({()} returns no column, is this a bug or a feature?

2011-12-19 Thread Jonathan Coveney
Yeah, more or less. I think that ticket is definitely a bigger issue, though in my case the subtle difference is that there simply are no columns AND no schema to go off of. The fix should probably be the number of columns when the schema is specified, and then go from there. 2011/12/19 Dmitriy Ry

[jira] [Commented] (PIG-2429) Better error message in pig_*.log

2011-12-19 Thread xuting zhao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172525#comment-13172525 ] xuting zhao commented on PIG-2429: -- I think this problem is linked to PIG-1829,

[jira] [Commented] (PIG-2429) Better error message in pig_*.log

2011-12-19 Thread xuting zhao (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172519#comment-13172519 ] xuting zhao commented on PIG-2429: -- Hi Anitha, Thanks for the help. I have run the test

Re: Flatten({()} returns no column, is this a bug or a feature?

2011-12-19 Thread Dmitriy Ryaboy
Jon is this more or less https://issues.apache.org/jira/browse/PIG-2420 ? On Mon, Dec 19, 2011 at 8:51 AM, Jonathan Coveney wrote: > Imagine thing is just a file with 1\n2\n3\n4\n5 > > a = load 'thing' as (a:int); b = foreach (group a all) generate a, a as b; > c = foreach b generate FLATTEN(a)

Flatten({()} returns no column, is this a bug or a feature?

2011-12-19 Thread Jonathan Coveney
Imagine thing is just a file with 1\n2\n3\n4\n5 a = load 'thing' as (a:int); b = foreach (group a all) generate a, a as b; c = foreach b generate FLATTEN(a) as a, FLATTEN({()}) ; dump c; This will return (1) (2) (3) (4) (5) The schema is unknown (perhaps an issue in and of itself). It FEELS li

[jira] [Updated] (PIG-2426) ProgressableReporter.progress(String msg) is an empty function

2011-12-19 Thread Vivek Padmanabhan (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Padmanabhan updated PIG-2426: --- Attachment: partial_run.txt Added a test cases for the patch. I am not getting the above menti

[jira] [Updated] (PIG-2426) ProgressableReporter.progress(String msg) is an empty function

2011-12-19 Thread Vivek Padmanabhan (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Padmanabhan updated PIG-2426: --- Attachment: PIG-2426_2.patch > ProgressableReporter.progress(String msg) is an empty functi

[jira] [Commented] (PIG-2363) Provide configuration to disable persistence of _logs for streaming commands

2011-12-19 Thread jirapos...@reviews.apache.org (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172149#comment-13172149 ] jirapos...@reviews.apache.org commented on PIG-2363: --

Review Request: Provide configuration to disable persistence of _logs for streaming commands

2011-12-19 Thread Vivek Padmanabhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3256/ --- Review request for pig. Summary --- For Pig scripts which has streaming com

[jira] [Assigned] (PIG-2363) Provide configuration to disable persistence of _logs for streaming commands

2011-12-19 Thread Vivek Padmanabhan (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Padmanabhan reassigned PIG-2363: -- Assignee: Vivek Padmanabhan > Provide configuration to disable persistence of _logs f

[jira] [Commented] (PIG-2435) Unable to open iterator for alias in pig

2011-12-19 Thread Arun Prakash (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172132#comment-13172132 ] Arun Prakash commented on PIG-2435: --- Thx it is working for me. > Unable t