[jira] [Commented] (PIG-2543) PigStats.isSuccessful returns false if embedded pig script has sh commands

2012-03-07 Thread Daniel Dai (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13224083#comment-13224083 ] Daniel Dai commented on PIG-2543: - The current design of PigStats is all based on mapreduce

[jira] [Updated] (PIG-2570) LimitOptimizer fails with dynamic LIMIT argument

2012-03-07 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2570: Attachment: PIG-2570-1.patch LimitOptimizer fails with dynamic LIMIT argument

[jira] [Updated] (PIG-2570) LimitOptimizer fails with dynamic LIMIT argument

2012-03-07 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2570: Fix Version/s: 0.11 0.10 LimitOptimizer fails with dynamic LIMIT argument

[jira] [Commented] (PIG-2570) LimitOptimizer fails with dynamic LIMIT argument

2012-03-07 Thread Bill Graham (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13224603#comment-13224603 ] Bill Graham commented on PIG-2570: -- +1 Thanks Daniel! This patch does the trick.

[jira] [Updated] (PIG-2572) e2e harness deploy fails when using pig that does not bundle hadoop

2012-03-07 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2572: Attachment: PIG-2572-2.patch PIG-2572-2.patch is for 0.10/trunk. e2e harness deploy fails

[jira] [Updated] (PIG-2572) e2e harness deploy fails when using pig that does not bundle hadoop

2012-03-07 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2572: Resolution: Fixed Assignee: Thomas Weise Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (PIG-2543) PigStats.isSuccessful returns false if embedded pig script has sh commands

2012-03-07 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2543: Attachment: PIG-2543-1.patch For this particular issue, we don't need to change PigStats interface. All we

[jira] [Resolved] (PIG-2532) Registered classes fail deserialization in frontend

2012-03-07 Thread Daniel Dai (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-2532. - Resolution: Fixed Fix Version/s: 0.11 Hadoop Flags: Reviewed Registered classes fail

[jira] [Updated] (PIG-2532) Registered classes fail deserialization in frontend

2012-03-07 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2532: Attachment: PIG-2532-h23.patch PIG-2532-h23.patch fix h23 test failure. Also I find the patch is not

[jira] [Updated] (PIG-2565) Support IMPORT for macros stored in S3 Buckets

2012-03-07 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2565: Attachment: PIG-2565-1.patch Support IMPORT for macros stored in S3 Buckets

[jira] [Updated] (PIG-2565) Support IMPORT for macros stored in S3 Buckets

2012-03-07 Thread Daniel Dai (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2565: Fix Version/s: 0.11 0.10 Assignee: Daniel Dai Support IMPORT for macros

[jira] [Created] (PIG-2574) Make reducer estimator plugable

2012-03-07 Thread Bill Graham (Created) (JIRA)
Make reducer estimator plugable --- Key: PIG-2574 URL: https://issues.apache.org/jira/browse/PIG-2574 Project: Pig Issue Type: Improvement Reporter: Bill Graham Assignee: Bill Graham I'd

[jira] [Assigned] (PIG-2573) Automagically setting parallelism based on input file size does not work with HCatalog

2012-03-07 Thread Travis Crawford (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Crawford reassigned PIG-2573: Assignee: Travis Crawford Automagically setting parallelism based on input file size

[jira] [Commented] (PIG-2573) Automagically setting parallelism based on input file size does not work with HCatalog

2012-03-07 Thread Travis Crawford (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13224970#comment-13224970 ] Travis Crawford commented on PIG-2573: -- Yup, I'm looking into this. After pig supports

[jira] [Created] (PIG-2575) underline symbol is not supported in foreach block

2012-03-07 Thread Shepherd Chu (Created) (JIRA)
underline symbol is not supported in foreach block -- Key: PIG-2575 URL: https://issues.apache.org/jira/browse/PIG-2575 Project: Pig Issue Type: Bug Environment: HadoopVersion

Re: [jira] [Created] (PIG-2575) underline symbol is not supported in foreach block

2012-03-07 Thread Dmitriy Ryaboy
More likely, its a variable name collision. Could you post the whole script?

Re: How can I track the actual map and reduce tasks executed in pig?

2012-03-07 Thread Dmitriy Ryaboy
You are confusing map and reduce tasks with a mapreduce jobs. Your pig script resulted in a single mapreduce job. The number of map tasks was 2, based on input size -- it has little to do with the actual operators you used. There is no union operator involved so I am not sure what you are

Re: [jira] [Created] (PIG-2575) underline symbol is not supported in foreach block

2012-03-07 Thread Jonathan Coveney
Is region_modified_account used elsewhere? There is a known bug where within a foreach block you can't make a relation that shares a name externally. 2012/3/7 Dmitriy Ryaboy dvrya...@gmail.com More likely, its a variable name collision. Could you post the whole script?

[jira] [Commented] (PIG-2563) IndexOutOfBoundsException: while projecting fields from a bag

2012-03-07 Thread Dmitriy V. Ryaboy (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13225076#comment-13225076 ] Dmitriy V. Ryaboy commented on PIG-2563: Daniel, I think I understand. But the