[jira] Updated: (PIG-1172) PushDownForeachFlatten shall not push ForEach below Join if the flattened fields is used in Join

2010-01-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1172: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch com

[jira] Updated: (PIG-1176) Column Pruner issues in union of loader with and without schema

2010-01-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1176: Attachment: PIG-1176-1.patch > Column Pruner issues in union of loader with and without schema >

[jira] Updated: (PIG-1176) Column Pruner issues in union of loader with and without schema

2010-01-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1176: Status: Patch Available (was: Open) > Column Pruner issues in union of loader with and without schema >

[jira] Created: (PIG-1176) Column Pruner issues in union of loader with and without schema

2010-01-04 Thread Daniel Dai (JIRA)
Column Pruner issues in union of loader with and without schema --- Key: PIG-1176 URL: https://issues.apache.org/jira/browse/PIG-1176 Project: Pig Issue Type: Bug Componen

[jira] Updated: (PIG-1172) PushDownForeachFlatten shall not push ForEach below Join if the flattened fields is used in Join

2010-01-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1172: Attachment: PIG-1172-2.patch hadoop20.jar should not be in patch. I reattched the patch. Thanks. > PushDownF

[jira] Commented: (PIG-1090) Update sources to reflect recent changes in load-store interfaces

2010-01-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796386#action_12796386 ] Daniel Dai commented on PIG-1090: - +1 for PIG-1090-8.patch > Update sources to reflect recen

[jira] Commented: (PIG-1173) pig cannot be built without an internet connection

2009-12-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794545#action_12794545 ] Daniel Dai commented on PIG-1173: - Hi, Jeff, I tried your patch, but I still get this error w

[jira] Updated: (PIG-1146) Inconsistent column pruning in LOUnion

2009-12-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1146: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch com

[jira] Updated: (PIG-761) ERROR 2086 on simple JOIN

2009-12-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-761: --- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch commit

[jira] Updated: (PIG-1172) PushDownForeachFlatten shall not push ForEach below Join if the flattened fields is used in Join

2009-12-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1172: Status: Patch Available (was: Open) > PushDownForeachFlatten shall not push ForEach below Join if the flatte

[jira] Updated: (PIG-1172) PushDownForeachFlatten shall not push ForEach below Join if the flattened fields is used in Join

2009-12-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1172: Attachment: PIG-1172-1.patch > PushDownForeachFlatten shall not push ForEach below Join if the flattened > f

[jira] Commented: (PIG-761) ERROR 2086 on simple JOIN

2009-12-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794504#action_12794504 ] Daniel Dai commented on PIG-761: The answer to both is no. There is only one case to insert li

[jira] Created: (PIG-1172) PushDownForeachFlatten shall not push ForEach below Join if the flattened fields is used in Join

2009-12-24 Thread Daniel Dai (JIRA)
PushDownForeachFlatten shall not push ForEach below Join if the flattened fields is used in Join Key: PIG-1172 URL: https://issues.apache.org/jira/browse/PIG-1172

[jira] Commented: (PIG-1090) Update sources to reflect recent changes in load-store interfaces

2009-12-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12794253#action_12794253 ] Daniel Dai commented on PIG-1090: - Regarding to PIG-1090-4.patch, In LOLoad.getSchema, we sha

[jira] Updated: (PIG-1146) Inconsistent column pruning in LOUnion

2009-12-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1146: Status: Open (was: Patch Available) > Inconsistent column pruning in LOUnion > -

[jira] Updated: (PIG-1146) Inconsistent column pruning in LOUnion

2009-12-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1146: Status: Patch Available (was: Open) > Inconsistent column pruning in LOUnion > -

[jira] Updated: (PIG-1146) Inconsistent column pruning in LOUnion

2009-12-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1146: Attachment: PIG-1146-2.patch Address couple of suggestions from Pradeep in ColumnPruner: 1. Clear some code f

[jira] Updated: (PIG-761) ERROR 2086 on simple JOIN

2009-12-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-761: --- Fix Version/s: 0.6.0 Assignee: Daniel Dai Status: Patch Available (was: Open) > ERROR 2086

[jira] Updated: (PIG-761) ERROR 2086 on simple JOIN

2009-12-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-761: --- Attachment: PIG-761-1.patch The problem lies in the complexity between limit and one of the optimization. More

[jira] Updated: (PIG-1165) Signature of loader does not set correctly for order by

2009-12-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1165: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch com

[jira] Updated: (PIG-1165) Signature of loader does not set correctly for order by

2009-12-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1165: Attachment: PIG-1165-1.patch > Signature of loader does not set correctly for order by >

[jira] Updated: (PIG-1165) Signature of loader does not set correctly for order by

2009-12-21 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1165: Status: Patch Available (was: Open) > Signature of loader does not set correctly for order by >

[jira] Created: (PIG-1165) Signature of loader does not set correctly for order by

2009-12-18 Thread Daniel Dai (JIRA)
Signature of loader does not set correctly for order by --- Key: PIG-1165 URL: https://issues.apache.org/jira/browse/PIG-1165 Project: Pig Issue Type: Bug Components: impl Aff

[jira] Updated: (PIG-1146) Inconsistent column pruning in LOUnion

2009-12-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1146: Status: Patch Available (was: Open) > Inconsistent column pruning in LOUnion > -

[jira] Updated: (PIG-1146) Inconsistent column pruning in LOUnion

2009-12-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1146: Attachment: PIG-1146-1.patch > Inconsistent column pruning in LOUnion > -

[jira] Assigned: (PIG-1146) Inconsistent column pruning in LOUnion

2009-12-18 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-1146: --- Assignee: Daniel Dai > Inconsistent column pruning in LOUnion > --

[jira] Updated: (PIG-948) [Usability] Relating pig script with MR jobs

2009-12-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-948: --- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch commit

[jira] Updated: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1144: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch com

[jira] Updated: (PIG-948) [Usability] Relating pig script with MR jobs

2009-12-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-948: --- Status: Open (was: Patch Available) > [Usability] Relating pig script with MR jobs > --

[jira] Updated: (PIG-948) [Usability] Relating pig script with MR jobs

2009-12-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-948: --- Status: Patch Available (was: Open) > [Usability] Relating pig script with MR jobs > --

[jira] Updated: (PIG-948) [Usability] Relating pig script with MR jobs

2009-12-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-948: --- Attachment: PIG-948-6.patch In local mode, we should disable the confusing message "Cannot get jobid". Attach a

[jira] Updated: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1144: Status: Patch Available (was: Open) > set default_parallelism construct does not set the number of reducers

[jira] Updated: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1144: Status: Open (was: Patch Available) > set default_parallelism construct does not set the number of reducers

[jira] Updated: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-17 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1144: Attachment: PIG-1144-4.patch Include logic for local mode. However, this is only for user use "-x local". If

[jira] Commented: (PIG-1159) merge join right side table does not support comma seperated paths

2009-12-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12791740#action_12791740 ] Daniel Dai commented on PIG-1159: - Some initial investigation: In POMergeJoin.seekInRightStre

[jira] Updated: (PIG-1155) Need to make sure existing loaders work "as is"

2009-12-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1155: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch com

[jira] Updated: (PIG-1155) Need to make sure existing loaders work "as is"

2009-12-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1155: Status: Patch Available (was: Open) > Need to make sure existing loaders work "as is" >

[jira] Updated: (PIG-1155) Need to make sure existing loaders work "as is"

2009-12-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1155: Attachment: PIG-1155-1.patch Attach a patch. Don't have way to generate the obsolete class in the code. So s

[jira] Updated: (PIG-948) [Usability] Relating pig script with MR jobs

2009-12-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-948: --- Status: Patch Available (was: Reopened) > [Usability] Relating pig script with MR jobs > --

[jira] Updated: (PIG-948) [Usability] Relating pig script with MR jobs

2009-12-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-948: --- Attachment: PIG-948-5.patch Attach a patch for the new logic to get jobid. There is no unit test case. I don't

[jira] Reopened: (PIG-948) [Usability] Relating pig script with MR jobs

2009-12-15 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reopened PIG-948: Current logic to get jobid is we wait for 2 seconds, if we cannot get jobid in 2 seconds, then we say "Cannot get

[jira] Updated: (PIG-1086) Nested sort by * throw exception

2009-12-11 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1086: Resolution: Fixed Fix Version/s: 0.7.0 Hadoop Flags: [Reviewed] Status: Resolved (was:

[jira] Updated: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-11 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1144: Status: Patch Available (was: Open) > set default_parallelism construct does not set the number of reducers

[jira] Updated: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-11 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1144: Attachment: PIG-1144-3.patch Change the patch to take "mapred.reduce.tasks" into account. The hierarchy for

[jira] Updated: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-11 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1144: Status: Open (was: Patch Available) > set default_parallelism construct does not set the number of reducers

[jira] Updated: (PIG-1142) Got NullPointerException merge join with pruning

2009-12-11 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1142: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) New patch

[jira] Updated: (PIG-1142) Got NullPointerException merge join with pruning

2009-12-11 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1142: Attachment: PIG-1142-3.patch No code change in PIG-1142-3.patch, except for more test cases. > Got NullPoint

[jira] Updated: (PIG-1142) Got NullPointerException merge join with pruning

2009-12-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1142: Hadoop Flags: (was: [Reviewed]) Status: Patch Available (was: Reopened) > Got NullPointerExcepti

[jira] Updated: (PIG-1142) Got NullPointerException merge join with pruning

2009-12-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1142: Attachment: PIG-1142-2.patch > Got NullPointerException merge join with pruning > ---

[jira] Reopened: (PIG-1142) Got NullPointerException merge join with pruning

2009-12-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reopened PIG-1142: - Find several lines of code share the same nature as the initial one. Should fix them all. > Got NullPointerE

[jira] Updated: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1144: Attachment: PIG-1144-2.patch I think the reason is quantile job need to know how many reducers we are going

[jira] Updated: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1144: Status: Open (was: Patch Available) > set default_parallelism construct does not set the number of reducers

[jira] Updated: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1144: Status: Patch Available (was: Open) > set default_parallelism construct does not set the number of reducers

[jira] Created: (PIG-1146) Inconsistent column pruning in LOUnion

2009-12-10 Thread Daniel Dai (JIRA)
Inconsistent column pruning in LOUnion -- Key: PIG-1146 URL: https://issues.apache.org/jira/browse/PIG-1146 Project: Pig Issue Type: Bug Components: impl Affects Versions: 0.6.0 R

[jira] Updated: (PIG-1142) Got NullPointerException merge join with pruning

2009-12-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1142: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch com

[jira] Commented: (PIG-1086) Nested sort by * throw exception

2009-12-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12788461#action_12788461 ] Daniel Dai commented on PIG-1086: - +1 > Nested sort by * throw exception > -

[jira] Commented: (PIG-1142) Got NullPointerException merge join with pruning

2009-12-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12788458#action_12788458 ] Daniel Dai commented on PIG-1142: - To make it clear, this issue happens when we prune more th

[jira] Updated: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1144: Affects Version/s: (was: 0.7.0) 0.6.0 Status: Patch Available (was:

[jira] Updated: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1144: Attachment: PIG-1144-1.patch > set default_parallelism construct does not set the number of reducers > corre

[jira] Commented: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12788456#action_12788456 ] Daniel Dai commented on PIG-1144: - Leaving parallelism to -1 is not a solution here. In setti

[jira] Assigned: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-1144: --- Assignee: Daniel Dai > set default_parallelism construct does not set the number of reducers > correct

[jira] Commented: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12788447#action_12788447 ] Daniel Dai commented on PIG-1144: - I find the root cause of the problem. For every sort job,

[jira] Commented: (PIG-1144) set default_parallelism construct does not set the number of reducers correctly

2009-12-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12788434#action_12788434 ] Daniel Dai commented on PIG-1144: - Hi, Viraj, default parallelism is set in JobControlCompile

[jira] Updated: (PIG-1142) Got NullPointerException merge join with pruning

2009-12-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1142: Attachment: PIG-1142-1.patch > Got NullPointerException merge join with pruning > ---

[jira] Updated: (PIG-1142) Got NullPointerException merge join with pruning

2009-12-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1142: Status: Patch Available (was: Open) > Got NullPointerException merge join with pruning > ---

[jira] Assigned: (PIG-1142) Got NullPointerException merge join with pruning

2009-12-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-1142: --- Assignee: Daniel Dai > Got NullPointerException merge join with pruning > -

[jira] Commented: (PIG-1142) Got NullPointerException merge join with pruning

2009-12-09 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12788415#action_12788415 ] Daniel Dai commented on PIG-1142: - I can reproduce it in regular join as well. Here is the sc

[jira] Updated: (PIG-1132) Column Pruner issues in dealing with unprunable loader

2009-12-08 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1132: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Core test

[jira] Updated: (PIG-1133) UDFContext should be made available to LoadFunc.bindTo

2009-12-08 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1133: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch com

[jira] Commented: (PIG-1132) Column Pruner issues in dealing with unprunable loader

2009-12-08 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787716#action_12787716 ] Daniel Dai commented on PIG-1132: - Yes, it could happen for any logical operators after Load.

[jira] Commented: (PIG-1133) UDFContext should be made available to LoadFunc.bindTo

2009-12-08 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787668#action_12787668 ] Daniel Dai commented on PIG-1133: - The interesting thing is UDFContext is always available to

[jira] Updated: (PIG-1132) Column Pruner issues in dealing with unprunable loader

2009-12-07 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1132: Status: Open (was: Patch Available) > Column Pruner issues in dealing with unprunable loader > -

[jira] Updated: (PIG-1132) Column Pruner issues in dealing with unprunable loader

2009-12-07 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1132: Status: Patch Available (was: Open) > Column Pruner issues in dealing with unprunable loader > -

[jira] Updated: (PIG-1132) Column Pruner issues in dealing with unprunable loader

2009-12-07 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1132: Attachment: PIG-1132-2.patch Ignore the first patch. > Column Pruner issues in dealing with unprunable load

[jira] Updated: (PIG-1133) UDFContext should be made available to LoadFunc.bindTo

2009-12-07 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1133: Status: Patch Available (was: Open) > UDFContext should be made available to LoadFunc.bindTo > -

[jira] Updated: (PIG-1133) UDFContext should be made available to LoadFunc.bindTo

2009-12-07 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1133: Attachment: PIG-1133-1.patch This issue is not reproducible in either hadoop local mode and MiniCluster. So

[jira] Created: (PIG-1133) UDFContext should be made available to LoadFunc.bindTo

2009-12-07 Thread Daniel Dai (JIRA)
UDFContext should be made available to LoadFunc.bindTo -- Key: PIG-1133 URL: https://issues.apache.org/jira/browse/PIG-1133 Project: Pig Issue Type: Bug Components: impl Affec

[jira] Updated: (PIG-1132) Column Pruner issues in dealing with unprunable loader

2009-12-07 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1132: Attachment: PIG-1132-1.patch > Column Pruner issues in dealing with unprunable loader > -

[jira] Updated: (PIG-1132) Column Pruner issues in dealing with unprunable loader

2009-12-07 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1132: Status: Patch Available (was: Open) > Column Pruner issues in dealing with unprunable loader > -

[jira] Created: (PIG-1132) Column Pruner issues in dealing with unprunable loader

2009-12-07 Thread Daniel Dai (JIRA)
Column Pruner issues in dealing with unprunable loader -- Key: PIG-1132 URL: https://issues.apache.org/jira/browse/PIG-1132 Project: Pig Issue Type: Bug Affects Versions: 0.4.0

[jira] Updated: (PIG-1127) Logical operator should contains individual copy of schema object

2009-12-07 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1127: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Committed

[jira] Commented: (PIG-1127) Logical operator should contains individual copy of schema object

2009-12-07 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787189#action_12787189 ] Daniel Dai commented on PIG-1127: - It is ideal we put the setParent logic into copy construct

[jira] Updated: (PIG-1128) column pruning causing failure when foreach has user-specified schema

2009-12-07 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1128: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Committed

[jira] Commented: (PIG-1128) column pruning causing failure when foreach has user-specified schema

2009-12-07 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787140#action_12787140 ] Daniel Dai commented on PIG-1128: - Core tests failures are due to port conflict. Run unit tes

[jira] Updated: (PIG-1127) Logical operator should contains individual copy of schema object

2009-12-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1127: Status: Open (was: Patch Available) > Logical operator should contains individual copy of schema object > --

[jira] Updated: (PIG-1127) Logical operator should contains individual copy of schema object

2009-12-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1127: Status: Patch Available (was: Open) > Logical operator should contains individual copy of schema object > --

[jira] Updated: (PIG-1127) Logical operator should contains individual copy of schema object

2009-12-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1127: Attachment: PIG-1127-2.patch > Logical operator should contains individual copy of schema object > --

[jira] Updated: (PIG-1128) column pruning causing failure when foreach has user-specified schema

2009-12-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1128: Status: Patch Available (was: Open) > column pruning causing failure when foreach has user-specified schema

[jira] Updated: (PIG-1128) column pruning causing failure when foreach has user-specified schema

2009-12-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1128: Attachment: PIG-1128-1.patch > column pruning causing failure when foreach has user-specified schema > --

[jira] Assigned: (PIG-1128) column pruning causing failure when foreach has user-specified schema

2009-12-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-1128: --- Assignee: Daniel Dai > column pruning causing failure when foreach has user-specified schema >

[jira] Updated: (PIG-1127) Logical operator should contains individual copy of schema object

2009-12-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1127: Status: Patch Available (was: Open) > Logical operator should contains individual copy of schema object > --

[jira] Updated: (PIG-1127) Logical operator should contains individual copy of schema object

2009-12-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1127: Attachment: PIG-1127-1.patch > Logical operator should contains individual copy of schema object > --

[jira] Created: (PIG-1127) Logical operator should contains individual copy of schema object

2009-12-04 Thread Daniel Dai (JIRA)
Logical operator should contains individual copy of schema object - Key: PIG-1127 URL: https://issues.apache.org/jira/browse/PIG-1127 Project: Pig Issue Type: Bug Affects Ve

[jira] Commented: (PIG-1126) piggybank loaders need to update fieldsToRead function

2009-12-04 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786013#action_12786013 ] Daniel Dai commented on PIG-1126: - +1 > piggybank loaders need to update fieldsToRead functi

[jira] Updated: (PIG-922) Logical optimizer: push up project

2009-12-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-922: --- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch commit

[jira] Updated: (PIG-922) Logical optimizer: push up project

2009-12-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-922: --- Status: Patch Available (was: Open) > Logical optimizer: push up project > -- >

[jira] Updated: (PIG-922) Logical optimizer: push up project

2009-12-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-922: --- Status: Open (was: Patch Available) > Logical optimizer: push up project > -- >

[jira] Updated: (PIG-922) Logical optimizer: push up project

2009-12-03 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-922: --- Attachment: PIG-922-p3_15.patch PIG-922-p3_15.patch is ready to commit to trunk. A tiny change in TestPruneColu

[jira] Updated: (PIG-922) Logical optimizer: push up project

2009-12-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-922: --- Status: Patch Available (was: Open) > Logical optimizer: push up project > -- >

[jira] Updated: (PIG-922) Logical optimizer: push up project

2009-12-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-922: --- Attachment: PIG-922-p3_14.patch Address the review comments from Pradeep. Actually we do not need to do anythin

<    6   7   8   9   10   11   12   13   14   15   >