[jira] Commented: (PIG-1661) Add alternative search-provider to Pig site

2010-10-01 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12917130#action_12917130 ] Ashutosh Chauhan commented on PIG-1661: --- +1 for experimenting with search-ha

[jira] Updated: (PIG-1531) Pig gobbles up error messages

2010-10-01 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1531: -- Status: Resolved (was: Patch Available) Resolution: Fixed Committed to both trunk and

[jira] Commented: (PIG-1641) Incorrect counters in local mode

2010-09-27 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12915408#action_12915408 ] Ashutosh Chauhan commented on PIG-1641: --- Tested manually for local mode. Messages

[jira] Created: (PIG-1641) Incorrect counters in local mode

2010-09-22 Thread Ashutosh Chauhan (JIRA)
Incorrect counters in local mode Key: PIG-1641 URL: https://issues.apache.org/jira/browse/PIG-1641 Project: Pig Issue Type: Bug Affects Versions: 0.8.0 Reporter: Ashutosh Chauhan User

[jira] Commented: (PIG-1531) Pig gobbles up error messages

2010-09-21 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12913048#action_12913048 ] Ashutosh Chauhan commented on PIG-1531: --- Oh Hudson, oh well... Ran the full suit

[jira] Updated: (PIG-1531) Pig gobbles up error messages

2010-09-19 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1531: -- Attachment: pig-1531_4.patch Added a test-case which fails on trunk. Pig still gobbles up error

[jira] Updated: (PIG-1531) Pig gobbles up error messages

2010-09-19 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1531: -- Status: Patch Available (was: Reopened) > Pig gobbles up error messa

[jira] Reopened: (PIG-1531) Pig gobbles up error messages

2010-09-19 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan reopened PIG-1531: --- Peril of not writing unit test : Resurrection of bug. Argh.. > Pig gobbles up error messa

[jira] Commented: (PIG-1590) Use POMergeJoin for Left Outer Join when join using 'merge'

2010-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905995#action_12905995 ] Ashutosh Chauhan commented on PIG-1590: --- Also inner merge join on more then 2

[jira] Commented: (PIG-1309) Sort Merge Cogroup

2010-09-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905935#action_12905935 ] Ashutosh Chauhan commented on PIG-1309: --- Correct. Condition(1) is implied only

[jira] Commented: (PIG-1598) Pig gobbles up error messages - Part 2

2010-09-02 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905771#action_12905771 ] Ashutosh Chauhan commented on PIG-1598: --- grunt> c = group a by $0 using &#x

[jira] Created: (PIG-1598) Pig gobbles up error messages - Part 2

2010-09-02 Thread Ashutosh Chauhan (JIRA)
Pig gobbles up error messages - Part 2 -- Key: PIG-1598 URL: https://issues.apache.org/jira/browse/PIG-1598 Project: Pig Issue Type: Improvement Reporter: Ashutosh Chauhan Another case of

[jira] Commented: (PIG-1590) Use POMergeJoin for Left Outer Join when join using 'merge'

2010-09-01 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905207#action_12905207 ] Ashutosh Chauhan commented on PIG-1590: --- It will entail changes in POMergeJoin

[jira] Created: (PIG-1590) Use POMergeJoin for Left Outer Join when join using 'merge'

2010-09-01 Thread Ashutosh Chauhan (JIRA)
mprovement Components: impl Affects Versions: 0.8.0 Reporter: Ashutosh Chauhan Priority: Minor C = join A by $0 left, B by $0 using 'merge'; will result in map-side sort merge join. Internally, it will translate to use POMergeCogroup + ForEachFlatten. POMergeCogrou

[jira] Commented: (PIG-1501) need to investigate the impact of compression on pig performance

2010-08-31 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12904843#action_12904843 ] Ashutosh Chauhan commented on PIG-1501: --- If its not backward-incompatible the

[jira] Updated: (PIG-1531) Pig gobbles up error messages

2010-08-30 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1531: -- Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Resolution

[jira] Commented: (PIG-1531) Pig gobbles up error messages

2010-08-30 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12904497#action_12904497 ] Ashutosh Chauhan commented on PIG-1531: --- Niraj ran all the unit tests. All passed

[jira] Updated: (PIG-1531) Pig gobbles up error messages

2010-08-29 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1531: -- Status: Patch Available (was: Open) > Pig gobbles up error messa

[jira] Updated: (PIG-1531) Pig gobbles up error messages

2010-08-29 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1531: -- Attachment: pig-1531_3.patch I took a look of the latest patch. There are two minor problems

[jira] Updated: (PIG-1531) Pig gobbles up error messages

2010-08-29 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1531: -- Status: Open (was: Patch Available) > Pig gobbles up error messa

[jira] Commented: (PIG-1518) multi file input format for loaders

2010-08-27 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903283#action_12903283 ] Ashutosh Chauhan commented on PIG-1518: --- Yan, Sorry for being late on this now t

[jira] Commented: (PIG-1531) Pig gobbles up error messages

2010-08-25 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902576#action_12902576 ] Ashutosh Chauhan commented on PIG-1531: --- * In addition to error Msg, you also nee

[jira] Updated: (PIG-1309) Map-side Cogroup

2010-08-20 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1309: -- Release Note: With this patch, it is now possible to perform map-side cogroup if data is sorted

[jira] Updated: (PIG-1353) Map-side outer joins

2010-08-20 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1353: -- Release Note: With this patch, it is now possible to perform [left|right|full] outer joins on

[jira] Updated: (PIG-1309) Map-side Cogroup

2010-08-20 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1309: -- Release Note: With this patch, it is now possible to perform map-side cogroup if data is sorted

[jira] Commented: (PIG-1486) update ant eclipse-files target to include new jar and remove contrib dirs from build path

2010-08-20 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900768#action_12900768 ] Ashutosh Chauhan commented on PIG-1486: --- meh.. Before testing thou shalt apply

[jira] Resolved: (PIG-533) DBloader UDF (initial prototype)

2010-08-19 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan resolved PIG-533. -- Fix Version/s: 0.8.0 Resolution: Fixed PIG-1229 makes this redundant. > DBloader

[jira] Commented: (PIG-1486) update ant eclipse-files target to include new jar and remove contrib dirs from build path

2010-08-19 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900568#action_12900568 ] Ashutosh Chauhan commented on PIG-1486: --- I did svn co https://svn.apache.org/r

[jira] Commented: (PIG-1420) Make CONCAT act on all fields of a tuple, instead of just the first two fields of a tuple

2010-08-19 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12900566#action_12900566 ] Ashutosh Chauhan commented on PIG-1420: --- > I could not figure out how to re-op

[jira] Commented: (PIG-1518) multi file input format for loaders

2010-08-14 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12898648#action_12898648 ] Ashutosh Chauhan commented on PIG-1518: --- This feature of combining multiple sp

[jira] Commented: (PIG-1229) allow pig to write output into a JDBC db

2010-08-04 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12895330#action_12895330 ] Ashutosh Chauhan commented on PIG-1229: --- Tested and it worked. Committed. Thanks A

[jira] Commented: (PIG-1404) PigUnit - Pig script testing simplified.

2010-08-04 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12895318#action_12895318 ] Ashutosh Chauhan commented on PIG-1404: --- bq. 3. (This one is for other pig develo

[jira] Commented: (PIG-1229) allow pig to write output into a JDBC db

2010-08-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894963#action_12894963 ] Ashutosh Chauhan commented on PIG-1229: --- I am still getting the same exception {

[jira] Commented: (PIG-1516) finalize in bag implementations causes pig to run out of memory in reduce

2010-08-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894945#action_12894945 ] Ashutosh Chauhan commented on PIG-1516: --- +1. Changes look good. > finalize

[jira] Commented: (PIG-1531) Pig gobbles up error messages

2010-08-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894935#action_12894935 ] Ashutosh Chauhan commented on PIG-1531: --- Another instance where it happens is

[jira] Commented: (PIG-1531) Pig gobbles up error messages

2010-07-31 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894320#action_12894320 ] Ashutosh Chauhan commented on PIG-1531: --- This is because in InputOutputFileVis

[jira] Created: (PIG-1531) Pig gobbles up error messages

2010-07-31 Thread Ashutosh Chauhan (JIRA)
Pig gobbles up error messages - Key: PIG-1531 URL: https://issues.apache.org/jira/browse/PIG-1531 Project: Pig Issue Type: Bug Affects Versions: 0.7.0 Reporter: Ashutosh Chauhan Fix

[jira] Resolved: (PIG-1528) Enable use of similar aliases when doing a join :(ERROR 1108: Duplicate schema alias:)

2010-07-30 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan resolved PIG-1528. --- Resolution: Duplicate Duplicate of PIG-859 > Enable use of similar aliases when doing a j

[jira] Updated: (PIG-1229) allow pig to write output into a JDBC db

2010-07-27 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1229: -- Status: Resolved (was: Patch Available) Resolution: Fixed Changes look good. Core test

[jira] Commented: (PIG-1229) allow pig to write output into a JDBC db

2010-07-26 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12892378#action_12892378 ] Ashutosh Chauhan commented on PIG-1229: --- Since fix to PIG-1424 doesnt look stra

[jira] Commented: (PIG-928) UDFs in scripting languages

2010-07-21 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12890840#action_12890840 ] Ashutosh Chauhan commented on PIG-928: -- Thanks, Aniket for making those changes.

[jira] Commented: (PIG-928) UDFs in scripting languages

2010-07-21 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12890845#action_12890845 ] Ashutosh Chauhan commented on PIG-928: -- Addendum: * Also what will happen if

[jira] Commented: (PIG-1487) Replace "bz" with ".bz" in all the LoadFunc

2010-07-13 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888182#action_12888182 ] Ashutosh Chauhan commented on PIG-1487: --- +1 > Replace "bz" with

[jira] Commented: (PIG-928) UDFs in scripting languages

2010-07-13 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888100#action_12888100 ] Ashutosh Chauhan commented on PIG-928: -- * Do you want to allow: {{regi

Re: Add "deepCopy" in LogicalExpression

2010-07-13 Thread Ashutosh Chauhan
You are now charting into danger zone :) I tried doing something similar when we were trying to add similar kind of logical optimizations to Pig but was not able to get my head around it that time. My attempt to it is at: https://issues.apache.org/jira/browse/PIG-1073 But then I might be too naive

[jira] Commented: (PIG-1486) update ant eclipse-files target to include new jar and remove contrib dirs from build path

2010-07-13 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887885#action_12887885 ] Ashutosh Chauhan commented on PIG-1486: --- Took a look at the patch. Changes look

[jira] Commented: (PIG-1249) Safe-guards against misconfigured Pig scripts without PARALLEL keyword

2010-07-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887283#action_12887283 ] Ashutosh Chauhan commented on PIG-1249: --- Map-reduce framework has a jira relate

[jira] Commented: (PIG-1491) Failure planning nested FOREACH with DISTINCT, POLoad cannot be cast to POLocalRearrange

2010-07-09 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12886906#action_12886906 ] Ashutosh Chauhan commented on PIG-1491: --- Scott, It will be useful if you can

[jira] Commented: (PIG-1389) Implement Pig counter to track number of rows for each input files

2010-07-09 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12886904#action_12886904 ] Ashutosh Chauhan commented on PIG-1389: --- +1 Discussed about 3) with Richard off

[jira] Updated: (PIG-1309) Map-side Cogroup

2010-07-09 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1309: -- Status: Resolved (was: Patch Available) Resolution: Fixed Patch checked-in to 0.7

[jira] Commented: (PIG-1463) Replace "bz" with ".bz" in setStoreLocation in PigStorage

2010-07-07 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885997#action_12885997 ] Ashutosh Chauhan commented on PIG-1463: --- Jeff, Similar problem exist

[jira] Updated: (PIG-1309) Map-side Cogroup

2010-07-02 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1309: -- Attachment: PIG_1309_7.patch Backport of merge cogroup for 0.7 branch. Since, hudson can test

[jira] Commented: (PIG-1449) RegExLoader hangs on lines that don't match the regular expression

2010-07-01 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884552#action_12884552 ] Ashutosh Chauhan commented on PIG-1449: --- @Christian, It would definitely be usefu

[jira] Updated: (PIG-1449) RegExLoader hangs on lines that don't match the regular expression

2010-07-01 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1449: -- Status: Resolved (was: Patch Available) Fix Version/s: 0.8.0 Resolution: Fixed

[jira] Commented: (PIG-1449) RegExLoader hangs on lines that don't match the regular expression

2010-07-01 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884551#action_12884551 ] Ashutosh Chauhan commented on PIG-1449: --- Reran the contrib tests. All passed. P

[jira] Updated: (PIG-1449) RegExLoader hangs on lines that don't match the regular expression

2010-07-01 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1449: -- Status: Open (was: Patch Available) > RegExLoader hangs on lines that don't match the

[jira] Updated: (PIG-1449) RegExLoader hangs on lines that don't match the regular expression

2010-07-01 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1449: -- Status: Patch Available (was: Open) Running through Hudson. > RegExLoader hangs on lines t

[jira] Commented: (PIG-1424) Error logs of streaming should not be placed in output location

2010-07-01 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884365#action_12884365 ] Ashutosh Chauhan commented on PIG-1424: --- This turns out to be much more involved

[jira] Commented: (PIG-1389) Implement Pig counter to track number of rows for each input files

2010-06-30 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12884116#action_12884116 ] Ashutosh Chauhan commented on PIG-1389: --- 1. {code} +/** + * Returns

[jira] Commented: (PIG-1389) Implement Pig counter to track number of rows for each input files

2010-06-28 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12883247#action_12883247 ] Ashutosh Chauhan commented on PIG-1389: --- In cases of Merge Join and Merge Cog

[jira] Commented: (PIG-1470) map/red jobs fail using G1 GC (Couldn't find heap)

2010-06-28 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12883205#action_12883205 ] Ashutosh Chauhan commented on PIG-1470: --- This is actually a bug in G1.

[jira] Created: (PIG-1466) Improve log messages for memory usage

2010-06-25 Thread Ashutosh Chauhan (JIRA)
Reporter: Ashutosh Chauhan Priority: Minor For anything more then a moderately sized dataset Pig usually spits following messages: {code} 2010-05-27 18:28:31,659 INFO org.apache.pig.impl.util.SpillableMemoryManager: low memory handler called (Usage threshold exceeded) init

[jira] Commented: (PIG-1463) Replace "bz" with ".bz" in setStoreLocation in PigStorage

2010-06-23 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12882017#action_12882017 ] Ashutosh Chauhan commented on PIG-1463: --- +1 > Replace "bz&qu

[jira] Commented: (PIG-1462) No informative error message on parse problem

2010-06-22 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881550#action_12881550 ] Ashutosh Chauhan commented on PIG-1462: --- This has come up before. As noted on PIG

[jira] Commented: (PIG-1461) support union operation that merges based on column names

2010-06-22 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881474#action_12881474 ] Ashutosh Chauhan commented on PIG-1461: --- w.r.t language I think {code} U = unio

[jira] Commented: (PIG-1427) Monitor and kill runaway UDFs

2010-06-21 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12880881#action_12880881 ] Ashutosh Chauhan commented on PIG-1427: --- It seems you missed out ivy.xml bits in

Re: the last job in the mapreduce plan

2010-06-16 Thread Ashutosh Chauhan
:20, Gang Luo wrote: > Thanks for replying. Actually, I didn't observe such thing happen in pig now. > But one of the operators I implement in Pig requires to end the current MR > operator afterwards. That issue may happen in my case. > > -Gang > > > > - 原始邮件 -

Re: the last job in the mapreduce plan

2010-06-15 Thread Ashutosh Chauhan
Gang, What you are saying can never happen because we create a new MR operator only when we have a blocking operator which needs to go in the next MR operator. We dont create new MR operator apriori without looking at next physical operator in the pipeline. If you are seeing this happening, I woul

[jira] Commented: (PIG-1449) RegExLoader hangs on lines that don't match the regular expression

2010-06-14 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12878663#action_12878663 ] Ashutosh Chauhan commented on PIG-1449: --- Justin, Good catch. Can you assimilate

[jira] Commented: (PIG-1442) java.lang.OutOfMemoryError: Java heap space (Reopen of PIG-766)

2010-06-12 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12878336#action_12878336 ] Ashutosh Chauhan commented on PIG-1442: --- This looks like a variant of PIG-1446 and

[jira] Commented: (PIG-1448) Detach tuple from inner plans of physical operator

2010-06-12 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12878294#action_12878294 ] Ashutosh Chauhan commented on PIG-1448: --- Problem here is not as bad as it may s

[jira] Created: (PIG-1448) Detach tuple from inner plans of physical operator

2010-06-12 Thread Ashutosh Chauhan (JIRA)
Versions: 0.7.0, 0.6.0, 0.5.0, 0.4.0, 0.3.0, 0.2.0, 0.1.0 Reporter: Ashutosh Chauhan Fix For: 0.8.0 This is a follow-up on PIG-1446 which only addresses this general problem for a specific instance of For Each. In general, all the physical operators which can have inner

[jira] Updated: (PIG-1446) OOME in a query having a bincond in the inner plan of a Foreach.

2010-06-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1446: -- Status: Resolved (was: Patch Available) Fix Version/s: 0.8.0 0.7.0

[jira] Commented: (PIG-1428) Add getPigStatusReporter() to PigHadoopLogger

2010-06-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12877591#action_12877591 ] Ashutosh Chauhan commented on PIG-1428: --- So, I read through PIG-889. It seems

[jira] Commented: (PIG-1428) Add getPigStatusReporter() to PigHadoopLogger

2010-06-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12877616#action_12877616 ] Ashutosh Chauhan commented on PIG-1428: --- I propose a slightly different approach

[jira] Updated: (PIG-1446) OOME in a query having a bincond in the inner plan of a Foreach.

2010-06-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1446: -- Status: Patch Available (was: Open) > OOME in a query having a bincond in the inner plan o

[jira] Updated: (PIG-1446) OOME in a query having a bincond in the inner plan of a Foreach.

2010-06-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1446: -- Attachment: pig-1446.patch Sequence of event is as follows: 1) MultiQuery optimizer combined 30

[jira] Assigned: (PIG-1446) OOME in a query having a bincond in the inner plan of a Foreach.

2010-06-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan reassigned PIG-1446: - Assignee: Ashutosh Chauhan > OOME in a query having a bincond in the inner plan o

[jira] Created: (PIG-1446) OOME in a query having a bincond in the inner plan of a Foreach.

2010-06-10 Thread Ashutosh Chauhan (JIRA)
Versions: 0.7.0 Reporter: Ashutosh Chauhan This is seen when For Each is following a group-by and there is a bin cond as an inner plan of For Each. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Commented: (PIG-1438) [Performance] MultiQueryOptimizer should also merge DISTINCT jobs

2010-06-09 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12877150#action_12877150 ] Ashutosh Chauhan commented on PIG-1438: --- +1 please commit. > [Perf

[jira] Commented: (PIG-1427) Monitor and kill runaway UDFs

2010-06-08 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876763#action_12876763 ] Ashutosh Chauhan commented on PIG-1427: --- @Dmitriy, Occupied with some work. Will

[jira] Closed: (PIG-283) Allow to set arbitrary jobconf key-value pairs inside pig program

2010-06-04 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan closed PIG-283. > Allow to set arbitrary jobconf key-value pairs inside pig prog

[jira] Updated: (PIG-283) Allow to set arbitrary jobconf key-value pairs inside pig program

2010-06-04 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-283: - Status: Resolved (was: Patch Available) Release Note: For documentation: After this

[jira] Commented: (PIG-1437) [Optimization] Rewrite GroupBy-Foreach-flatten(group) to Distinct

2010-06-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12875481#action_12875481 ] Ashutosh Chauhan commented on PIG-1437: --- Since this is logical transformation of q

[jira] Updated: (PIG-1437) [Optimization] Rewrite GroupBy-Foreach-flatten(group) to Distinct

2010-06-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-1437: -- Release Note: (was: Its possible to rewrite queries like this {code} A = load 'data'

[jira] Created: (PIG-1437) [Optimization] Rewrite GroupBy-Foreach-flatten(group) to Distinct

2010-06-03 Thread Ashutosh Chauhan (JIRA)
Components: impl Affects Versions: 0.7.0 Reporter: Ashutosh Chauhan Priority: Minor -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Commented: (PIG-1433) pig should create success file if mapreduce.fileoutputcommitter.marksuccessfuljobs is true

2010-06-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12875326#action_12875326 ] Ashutosh Chauhan commented on PIG-1433: --- My point was to have all constant string

[jira] Commented: (PIG-1433) pig should create success file if mapreduce.fileoutputcommitter.marksuccessfuljobs is true

2010-06-03 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12875319#action_12875319 ] Ashutosh Chauhan commented on PIG-1433: --- +1 for the commit. couple of notes for fu

[jira] Commented: (PIG-283) Allow to set arbitrary jobconf key-value pairs inside pig program

2010-05-28 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12873095#action_12873095 ] Ashutosh Chauhan commented on PIG-283: -- Seems hudson didn't fully recover from

[jira] Commented: (PIG-1427) Monitor and kill runaway UDFs

2010-05-27 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872862#action_12872862 ] Ashutosh Chauhan commented on PIG-1427: --- * Filed PIG-1428 for it. * Neat workar

[jira] Updated: (PIG-283) Allow to set arbitrary jobconf key-value pairs inside pig program

2010-05-27 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-283: - Status: Patch Available (was: Open) Affects Version/s: 0.7.0 Fix Version/s

[jira] Created: (PIG-1428) Add getPigStatusReporter() to PigHadoopLogger

2010-05-27 Thread Ashutosh Chauhan (JIRA)
: Ashutosh Chauhan Fix For: 0.8.0 Without this getter method, its not possible to get counters, report progress etc. from UDFs. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Assigned: (PIG-283) Allow to set arbitrary jobconf key-value pairs inside pig program

2010-05-27 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan reassigned PIG-283: Assignee: Ashutosh Chauhan > Allow to set arbitrary jobconf key-value pairs inside

[jira] Updated: (PIG-283) Allow to set arbitrary jobconf key-value pairs inside pig program

2010-05-27 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated PIG-283: - Attachment: pig-282.patch Patch as suggested in previous comment. This will let user to add

[jira] Commented: (PIG-283) Allow to set arbitrary jobconf key-value pairs inside pig program

2010-05-27 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872315#action_12872315 ] Ashutosh Chauhan commented on PIG-283: -- Proposal here is as suggested in the descrip

[jira] Commented: (PIG-1427) Monitor and kill runaway UDFs

2010-05-27 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872303#action_12872303 ] Ashutosh Chauhan commented on PIG-1427: --- 1. You didnt pay heed to my request

[jira] Commented: (PIG-1427) Monitor and kill runaway UDFs

2010-05-26 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12872031#action_12872031 ] Ashutosh Chauhan commented on PIG-1427: --- A useful feature. Couple of comments

[jira] Commented: (PIG-1424) Error logs of streaming should not be placed in output location

2010-05-26 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871902#action_12871902 ] Ashutosh Chauhan commented on PIG-1424: --- Till we figure out a proper solution for

[jira] Commented: (PIG-1347) Clear up output directory for a failed job

2010-05-26 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871862#action_12871862 ] Ashutosh Chauhan commented on PIG-1347: --- Patch is pretty straightforward and harm

[jira] Commented: (PIG-928) UDFs in scripting languages

2010-05-25 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12871448#action_12871448 ] Ashutosh Chauhan commented on PIG-928: -- Arnab, Thanks for putting together a patch

  1   2   3   4   5   >