[jira] Commented: (PIG-506) Does pig need a NATIVE keyword?

2010-08-26 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903263#action_12903263 ] Daniel Dai commented on PIG-506: Patch looks good. One minor comment, PlanHelper.LoadStoreFind

[jira] Updated: (PIG-1426) Change the size of Tuple from Int to VInt when Serialize Tuple

2010-08-26 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-1426: Status: Resolved (was: Patch Available) Resolution: Won't Fix This issue is similar with PIG-1472 wh

[jira] Updated: (PIG-1562) Fix the version for the dependent packages for the maven

2010-08-26 Thread niraj rai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] niraj rai updated PIG-1562: --- Attachment: PIG_1562_0.patch This patch has fix for the version issue of the required packages. > Fix the vers

[jira] Updated: (PIG-1343) pig_log file missing even though Main tells it is creating one and an M/R job fails

2010-08-26 Thread niraj rai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] niraj rai updated PIG-1343: --- Attachment: PIG_1343_5.patch > pig_log file missing even though Main tells it is creating one and an M/R job >

Re: Pig Contributor meeting notes

2010-08-26 Thread Jeff Zhang
BTW, actually Dmitriy has invited me to join this meeting through skype, but it's pity that I have no time to join it this time. On Thu, Aug 26, 2010 at 6:15 PM, Jeff Zhang wrote: > Alan, > > That's great, next time I will try to join the contributor meeting. > > On Thu, Aug 26, 2010 at 11:35 AM

Re: Pig Contributor meeting notes

2010-08-26 Thread Jeff Zhang
Alan, That's great, next time I will try to join the contributor meeting. On Thu, Aug 26, 2010 at 11:35 AM, Alan Gates wrote: > > On Aug 26, 2010, at 12:55 AM, Jeff Zhang wrote: > >> Wonderful, Dmitriy, It's pity for me missing the contributor meeting. >> And any ppt shared ? > > Jeff, > > We do

[jira] Commented: (PIG-1565) additional piggybank datetime and string UDFs

2010-08-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903174#action_12903174 ] Alan Gates commented on PIG-1565: - [exec] +1 overall. [exec] [exec] +1 @au

[jira] Updated: (PIG-506) Does pig need a NATIVE keyword?

2010-08-26 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated PIG-506: -- Attachment: PIG-506.3.patch Updated patch, earlier patch was missing src/org/apache/pig/newplan/logical/r

[jira] Commented: (PIG-1565) additional piggybank datetime and string UDFs

2010-08-26 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903140#action_12903140 ] Dmitriy V. Ryaboy commented on PIG-1565: Please note that there's an outstanding patc

[jira] Commented: (PIG-1564) add support for multiple filesystems

2010-08-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903128#action_12903128 ] Alan Gates commented on PIG-1564: - We do intend to remove it, though at the moment there is n

[jira] Updated: (PIG-1343) pig_log file missing even though Main tells it is creating one and an M/R job fails

2010-08-26 Thread niraj rai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] niraj rai updated PIG-1343: --- Attachment: pig_1343_4.patch > pig_log file missing even though Main tells it is creating one and an M/R job >

[jira] Updated: (PIG-1565) additional piggybank datetime and string UDFs

2010-08-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated PIG-1565: Fix Version/s: 0.8.0 > additional piggybank datetime and string UDFs > --

[jira] Assigned: (PIG-1565) additional piggybank datetime and string UDFs

2010-08-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates reassigned PIG-1565: --- Assignee: Andrew Hitchcock > additional piggybank datetime and string UDFs > --

[jira] Commented: (PIG-1565) additional piggybank datetime and string UDFs

2010-08-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903123#action_12903123 ] Alan Gates commented on PIG-1565: - Comments # ErrorCatchingBase swallows any non-ExecExceptio

[jira] Commented: (PIG-1518) multi file input format for loaders

2010-08-26 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903102#action_12903102 ] Yan Zhou commented on PIG-1518: --- It is not combinable if the loader is a CollectableLoadFunc AN

[jira] Updated: (PIG-1343) pig_log file missing even though Main tells it is creating one and an M/R job fails

2010-08-26 Thread niraj rai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] niraj rai updated PIG-1343: --- Attachment: (was: pig_1343_3.patch) > pig_log file missing even though Main tells it is creating one and an

[jira] Updated: (PIG-1458) aggregate files for replicated join

2010-08-26 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding updated PIG-1458: -- Attachment: PIG-1458.patch This patch uses the new multi-file-combiner (PIG-1518) to concatenate many sm

[jira] Updated: (PIG-1343) pig_log file missing even though Main tells it is creating one and an M/R job fails

2010-08-26 Thread niraj rai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] niraj rai updated PIG-1343: --- Status: Open (was: Patch Available) > pig_log file missing even though Main tells it is creating one and an M/

[jira] Updated: (PIG-1343) pig_log file missing even though Main tells it is creating one and an M/R job fails

2010-08-26 Thread niraj rai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] niraj rai updated PIG-1343: --- Attachment: pig_1343_3.patch > pig_log file missing even though Main tells it is creating one and an M/R job >

[jira] Commented: (PIG-1399) Logical Optimizer: Expression optimizor rule

2010-08-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903084#action_12903084 ] Alan Gates commented on PIG-1399: - Comments # Your extensive comment in the JIRA (https://i

[jira] Commented: (PIG-1343) pig_log file missing even though Main tells it is creating one and an M/R job fails

2010-08-26 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903072#action_12903072 ] Richard Ding commented on PIG-1343: --- The new patch logs NPE instead of the intended messag

[jira] Commented: (PIG-1205) Enhance HBaseStorage-- Make it support loading row key and implement StoreFunc

2010-08-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903043#action_12903043 ] Alan Gates commented on PIG-1205: - Comments # As discussed previously, LoadStoreCaster shoul

[jira] Assigned: (PIG-1569) java properties not honored in case of properties such as stop.on.failure

2010-08-26 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding reassigned PIG-1569: - Assignee: Richard Ding > java properties not honored in case of properties such as stop.on.failure

[jira] Commented: (PIG-1518) multi file input format for loaders

2010-08-26 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12903031#action_12903031 ] Dmitriy V. Ryaboy commented on PIG-1518: This is a great feature, thanks Yan. Could

[jira] Updated: (PIG-1555) [piggybank] add CSV Loader

2010-08-26 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-1555: --- Status: Resolved (was: Patch Available) Release Note: CSVLoader can be used to load

[jira] Updated: (PIG-1343) pig_log file missing even though Main tells it is creating one and an M/R job fails

2010-08-26 Thread niraj rai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] niraj rai updated PIG-1343: --- Attachment: pig_1343_2.patch Implemented the interactive mode logging as well. > pig_log file missing even tho

[jira] Updated: (PIG-1343) pig_log file missing even though Main tells it is creating one and an M/R job fails

2010-08-26 Thread niraj rai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] niraj rai updated PIG-1343: --- Status: Open (was: Patch Available) > pig_log file missing even though Main tells it is creating one and an M/

[jira] Updated: (PIG-1343) pig_log file missing even though Main tells it is creating one and an M/R job fails

2010-08-26 Thread niraj rai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] niraj rai updated PIG-1343: --- Status: Patch Available (was: Open) > pig_log file missing even though Main tells it is creating one and an M/

Re: Added Pig to the list of projects on Cloudera's public ReviewBoard instance

2010-08-26 Thread Dmitriy Ryaboy
Thanks Carl! On Thu, Aug 26, 2010 at 1:08 AM, Carl Steinbach wrote: > Hi, > > I added Pig to the list of projects that can be reviewed on Cloudera's > public > ReviewBoard instance, located at http://review.cloudera.org (AKA > review.hbase.org). > > Review requests and comments are automatically

Re: Pig Contributor meeting notes

2010-08-26 Thread Alan Gates
On Aug 26, 2010, at 12:55 AM, Jeff Zhang wrote: Wonderful, Dmitriy, It's pity for me missing the contributor meeting. And any ppt shared ? Jeff, We don't want to exclude our contributors who don't happen to live in the San Francisco Bay Area. If we could include you via Skype or some ot

Re: Pig optimizer

2010-08-26 Thread Daniel Dai
Hi, Renato, I think you are talking about how we organize different operators into map-reduce jobs. Unfortunately there is no document currently. Basically we will put as much operators into one map-reduce job as possible. Co-group/Group, Join, Order, Distinct, Cross, Stream will create a map-

[jira] Resolved: (PIG-1518) multi file input format for loaders

2010-08-26 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Ding resolved PIG-1518. --- Hadoop Flags: [Reviewed] Resolution: Fixed Patch is committed to trunk. Thanks Yan. > multi file

[jira] Assigned: (PIG-1573) PIG shouldn't pass all input to a UDF if the UDF specify no argument

2010-08-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned PIG-1573: Assignee: Xuefu Zhang > PIG shouldn't pass all input to a UDF if the UDF specify no argument > --

[jira] Created: (PIG-1573) PIG shouldn't pass all input to a UDF if the UDF specify no argument

2010-08-26 Thread Xuefu Zhang (JIRA)
PIG shouldn't pass all input to a UDF if the UDF specify no argument Key: PIG-1573 URL: https://issues.apache.org/jira/browse/PIG-1573 Project: Pig Issue Type: Bug Affe

[jira] Updated: (PIG-1568) Optimization rule FilterAboveForeach is too restrictive and doesn't handle project * correctly

2010-08-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-1568: - Status: Patch Available (was: Open) Regenerate the patch after fixing failed test case. The test case itse

[jira] Commented: (PIG-1564) add support for multiple filesystems

2010-08-26 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902952#action_12902952 ] Richard Ding commented on PIG-1564: --- Hi Andrew, HDataStorage is a thin layer on top of Had

[jira] Updated: (PIG-1568) Optimization rule FilterAboveForeach is too restrictive and doesn't handle project * correctly

2010-08-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-1568: - Attachment: jira-1568-1.patch > Optimization rule FilterAboveForeach is too restrictive and doesn't handle

[jira] Updated: (PIG-1568) Optimization rule FilterAboveForeach is too restrictive and doesn't handle project * correctly

2010-08-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated PIG-1568: - Status: Open (was: Patch Available) > Optimization rule FilterAboveForeach is too restrictive and doesn't

[jira] Updated: (PIG-1518) multi file input format for loaders

2010-08-26 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Zhou updated PIG-1518: -- Attachment: PIG-1518.patch rebased on the latest trunk > multi file input format for loaders > -

[jira] Created: (PIG-1572) change default datatype when relations are used as scalar to bytearray

2010-08-26 Thread Thejas M Nair (JIRA)
change default datatype when relations are used as scalar to bytearray -- Key: PIG-1572 URL: https://issues.apache.org/jira/browse/PIG-1572 Project: Pig Issue Type: Bug

[jira] Updated: (PIG-1501) need to investigate the impact of compression on pig performance

2010-08-26 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated PIG-1501: --- Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Resolution: Fixed Pat

Re: Pig Contributor meeting notes

2010-08-26 Thread Russell Jurney
Slides about Azkaban and Pig: http://www.slideshare.net/rjurney/azkaban-pig-5057793 On Thu, Aug 26, 2010 at 12:55 AM, Jeff Zhang wrote: > Wonderful, Dmitriy, It's pity for me missing the contributor meeting. > And any ppt shared ? > > > > On Wed, Aug 25, 2010 at 8:32 PM, Dmitriy Ryaboy > wrote:

[jira] Commented: (PIG-1570) native mapreduce operator MR job does not follow same failure handling logic as other pig MR jobs

2010-08-26 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902919#action_12902919 ] Thejas M Nair commented on PIG-1570: Another thing to investigate (somewhat related) - th

[jira] Updated: (PIG-506) Does pig need a NATIVE keyword?

2010-08-26 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated PIG-506: -- Attachment: PIG-506.2.patch PIG-506.2.patch has - Changes to get mapreduce operator working with new logic

[jira] Created: (PIG-1571) add a compile time check to see if the output file of native mapreduce operator exists

2010-08-26 Thread Thejas M Nair (JIRA)
add a compile time check to see if the output file of native mapreduce operator exists -- Key: PIG-1571 URL: https://issues.apache.org/jira/browse/PIG-1571 Project: P

[jira] Created: (PIG-1570) native mapreduce operator MR job does not follow same failure handling logic as other pig MR jobs

2010-08-26 Thread Thejas M Nair (JIRA)
native mapreduce operator MR job does not follow same failure handling logic as other pig MR jobs - Key: PIG-1570 URL: https://issues.apache.org/jira/browse/PIG-1570

Re: Pig optimizer

2010-08-26 Thread Renato Marroquín Mogrovejo
Anyone, please? Renato M. 2010/8/24 Renato Marroquín Mogrovejo > Hi Daniel, > > Thanks, but that was not what I was actually looking. What I want to know > is for example, how the optimizer work when the bags' logical plans are > combined, or if all commands are reduced at the end to CO-GROUP c

[jira] Updated: (PIG-1518) multi file input format for loaders

2010-08-26 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Zhou updated PIG-1518: -- Attachment: PIG-1518.patch > multi file input format for loaders > --- > >

[jira] Updated: (PIG-1501) need to investigate the impact of compression on pig performance

2010-08-26 Thread Yan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Zhou updated PIG-1501: -- Status: Patch Available (was: Open) This feature will save HDFS space used to store the intermediate data used b

[jira] Created: (PIG-1569) java properties not honored in case of properties such as stop.on.failure

2010-08-26 Thread Thejas M Nair (JIRA)
java properties not honored in case of properties such as stop.on.failure - Key: PIG-1569 URL: https://issues.apache.org/jira/browse/PIG-1569 Project: Pig Issue Type: Bu

Added Pig to the list of projects on Cloudera's public ReviewBoard instance

2010-08-26 Thread Carl Steinbach
Hi, I added Pig to the list of projects that can be reviewed on Cloudera's public ReviewBoard instance, located at http://review.cloudera.org (AKA review.hbase.org). Review requests and comments are automatically forwarded to the pig-dev mailing list, and they also get posted back to the original

Re: Pig Contributor meeting notes

2010-08-26 Thread Jeff Zhang
Wonderful, Dmitriy, It's pity for me missing the contributor meeting. And any ppt shared ? On Wed, Aug 25, 2010 at 8:32 PM, Dmitriy Ryaboy wrote: > Twitter hosted this month's Pig contributor meeting. > Developers from Yahoo, Twitter, LinkedIn, RichRelevance, and Cloudera were > present. > > 1.

[jira] Commented: (PIG-1508) Make 'docs' target (forrest) work with Java 1.6

2010-08-26 Thread HBase Review Board (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902767#action_12902767 ] HBase Review Board commented on PIG-1508: - Message from: "Carl Steinbach" -

Review Request: PIG-1508: Make 'docs' target (forrest) work with Java 1.6

2010-08-26 Thread Carl Steinbach
--- This is an automatically generated e-mail. To reply, visit: http://review.cloudera.org/r/725/ --- Review request for Pig Developers. Summary --- Remove Pig's dependency on Ja