[jira] Updated: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-970: --- Attachment: hbase-0.18.1-test.jar hbase-0.20.0.jar > Support of HBase 0.20.0 > -

[jira] Updated: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-970: --- Attachment: Pig_HBase_0.20.0.patch > Support of HBase 0.20.0 > --- > > Key:

[jira] Updated: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-970: --- Attachment: zookeeper-hbase-1329.jar > Support of HBase 0.20.0 > --- > > Key

[jira] Updated: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-970: --- Attachment: (was: hbase-0.18.1-test.jar) > Support of HBase 0.20.0 > --- > >

[jira] Updated: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-970: --- Attachment: hbase-0.20.0-test.jar > Support of HBase 0.20.0 > --- > > Key: P

[jira] Assigned: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned PIG-970: -- Assignee: Jeff Zhang > Support of HBase 0.20.0 > --- > > Key: PIG-970

[jira] Updated: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-970: --- Attachment: (was: hbase-0.20.0-test.jar) > Support of HBase 0.20.0 > --- > >

[jira] Updated: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-970: --- Attachment: (was: hbase-0.20.0.jar) > Support of HBase 0.20.0 > --- > >

[jira] Updated: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-970: --- Attachment: (was: zookeeper-hbase-1329.jar) > Support of HBase 0.20.0 > --- > >

[jira] Updated: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-970: --- Attachment: (was: Pig_HBase_0.20.0.patch) > Support of HBase 0.20.0 > --- > >

[jira] Updated: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-970: --- Attachment: hbase-0.20.0-test.jar hbase-0.20.0.jar Pig_HBase_0.20.0.patch > Supp

[jira] Updated: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-970: --- Attachment: zookeeper-hbase-1329.jar > Support of HBase 0.20.0 > --- > > Key

[jira] Commented: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772461#action_12772461 ] Jeff Zhang commented on PIG-970: Vincent, I do not know how you pass TestHBaseStorage using yo

[jira] Updated: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated PIG-970: --- Tags: hbase Fix Version/s: 0.5.0 Status: Patch Available (was: Open) > Support of HBase

[jira] Commented: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772464#action_12772464 ] Hadoop QA commented on PIG-970: --- -1 overall. Here are the results of testing the latest attachm

[jira] Commented: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772465#action_12772465 ] Jeff Zhang commented on PIG-970: this patch works on my machine, but it seems that I have no r

Definition of equality of bags

2009-11-02 Thread Thejas Nair
I could not find any documentation (in piglatin manual) on what the definition of equality of bags is (or what it should be), does the order of tuples in the bag matter ? But the definition of a bag does not imply any ordering. This has implication on the definition of join/cogroup/group on bags.

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

2009-11-02 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772562#action_12772562 ] Daniel Dai commented on PIG-1038: - Hi, Ashutosh, I will look into POForeach and find the firs

[jira] Commented: (PIG-1062) load-store-redesign branch: change SampleLoader and subclasses to work with new LoadFunc interface

2009-11-02 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772565#action_12772565 ] Thejas M Nair commented on PIG-1062: WeightedRangePartitioner.setConf use of fileSize() i

[jira] Created: (PIG-1070) Review Basics link broken under Getting Started

2009-11-02 Thread robert Cook (JIRA)
Review Basics link broken under Getting Started --- Key: PIG-1070 URL: https://issues.apache.org/jira/browse/PIG-1070 Project: Pig Issue Type: Bug Components: site Environment: A

Re: Definition of equality of bags

2009-11-02 Thread Thejas Nair
Looks like the join/cogroup/group is not defined on bags. I assume this is because the equality on bags is not defined. It gives the error in map-reduce mode, but does not in local mode. Since pig is likely to get rid of custom local mode implementation and use hadoop local mode and that should fi

[jira] Commented: (PIG-1062) load-store-redesign branch: change SampleLoader and subclasses to work with new LoadFunc interface

2009-11-02 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772623#action_12772623 ] Thejas M Nair commented on PIG-1062: Even after the interface changes, pig can compute th

[jira] Updated: (PIG-1030) explain and dump not working with two UDFs inside inner plan of foreach

2009-11-02 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1030: Resolution: Fixed Fix Version/s: 0.6.0 Hadoop Flags: [Reviewed] Status: Resolve

[jira] Updated: (PIG-1035) support for skewed outer join

2009-11-02 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Kamath updated PIG-1035: Resolution: Fixed Fix Version/s: 0.6.0 Hadoop Flags: [Reviewed] Status: Resolve

[jira] Commented: (PIG-1062) load-store-redesign branch: change SampleLoader and subclasses to work with new LoadFunc interface

2009-11-02 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772704#action_12772704 ] Thejas M Nair commented on PIG-1062: As indicated in previous comment, I am planning to g

[jira] Updated: (PIG-1026) [zebra] map split returns null

2009-11-02 Thread Chao Wang (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Wang updated PIG-1026: --- Patch reviewed. +1 > [zebra] map split returns null > -- > > Key: PIG

[jira] Commented: (PIG-1062) load-store-redesign branch: change SampleLoader and subclasses to work with new LoadFunc interface

2009-11-02 Thread Sriranjan Manjunath (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772767#action_12772767 ] Sriranjan Manjunath commented on PIG-1062: -- We cannot use counters since load/join w

[jira] Commented: (PIG-1037) better memory layout and spill for sorted and distinct bags

2009-11-02 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772772#action_12772772 ] Alan Gates commented on PIG-1037: - The difference is much more than switching from dumping on

[jira] Commented: (PIG-1038) Optimize nested distinct/sort to use secondary key

2009-11-02 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772774#action_12772774 ] Alan Gates commented on PIG-1038: - I agree that we need a framework for optimizations in the

[jira] Commented: (PIG-970) Support of HBase 0.20.0

2009-11-02 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772781#action_12772781 ] Alan Gates commented on PIG-970: Patch doesn't include binary files. I'll pull together the l

[jira] Commented: (PIG-1062) load-store-redesign branch: change SampleLoader and subclasses to work with new LoadFunc interface

2009-11-02 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772797#action_12772797 ] Dmitriy V. Ryaboy commented on PIG-1062: The sampler (in this design) reads all the d

[jira] Commented: (PIG-1062) load-store-redesign branch: change SampleLoader and subclasses to work with new LoadFunc interface

2009-11-02 Thread Dmitriy V. Ryaboy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772807#action_12772807 ] Dmitriy V. Ryaboy commented on PIG-1062: Thejas: bq. sending a special tuple with nu

two-level access problem?

2009-11-02 Thread Dmitriy Ryaboy
Could someone explain the nature of the "two-level access problem" referred to in the Load/Store redesign wiki and in the DataType code? Thanks, -D

[jira] Commented: (PIG-1037) better memory layout and spill for sorted and distinct bags

2009-11-02 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772890#action_12772890 ] Ashutosh Chauhan commented on PIG-1037: --- Thanks for the explanation, Alan. > better m

[jira] Commented: (PIG-958) Splitting output data on key field

2009-11-02 Thread Ankur (JIRA)
[ https://issues.apache.org/jira/browse/PIG-958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772925#action_12772925 ] Ankur commented on PIG-958: --- Can we have an update on this please ? > Splitting output data on key