RE: Limit on DataBag?

2011-03-19 Thread Dmitriy Ryaboy
Foreach element { Limanchors = limit anchors 10; Generate href, limanchors; } -Original Message- From: "Robert Waddell" To: user@pig.apache.org Sent: 3/19/2011 5:34 AM Subject: Limit on DataBag? Hi There, I have a tuple which consists of : element= {href:chararray, anchors:databag

Re: Hadoop Counters Expensive?

2011-03-19 Thread Harsh J
Two additional counters shouldn't be expensive. But do consider if the already available "map input records" / "(map|reduce) output records" suit your need for such counters. On Sat, Mar 19, 2011 at 4:33 AM, Andreas Paepcke wrote: > I'm writing a load/store pair, and I am considering the use > of

Limit on DataBag?

2011-03-19 Thread Robert Waddell
Hi There, I have a tuple which consists of : element= {href:chararray, anchors:databag} I am aware that I can use the LIMIT operation on this tuple to limit the overall number of "element" instances, but is there a way to limit the number of elements within the databag ("anchors") ? Robert.