Question on custom store function

2011-11-01 Thread felix gao
I have wrote a custom store function that primarily based on the multi-storage store function. They way I use it is store load_log INTO '/Users/felix/Documents/pig/multi_store_output/ns_{0}/site_{1}' using MyMultiStorage('2,1', '1,2'); where {0} and {1} will be substituted with the tuple index a

Sequence File Loader

2011-11-01 Thread Gayatri Rao
Does any one have an example of how to use SequenceFileLoader for writable objects other than IntWritable, LongWritable, Text etc. Thanks Gayatri

Re: pig tutorial step

2011-11-01 Thread Ashutosh Chauhan
Hey Matteo, You can use pig-0.9.1.jar, document is not upto date. Hope it helps, Ashutosh On Mon, Oct 31, 2011 at 14:03, Matteo Moci wrote: > Hello, > I am running for the first time the tutorial at > http://pig.apache.org/docs/r0.9.1/start.html > and found that these lines seem not correct: >

Re: creating a graph over time

2011-11-01 Thread Jonathan Coveney
Okie dokie. So first, let's clarify and simplify the problem a little, especially to ensure that I know what is going on. Let's first just focus on a particular class. This is ok since presumably each class is independent. Now, we have user_id, start_time, and end_time (start_time+duration). If I

Re: creating a graph over time

2011-11-01 Thread Marco Cadetg
Thanks again for all your comments. Jonathan, would you mind to enlighten me on the way you would keep track of the people you need to "eject". I don't get the min heap based tuple... Cheers -Marco On Mon, Oct 31, 2011 at 6:15 PM, Jonathan Coveney wrote: > Perhaps I'm misunderstanding your use

Re: Two-level access in Pig 0.8.1

2011-11-01 Thread Andrew Clegg
Sorry, scratch that question, clearly it doesn't, because I'm using it in 0.8.1 and it's not setting two-level access. Oh well. On 1 November 2011 11:03, Andrew Clegg wrote: > Would it be fair to assume that SchemaUtil.newBagSchema(...) etc. will > do the right thing for whichever version you're

Re: Two-level access in Pig 0.8.1

2011-11-01 Thread Andrew Clegg
Would it be fair to assume that SchemaUtil.newBagSchema(...) etc. will do the right thing for whichever version you're using, without requiring additional manual intervention? On 31 October 2011 23:20, Dmitriy Ryaboy wrote: > Our 0.8-compatible schemas for nested structures stopped working on > 0