Re: ovoid "::" schema spec after join?

2012-10-11 Thread TianYi Zhu
Hi Yang, You can use the them without prefix if there's no conflict. Thanks, TianYi On Fri, Oct 12, 2012 at 9:31 AM, Yang wrote: > whenever after I do a C= JOIN A,B > then if I want to refer to some fields, I'd have to specify > A::field1 A::field2 B::field3 B::field4 > > supposedly if the f

question

2012-10-11 Thread jamal sasha
> >I have a data file in format > > > > User, movie, price > > 123,abc,22.2 > > 123,daw,39 > > 123,abc,99 ß Note that the user and movie is same but price is different > > > > I want to generate a pig script where I am counting how many times a user has rented a particular movie > > > > > > in

Re: Hadoop Job History Loader with PIG

2012-10-11 Thread Cheolsoo Park
Hi Nebojsa, You're absolutely right. CDH4.x compiles everything against hadoop-2.0.x, so HadoopJobHistoryLoader is excluded. Thank you very much for pointing that out. This is a packaging bug as I see it, and I am going to get it fixed in next release. In the meantime, could you apply the patch t

Re: Non static nested Algebraic functions and their constructor

2012-10-11 Thread Dmitriy Ryaboy
Yeah.. Joys of reflection. Note that if you are writing algebraics against pig 0.11 you probably want to extend AlgebraicEvalFunc -- that gives you the normal exec() and the accumulative implementation for free. D On Wed, Oct 10, 2012 at 10:20 AM, Ugljesa Stojanovic wrote: > Yeah i managed to fi

NEED HELP in PigStorage

2012-10-11 Thread yogesh dhari
Hi All , How to load it using PigStorage Please find the attachment, if I do copy paste of row here then it shows blank boxes between columns. but if I open that file these boxes having 00 01 kind of some numbering inside the the boxes. 7timesascent.in2008-08-27truefalsefalse1 8goog

Re: There's nothing like an "#include" statement for splicing common text into a pig script, right?

2012-10-11 Thread Alan Gates
See http://pig.apache.org/docs/r0.10.0/cont.html#import-macros Alan. On Oct 11, 2012, at 7:36 AM, Trager Corey wrote: > Several scripts start by loading the same file. I'd like to have the text > for the field names and types in one place. Doable? > > > The i

There's nothing like an "#include" statement for splicing common text into a pig script, right?

2012-10-11 Thread Trager Corey
Several scripts start by loading the same file. I'd like to have the text for the field names and types in one place. Doable? The information contained in this communication may be CONFIDENTIAL and is intended only for the use of the recipient(s) named above. I

Re: NEED HELP in PigStorage

2012-10-11 Thread Prashant Kommireddi
Hi Yogesh, Attachments don't come through. You would need to use pastebin or something like that to show your example file. On Thu, Oct 11, 2012 at 9:56 AM, yogesh dhari wrote: > Hello all, > > Please help me how to* store this kind of file using PigStorage,* > > *Please find the attachment of

NEED HELP in PigStorage

2012-10-11 Thread yogesh dhari
Hello all, Please help me how to store this kind of file using PigStorage, Please find the attachment of the file format, this file is generated by using insert overwrite local directory '/home/yogesh/Downloads/demoyy' select * from NYSE_LOCAL; Thanks & Regards Yogesh Kumar

Re: Hadoop Job History Loader with PIG

2012-10-11 Thread Zebeljan, Nebojsa
Hi Cheolsoo, I've found the reason why the "HadoopJobHistoryLoader" is not available. In clouderas distro the class is excluded when building the piggybank -> ./contrib/piggybank/java/build.xml -> ./cloudera/patches/0001-CLOUDERA-BUILD.-CDHifying-Pig-0.9.1-build.patch ---

Re: Hadoop Job History Loader with PIG

2012-10-11 Thread Zebeljan, Nebojsa
Hi Cheolsoo, Yes, I've registered the piggybank jar in the pig script - see script below. --- REGISTER /usr/lib/pig/contrib/piggybank/java/piggybank.jar a = load '/some_dir/some_aggregation/_logs/history' using HadoopJobHistoryLoader() as (j:map[], m:map[], r:map[]); b = foreach a generate j#'PIG