Re: query on DiffDate

2011-08-18 Thread ipshita chatterji
Thanks a tonne. It works. :-) On Fri, Aug 19, 2011 at 11:19 AM, Daniel Dai wrote: > You need to pass two chararray instead of the tuple: > tooutput = FOREACH A GENERATE > org.apache.pig.piggybank.evaluation.datetime.DiffDate(t1.t1a, t1.t1b) > AS diffrerence:int; > > Daniel > > On Thu, Aug 18

Re: query on DiffDate

2011-08-18 Thread Daniel Dai
You need to pass two chararray instead of the tuple: tooutput = FOREACH A GENERATE org.apache.pig.piggybank.evaluation.datetime.DiffDate(t1.t1a, t1.t1b) AS diffrerence:int; Daniel On Thu, Aug 18, 2011 at 9:05 PM, ipshita chatterji wrote: > Hi Folks, > > I am very new to PIG. I am facing problems

query on DiffDate

2011-08-18 Thread ipshita chatterji
Hi Folks, I am very new to PIG. I am facing problems in using DiffDate function present in org.apache.pig.piggybank. evaluation.datetime. How do I pass 2 dates in a tuple format? I get an error. This is what I do: A= LOAD 'date.csv' AS (t1:tuple(t1a:chararray, t1b:chararray)); DESCRIBE A; DU

Re: PigStorage related question

2011-08-18 Thread sridhar basam
On Thu, Aug 18, 2011 at 3:34 PM, Daniel Dai wrote: > Check https://cwiki.apache.org/confluence/display/PIG/Pig+Tips, > PigStorageWithInputPath > > Thanks, that looks like exactly what i need. Sridhar

Re: multiple folder loading or passing comma on parameter with Amazon Pig

2011-08-18 Thread Daniel Dai
Yes, it's still there in 0.9 document: http://pig.apache.org/docs/r0.9.0/cont.html#Examples-N105D4. Can you open a Pig Jira? Thanks Daniel On Thu, Aug 18, 2011 at 12:28 PM, Dexin Wang wrote: > I will. > > There is also a "bug" on Pig documentation here: > > http://pig.apache.org/docs/r0.8.1/pigl

Re: PigStorage related question

2011-08-18 Thread Daniel Dai
Check https://cwiki.apache.org/confluence/display/PIG/Pig+Tips, PigStorageWithInputPath Daniel On Thu, Aug 18, 2011 at 12:19 PM, sridhar basam wrote: > Hey, >       I wanted to see if the following is possible in pig-0.8.1. > > a = load '/logs/apache/*/today/access.log.txt' USING PigStorage() AS

Re: multiple folder loading or passing comma on parameter with Amazon Pig

2011-08-18 Thread Dexin Wang
I will. There is also a "bug" on Pig documentation here: http://pig.apache.org/docs/r0.8.1/piglatin_ref2.html where it says In this example the command is executed and its stdout is used as the parameter value. %declare CMD 'generate_date'; it should really be `generate_date` with the ba

PigStorage related question

2011-08-18 Thread sridhar basam
Hey, I wanted to see if the following is possible in pig-0.8.1. a = load '/logs/apache/*/today/access.log.txt' USING PigStorage() AS (' tuple') I want to add to the existing tuple a chararray consisting of the variable expansion in the '*' above. Would it be possible to do something li

Re: Problem accessing fields in a tuple

2011-08-18 Thread ggrambo
Hi Thejas,I applied the patch and rebuilt.  The initial bug is gone, but there looks to be another:describe a;a: {f1: int,f2: int,f3: int,f4: int,f5: int,f6: int,f7: int,f8: int,f9: int,f10: int}aa = FOREACH a GENERATE $0, TOTUPLE($2,$3,$4,$5);aaa = FOREACH aa GENERATE $0, $1.f4 as v; -- OK = F

Re: about pig-0.8.1 unit test

2011-08-18 Thread Thejas Nair
yes, even in this case, both outputs look correct. -Thejas On 8/18/11 6:05 AM, lulynn_2008 wrote: Thejas Nair, Thank you Actually there are other unit tests failed because of different order output. During parse the pig command, a HashMap variable "aliases" will be used in src-gen/org/apache

Re:Re: about pig-0.8.1 unit test

2011-08-18 Thread lulynn_2008
Thejas Nair,Thank you Actually there are other unit tests failed because of different order output. During parse the pig command, a HashMap variable "aliases" will be used in src-gen/org/apache/pig/impl/logicalLayer/parser/QueryParser.java. I think this unit test failure is also caused by HashM