Re: Load Pig metadata from file?

2012-05-18 Thread Ruslan Al-Fakikh
nks a >> lot for that! >> >> Shan: I'm just beginning to use Pig and don't know a lot about macros. >> I'll look into them, however. >> >> Regards, >> Saurabh >> >>> Date: Tue, 15 May 2012 15:58:53 -0700 >>> Subject: Re: L

Re: Load Pig metadata from file?

2012-05-16 Thread Thejas Nair
first sighting of a white space. I found that using the 'bash -x' method that you suggested. Thanks a lot for that! Shan: I'm just beginning to use Pig and don't know a lot about macros. I'll look into them, however. Regards, Saurabh Date: Tue, 15 May 2012 15:58:53 -

RE: Load Pig metadata from file?

2012-05-15 Thread Saurabh S
Pig and don't know a lot about macros. I'll look into them, however. Regards, Saurabh > Date: Tue, 15 May 2012 15:58:53 -0700 > Subject: Re: Load Pig metadata from file? > From: aniket...@gmail.com > To: user@pig.apache.org > > I think you need to play with some quotes,

Re: Load Pig metadata from file?

2012-05-15 Thread shan s
Can you use macros instead? It would be much cleaner.. I was just pointed to http://hortonworks.com/blog/new-apache-pig-features-part-1-macro/ On Wed, May 16, 2012 at 4:04 AM, Saurabh S wrote: > > Here is a sample LOAD statement from Programming Pig book: > > daily = load 'NYSE_daily' as (excha

Re: Load Pig metadata from file?

2012-05-15 Thread Aniket Mokashi
I think you need to play with some quotes, its more likely a bash problem. one way to debug is bash -x pig -f script.pig -param md=$(cat metadata.dat) and check what does hadoop jar gets in the end. try - md="$(cat metadata.dat)" or -md="'$(cat metadata.dat)'" (single quote inside double quote a

Load Pig metadata from file?

2012-05-15 Thread Saurabh S
Here is a sample LOAD statement from Programming Pig book: daily = load 'NYSE_daily' as (exchange:chararray, symbol:chararray, date:chararray, open:float, high:float, low:float, close:float, volume:int, adj_close:float); In my case, there are around 250 columns to load.