Re: Advanced HDFS operations from Python embedded scripts

2013-01-18 Thread Clément MATHIEU
On 2013-01-17 23:11, Jakub Glapa wrote: Hi Jakub, my pig script is going to produce a set of files that will be an input for a different process. The script would be running periodically so the number of files would be growing. I would like to implement an expiry mechanism were I could

Re: Advanced HDFS operations from Python embedded scripts

2013-01-18 Thread Jakub Glapa
that looks promising, thanks Clement! -- regards, pozdrawiam, Jakub Glapa On Fri, Jan 18, 2013 at 9:12 AM, Clément MATHIEU clem...@unportant.infowrote: On 2013-01-17 23:11, Jakub Glapa wrote: Hi Jakub, my pig script is going to produce a set of files that will be an input for a

Hard-coded inline relations

2013-01-18 Thread Michael Malak
I'm new to Pig, and it looks like there is no provision to declare relations inline in a Pig script (without LOADing from an external file)? Based on http://pig.apache.org/docs/r0.7.0/piglatin_ref2.html#Constants I would have thought the following would constitute Hello World for Pig: A =