Re: Pig/Avro Question

2012-02-03 Thread Russell Jurney
Wow, thanks a ton! On Fri, Feb 3, 2012 at 1:17 PM, Stan Rosenberg < srosenb...@proclivitysystems.com> wrote: > Check the code in PigAvroInputFormat; it overrides 'listStatus' from > FileInputFormat so that files not ending > in .avro are filtered. > > stan > > On Fri, Feb 3, 2012 at 1:58 PM, Russ

Re: Pig/Avro Question

2012-02-03 Thread Stan Rosenberg
Check the code in PigAvroInputFormat; it overrides 'listStatus' from FileInputFormat so that files not ending in .avro are filtered. stan On Fri, Feb 3, 2012 at 1:58 PM, Russell Jurney wrote: > btw - the weird thing is... I've read the code.  There isn't a filter for > .avro in there.  Does Hado

Re: Pig/Avro Question

2012-02-03 Thread Russell Jurney
btw - the weird thing is... I've read the code. There isn't a filter for .avro in there. Does Hadoop, or Avro itself (not that I can see it is involved) do so? On Fri, Feb 3, 2012 at 10:55 AM, Russell Jurney wrote: > Hmmm I applied it, but I still can't open files that don't end in .avro > > On

Re: Pig/Avro Question

2012-02-03 Thread Russell Jurney
Hmmm I applied it, but I still can't open files that don't end in .avro On Fri, Feb 3, 2012 at 2:23 AM, Philipp wrote: > This patch fixes this issue: > > https://issues.apache.org/**jira/browse/PIG-2492 > > > > On 02/03/2012 07:22 AM, Russell Jurne

Re: Pig/Avro Question

2012-02-03 Thread Philipp
This patch fixes this issue: https://issues.apache.org/jira/browse/PIG-2492 On 02/03/2012 07:22 AM, Russell Jurney wrote: I have the same bug. I read the code... there is no obvious fix. Arg. On Feb 2, 2012, at 10:07 PM, Something Something wrote: In my Pig script I have something like t

Re: Pig/Avro Question

2012-02-02 Thread Russell Jurney
I have the same bug. I read the code... there is no obvious fix. Arg. On Feb 2, 2012, at 10:07 PM, Something Something wrote: > In my Pig script I have something like this... > > %default MY_SCHEMA '/user/xyz/my-schema.json'; > > %default MY_AVRO > 'org.apache.pig.piggybank.storage.avro.Avr