[
https://issues.apache.org/jira/browse/PIG-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13503823#comment-13503823
]
Bart Verwilst commented on PIG-2492:
------------------------------------
I've compiled 0.11 from the svn branch just now, and get this:
~/branch-0.11/build $ pig
2012-11-26 15:59:39,439 [main] INFO org.apache.pig.Main - Apache Pig version
0.11.0-SNAPSHOT (r1413659) compiled Nov 26 2012, 15:55:29
grunt> REGISTER 'hdfs:///lib/avro-1.7.2.jar';
grunt> REGISTER 'hdfs:///lib/json-simple-1.1.1.jar';
grunt> REGISTER 'hdfs:///lib/piggybank.jar';
grunt>
grunt> DEFINE AvroStorage org.apache.pig.piggybank.storage.avro.AvroStorage();
grunt> avro = load '/test/*' USING AvroStorage();
grunt> describe avro;
Schema for avro unknown.
grunt> avro = load '/test/*.avro' USING AvroStorage();
grunt> describe avro;
Schema for avro unknown.
grunt>
grunt> avro = load '/test/2012-11-25.avro' USING AvroStorage();
grunt> describe avro;
avro: {id: long,timestamp: long,latitude: int,longitude: int,speed:
int,heading: int,terminalid: int,customerid: chararray,mileage:
int,creationtime: long,tracetype: int,traceproperties: {ARRAY_ELEM: (id:
long,value: chararray,pkey: chararray)}}
grunt> avro = load '/test/2012-11-2{5}.avro' USING AvroStorage();
2012-11-26 16:01:07,284 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR
1200: null
Details at logfile: /home/verwilst/branch-0.11/build/pig_1353941979436.log
grunt> avro = load '/test/2012-11-2?.avro' USING AvroStorage();
grunt> describe avro;
Schema for avro unknown.
grunt> avro = load '/test/2012-11-2*.avro' USING AvroStorage();
grunt> describe avro;
Schema for avro unknown.
grunt>
~/branch-0.11/build $ hadoop fs -ls /test/
Found 1 items
-rw-r--r-- 3 hdfs supergroup 63140500 2012-11-26 14:13 /test/2012-11-25.avro
Shouldn't this be working here?
> AvroStorage should recognize globs and commas
> ---------------------------------------------
>
> Key: PIG-2492
> URL: https://issues.apache.org/jira/browse/PIG-2492
> Project: Pig
> Issue Type: Improvement
> Components: piggybank
> Affects Versions: 0.9.1, 0.10.0
> Reporter: Stan Rosenberg
> Assignee: Cheolsoo Park
> Fix For: 0.11
>
> Attachments: AvroStorage.patch, AvroStorageUtils.patch,
> avro_test_files-2.tar.gz, avro_test_files.tar.gz, PIG-2492-2.patch,
> PIG-2492-3.patch, PIG-2492-4.patch, PIG-2492.patch
>
>
> I've patched AvroStorage and AvroStorageUtils to support the same file input
> syntax as currently supported
> by hadoop's FileInputFormat. Specifically, globs and commas are supported.
> Somebody should write some unit tests for theses changes; I am currently
> pressed for time.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
