[ https://issues.apache.org/jira/browse/PIG-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13080300#comment-13080300 ]
Bill Graham commented on PIG-2195: ---------------------------------- This first patch is ready for review FYI. Also FYI, I've created PIG-2202 to track upgrading AvroStorage to work with Avro 1.5.1 and PIG-2201 to track a separate issue with the unit tests. > AvroStorage fails to STORE when LOADing via PigStorage > ------------------------------------------------------ > > Key: PIG-2195 > URL: https://issues.apache.org/jira/browse/PIG-2195 > Project: Pig > Issue Type: Bug > Reporter: Bill Graham > Assignee: Bill Graham > Attachments: PIG-2195_1.patch, > expected_testRecordSplitFromText1.avro, expected_testRecordSplitFromText2.avro > > > Reading data via {{PigStorage}} and writing it via {{AvroStorage}} fails with > an exception like this > {{java.lang.ClassCastException: org.apache.pig.data.BinSedesTuple cannot be > cast to org.apache.avro.generic.IndexedRecord}} > The Pig script in this section of the documentation shows an example like > this that fails: > http://linkedin.jira.com/wiki/display/HTOOLS/AvroStorage+-+Pig+support+for+Avro+data#AvroStorage-PigsupportforAvrodata-A.Howtostoredataindifferentways. > A workaround currently exists to produce avro from TSVs like this: > {noformat} > avro = LOAD 'inputPath/' AS (foo); > STORE avro INTO 'outputPath/' USING oap.piggybank.storage.avro.AvroStorage( > '{"data":"data_file.avro", > "same":"data_file.avro", "field0":"def:bar"}'); > {noformat} > This is redundant though and {{data}} and {{same}} seem to indicate the same > thing. This approach also requires an existing avro data file to exist. This > patch will make the following alternate constructor syntax's work as well. > # Read schema from an existing data file: > {noformat} > '{"data":"data_file.avro", "field0":"def:bar"}'); > {noformat} > # Read schema from an existing schema file: > {noformat} > '{"schema_file":"data_file.avsc", "field0":"def:bar"}'); > {noformat} -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira