[ https://issues.apache.org/jira/browse/AVRO-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dave Beech updated AVRO-1234: ----------------------------- Attachment: AVRO-1234.patch Attaching patch to remove the extension check from AvroInputFormat, AvroAsTextInputFormat and TetherInputFormat. > Avro MapReduce jobs silently ignore input data without '.avro' extension > ------------------------------------------------------------------------ > > Key: AVRO-1234 > URL: https://issues.apache.org/jira/browse/AVRO-1234 > Project: Avro > Issue Type: Bug > Reporter: Dave Beech > Attachments: AVRO-1234.patch > > > The AvroInputFormat class explicitly checks each input path for a '.avro' > extension. > If only some of the input paths have the correct extension, the remainder are > silently ignored and not included in the job. However, if none of the input > paths have the extension, the job will continue and succeed even though no > map tasks are allocated, and no work is done. > This only happens using the old mapred API. The new mapreduce API version > will happily read files regardless of extension. > Is the check necessary? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira