[ 
https://issues.apache.org/jira/browse/AVRO-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dave Beech updated AVRO-1234:
-----------------------------

    Attachment: AVRO-1234.patch

Attaching patch to remove the extension check from AvroInputFormat, 
AvroAsTextInputFormat and TetherInputFormat.
                
> Avro MapReduce jobs silently ignore input data without '.avro' extension
> ------------------------------------------------------------------------
>
>                 Key: AVRO-1234
>                 URL: https://issues.apache.org/jira/browse/AVRO-1234
>             Project: Avro
>          Issue Type: Bug
>            Reporter: Dave Beech
>         Attachments: AVRO-1234.patch
>
>
> The AvroInputFormat class explicitly checks each input path for a '.avro' 
> extension. 
> If only some of the input paths have the correct extension, the remainder are 
> silently ignored and not included in the job. However, if none of the input 
> paths have the extension, the job will continue and succeed even though no 
> map tasks are allocated, and no work is done.
> This only happens using the old mapred API. The new mapreduce API version 
> will happily read files regardless of extension. 
> Is the check necessary?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to