[
https://issues.apache.org/jira/browse/AVRO-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14044193#comment-14044193
]
Doug Cutting commented on AVRO-1530:
------------------------------------
That would be an incompatible change. Some folks might rely on the current
behaviour.
One can detect an empty file by looking at its length. No valid avro data file
will ever be empty.
> Java DataFileStream does not allow distinguishing between empty files and
> corrupt files
> ---------------------------------------------------------------------------------------
>
> Key: AVRO-1530
> URL: https://issues.apache.org/jira/browse/AVRO-1530
> Project: Avro
> Issue Type: Bug
> Reporter: Brock Noland
>
> When writing data to HDFS, especially with Flume, it's possible to write
> empty files. When you run Hive queries over this data, the job fails with
> "Not a data file." from here
> https://github.com/apache/avro/blob/trunk/lang/java/avro/src/main/java/org/apache/avro/file/DataFileStream.java#L102
--
This message was sent by Atlassian JIRA
(v6.2#6252)
