[
https://issues.apache.org/jira/browse/ORC-162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146090#comment-16146090
]
ASF GitHub Bot commented on ORC-162:
------------------------------------
Github user electrum commented on the issue:
https://github.com/apache/orc/pull/163
We had the same use case of making empty bucket creation more efficient.
Encoding the fact that the file is intentionally empty in the name provides a
good safeguard against storage system problems that can cause files to be
truncated (unfortunately far too common).
> Handle 0 byte files as empty ORC files
> --------------------------------------
>
> Key: ORC-162
> URL: https://issues.apache.org/jira/browse/ORC-162
> Project: ORC
> Issue Type: Bug
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
>
> Hive often creates empty files for empty buckets, which can introduce
> significant load on the HDFS cluster. Therefore, they made the Hive
> OrcOutputFormat and OrcInputFormat use 0 byte ORC files as a special case.
> We need to make the other readers treat them reasonably.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
