[
https://issues.apache.org/jira/browse/ORC-162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146330#comment-16146330
]
ASF GitHub Bot commented on ORC-162:
------------------------------------
Github user prasanthj commented on the issue:
https://github.com/apache/orc/pull/163
I agree that reader should gracefully handle 0 length files like what this
patch does instead of throwing. In addition to that we should also avoid
creating splits for 0 length files. Spinning up tasks for reading 0 length
files is wasteful.
> Handle 0 byte files as empty ORC files
> --------------------------------------
>
> Key: ORC-162
> URL: https://issues.apache.org/jira/browse/ORC-162
> Project: ORC
> Issue Type: Bug
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
>
> Hive often creates empty files for empty buckets, which can introduce
> significant load on the HDFS cluster. Therefore, they made the Hive
> OrcOutputFormat and OrcInputFormat use 0 byte ORC files as a special case.
> We need to make the other readers treat them reasonably.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
