[
https://issues.apache.org/jira/browse/HIVE-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13982429#comment-13982429
]
Ashutosh Chauhan edited comment on HIVE-6979 at 4/27/14 7:10 PM:
-----------------------------------------------------------------
union_remove_25 wasn't expected to fail. Prashant, can you take a look?
was (Author: ashutoshc):
+1
> Hadoop-2 test failures related to quick stats not being populated correctly
> ---------------------------------------------------------------------------
>
> Key: HIVE-6979
> URL: https://issues.apache.org/jira/browse/HIVE-6979
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.14.0
> Reporter: Prasanth J
> Assignee: Prasanth J
> Attachments: HIVE-6979.1.patch, HIVE-6979.2.patch
>
>
> The test failures that are currently reported by Hive QA running on hadoop-2
> (https://issues.apache.org/jira/browse/HIVE-6968?focusedCommentId=13980570&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13980570)
> are related to difference in the way hadoop FileSystem.globStatus() api
> behaves. For a directory structure like below
> {code}
> dir1/file1
> dir1/file2
> {code}
> Two level of path pattern like dir1/*/* will return both files in hadoop 1.x
> but will return empty result in hadoop 2.x (in fact it will say no such file
> or directory and return empty file status array). Hadoop 2.x seems to be
> compliant to linux behaviour (ls dir1/*/*) but hadoop 1.x is not.
> As a result of this, the fast statistics (NUM_FILES and TOTAL_SIZE) are
> populated wrongly causing diffs in qfile tests for hadoop-1 and hadoop-2.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
