[ https://issues.apache.org/jira/browse/MAPREDUCE-5853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Dere resolved MAPREDUCE-5853. ----------------------------------- Resolution: Duplicate Sorry, looks like there are other related (fixed) issues: HADOOP-8014 > ChecksumFileSystem.getContentSummary() including contents for crc files > ------------------------------------------------------------------------ > > Key: MAPREDUCE-5853 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5853 > Project: Hadoop Map/Reduce > Issue Type: Bug > Reporter: Jason Dere > > Trying to track down some differences in Hive statistics between > hadoop-1/hadoop-2. It looks like although ChecksumFileSystem.listStatus() > filters out CRC files, getContentSummary() falls back to using the > FilterFileSystem.getContentSummary() implementation, which calls > fs.getContentSummary(). The underlying fs may not have the same filters as > the ChecksumFileSystem and so the CRC files can get included in the content > summary. -- This message was sent by Atlassian JIRA (v6.2#6252)