[
https://issues.apache.org/jira/browse/HCATALOG-626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13614751#comment-13614751
]
Rodrigo Trujillo commented on HCATALOG-626:
-------------------------------------------
I have seen this too.
Is this fixed in HCatalog 0.5.0 ?
> TestReaderWriter failed with hadoop 1.1.1 due to HADOOP-7823
> ------------------------------------------------------------
>
> Key: HCATALOG-626
> URL: https://issues.apache.org/jira/browse/HCATALOG-626
> Project: HCatalog
> Issue Type: Test
> Components: test
> Affects Versions: 0.4
> Environment: REHL
> Reporter: Bing Li
> Priority: Minor
> Labels: test
>
> With hcatalog 0.4.0, TestReaderWriter failed with hadoop 1.1.1 due to
> HADOOP-7823 (https://issues.apache.org/jira/browse/HADOOP-7823).
> It will throw NPE:
> <testcase classname="org.apache.hcatalog.data.TestReaderWriter" name="test"
> time="6.932">
> <error
> type="java.lang.NullPointerException">java.lang.NullPointerException
> at
> org.apache.hadoop.fs.BufferedFSInputStream.getPos(BufferedFSInputStream.java:48)
> at
> org.apache.hadoop.fs.FSDataInputStream.getPos(FSDataInputStream.java:41)
> at
> org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.readChunk(ChecksumFileSystem.java:219)
> at
> org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:237)
> at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:189)
> at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:158)
> at java.io.DataInputStream.read(DataInputStream.java:94)
> at org.apache.hadoop.util.LineReader.readLine(LineReader.java:134)
> at
> org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:176)
> at
> org.apache.hadoop.mapred.LineRecordReader.next(LineRecordReader.java:43)
> at
> org.apache.hcatalog.mapreduce.HCatRecordReader.nextKeyValue(HCatRecordReader.java:188)
> at
> org.apache.hcatalog.data.transfer.impl.HCatInputFormatReader$HCatRecordItr.hasNext(HCatInputFormatReader.java:107)
> at
> org.apache.hcatalog.data.TestReaderWriter.runsInSlave(TestReaderWriter.java:139)
> at
> org.apache.hcatalog.data.TestReaderWriter.test(TestReaderWriter.java:104)
> </error>
> </testcase>
> According to the change sets in HADOOP-7823, hadoop always read one extra
> line in next() method, which will lead this NPE.
> HCatalog should handle this changes in TestReaderWriter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira