[
https://issues.apache.org/jira/browse/TAJO-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089412#comment-14089412
]
ASF GitHub Bot commented on TAJO-999:
-------------------------------------
GitHub user blrunner opened a pull request:
https://github.com/apache/tajo/pull/110
TAJO-999: SequenceFile key class need to be compatible.
I uploaded the patch and I finished to test it successfully on TPC-H
benchmarking cluster.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/blrunner/tajo TAJO-999
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/tajo/pull/110.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #110
----
commit 6932366c854c62caf1be7c442bf438774c5933e1
Author: Jaehwa Jung <[email protected]>
Date: 2014-08-07T16:28:59Z
TAJO-999: SequenceFile key class need to be compatible.
----
> SequenceFile key class need to be compatible.
> ---------------------------------------------
>
> Key: TAJO-999
> URL: https://issues.apache.org/jira/browse/TAJO-999
> Project: Tajo
> Issue Type: Bug
> Components: storage
> Reporter: Jaehwa Jung
> Assignee: Jaehwa Jung
> Fix For: 0.9.0
>
>
> Currently, tajo uses ByteWritable class for key class in SequenceFile. If we
> used ByteWritable class for key class, it is no problem. But if we use
> another class for key class, we must find IOException. For example, When I
> used LongWritable class for key class in TextSerde, I found error as follows:
> {code:xml}
> ERROR org.apache.tajo.worker.Task: wrong key class:
> org.apache.hadoop.io.BytesWritable is not class
> org.apache.hadoop.io.LongWritable
> java.io.IOException: wrong key class: org.apache.hadoop.io.BytesWritable is
> not class org.apache.hadoop.io.LongWritable
> at
> org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:2251)
> at
> org.apache.tajo.storage.sequencefile.SequenceFileScanner.next(SequenceFileScanner.java:147)
> {code}
> Thus, we need to improve SequenceFileScanner and SequenceFileScannerAppender
> compatible for all writable classes.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
