-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19406/#review39028
-----------------------------------------------------------
Jung JaeHwa
Could you please take a look at this error?
Store : Hcatalog
Query :
create table table2 (id integer, name text, year smallint) using sequencefile
with ('compression.codec'='org.apache.hadoop.io.compress.SnappyCodec')
select name from table2;
2014-03-31 14:13:30,477 INFO [Thread-95] worker.Task (Task.java:<init>(203)) -
==================================
2014-03-31 14:13:30,477 INFO [Thread-95] worker.TaskAttemptContext
(TaskAttemptContext.java:setState(110)) - Query status of ta_1396242125461_000
8_000001_000000_00 is changed to TA_RUNNING
2014-03-31 14:13:30,488 ERROR [Thread-95] worker.Task (Task.java:run(393)) -
java.lang.ArrayIndexOutOfBoundsException: 1
at
org.apache.tajo.storage.sequencefile.SequenceFileScanner.makeTuple(SequenceFileScanner.java:209)
at
org.apache.tajo.storage.sequencefile.SequenceFileScanner.next(SequenceFileScanner.java:158)
at
org.apache.tajo.engine.planner.physical.SeqScanExec.next(SeqScanExec.java:168)
at
org.apache.tajo.engine.planner.physical.StoreTableExec.next(StoreTableExec.java:76)
at org.apache.tajo.worker.Task.run(Task.java:384)
at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:395)
at java.lang.Thread.run(Thread.java:695)
2014-03-31 14:13:30,488 INFO [Thread-95] worker.TaskAttemptContext
(TaskAttemptContext.java:setState(110)) - Query status of ta_1396242125461_000
8_000001_000000_00 is changed to TA_FAILED
2014-03-31 14:13:30,488 INFO [Thread-95] worker.Task (Task.java:run(447)) -
Task Counter - total:12, succeeded: 5, killed: 0, failed: 7
2014-03-31 14:13:30,488 INFO [Thread-95] worker.TaskRunner
(TaskRunner.java:run(336)) - Request GetTask:
eb_1396242125461_0008_000001,container_1
396242125461_0008_01_000016
2014-03-31 14:13:30,489 ERROR [AsyncDispatcher event handler]
querymaster.QueryUnitAttempt (QueryUnitAttempt.java:transition(403)) - FROM
kimjh.se
rver.gruter.com >> java.lang.ArrayIndexOutOfBoundsException: 1
at
org.apache.tajo.storage.sequencefile.SequenceFileScanner.makeTuple(SequenceFileScanner.java:209)
at
org.apache.tajo.storage.sequencefile.SequenceFileScanner.next(SequenceFileScanner.java:158)
at
org.apache.tajo.engine.planner.physical.SeqScanExec.next(SeqScanExec.java:168)
at
org.apache.tajo.engine.planner.physical.StoreTableExec.next(StoreTableExec.java:76)
at org.apache.tajo.worker.Task.run(Task.java:384)
at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:395)
at java.lang.Thread.run(Thread.java:695)
2014-03-31 14:13:30,489 INFO [AsyncDispatcher event handler]
querymaster.QueryUnit (QueryUnit.java:transition(543)) -
===========================
==================================
- Jinho Kim
On March 28, 2014, 9:15 a.m., Jung JaeHwa wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/19406/
> -----------------------------------------------------------
>
> (Updated March 28, 2014, 9:15 a.m.)
>
>
> Review request for Tajo.
>
>
> Bugs: TAJO-616
> https://issues.apache.org/jira/browse/TAJO-616
>
>
> Repository: tajo
>
>
> Description
> -------
>
> Hadoop users can create a sequence file format, and hive users also can
> create a table which was stored as SequenceFIle. So, we need to support
> sequence file format as follows:
>
> * Update parser and catalog for SequenceFile
> * Make serializer/deserializer configurable in SequenceFile
> * Scanner for SequenceFile
> * Support for compression/decompression of SequenceFile
> * Compatible to apache hive
>
>
> Diffs
> -----
>
>
> tajo-catalog/tajo-catalog-common/src/main/java/org/apache/tajo/catalog/CatalogConstants.java
> c7116f6
>
> tajo-catalog/tajo-catalog-common/src/main/java/org/apache/tajo/catalog/CatalogUtil.java
> 9078e60
> tajo-catalog/tajo-catalog-common/src/main/proto/CatalogProtos.proto 06ffcfd
>
> tajo-catalog/tajo-catalog-drivers/tajo-hcatalog/src/main/java/org/apache/tajo/catalog/store/HCatalogStore.java
> 6ef255f
>
> tajo-catalog/tajo-catalog-drivers/tajo-hcatalog/src/main/java/org/apache/tajo/catalog/store/HCatalogUtil.java
> d426369
>
> tajo-catalog/tajo-catalog-drivers/tajo-hcatalog/src/test/java/org/apache/tajo/catalog/store/TestHCatalogStore.java
> b9a734e
> tajo-common/src/main/java/org/apache/tajo/util/Bytes.java f9ba923
>
> tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/benchmark/TPCH.java
> 20015b5
> tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/TpchTestBase.java
> 0b80231
>
> tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/client/TestDDLBuilder.java
> 73f7d5e
>
> tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/engine/query/TestCTASQuery.java
> e6840f6
>
> tajo-core/tajo-core-backend/src/test/java/org/apache/tajo/engine/query/TestNullValues.java
> 1f1d9e1
> tajo-storage/pom.xml 9f144bb
> tajo-storage/src/main/java/org/apache/tajo/storage/CSVFile.java 116e25c
>
> tajo-storage/src/main/java/org/apache/tajo/storage/sequencefile/SequenceFileAppender.java
> PRE-CREATION
>
> tajo-storage/src/main/java/org/apache/tajo/storage/sequencefile/SequenceFileScanner.java
> PRE-CREATION
> tajo-storage/src/main/resources/storage-default.xml e3a0eaf
>
> tajo-storage/src/test/java/org/apache/tajo/storage/TestCompressionStorages.java
> a776eb6
> tajo-storage/src/test/java/org/apache/tajo/storage/TestMergeScanner.java
> ad12c06
> tajo-storage/src/test/java/org/apache/tajo/storage/TestStorages.java
> b5338ff
> tajo-storage/src/test/resources/storage-default.xml 75274d0
>
> Diff: https://reviews.apache.org/r/19406/diff/
>
>
> Testing
> -------
>
> mvn clean install -Phcatalog-0.12.0
> mvn clean install -Phcatalog-0.12.0
> -Dtajo.catalog.store.class=org.apache.tajo.catalog.store.HCatalogStore
>
>
> Thanks,
>
> Jung JaeHwa
>
>
