zhou degao created KYLIN-1737:
---------------------------------
Summary: BufferOverflowException when calculate raw measure
Key: KYLIN-1737
URL: https://issues.apache.org/jira/browse/KYLIN-1737
Project: Kylin
Issue Type: Bug
Components: Job Engine
Affects Versions: v1.5.1
Environment: centos 6.5
Reporter: zhou degao
Assignee: Dong Li
Input records: 6M+ (no this error if the input records is less than 3M)
Error: java.nio.BufferOverflowException at
java.nio.HeapByteBuffer.put(HeapByteBuffer.java:189) at
java.nio.ByteBuffer.put(ByteBuffer.java:859) at
org.apache.kylin.common.util.BytesUtil.writeByteArray(BytesUtil.java:338) at
org.apache.kylin.measure.raw.RawSerializer.serialize(RawSerializer.java:88) at
org.apache.kylin.measure.raw.RawSerializer.serialize(RawSerializer.java:30) at
org.apache.kylin.measure.MeasureCodec.encode(MeasureCodec.java:89) at
org.apache.kylin.engine.mr.steps.CuboidReducer.reduce(CuboidReducer.java:105)
at org.apache.kylin.engine.mr.steps.CuboidReducer.reduce(CuboidReducer.java:43)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171) at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627) at
org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at
org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:422) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
