王振强 created KYLIN-3762:
--------------------------
Summary: 构建cube出现error
Key: KYLIN-3762
URL: https://issues.apache.org/jira/browse/KYLIN-3762
Project: Kylin
Issue Type: Bug
Affects Versions: v2.5.2
Reporter: 王振强
Attachments: mr_error_log.jpg
构建cube出现error，以下是mr的log
2019-01-09 14:06:43,552 INFO [fetcher#1]
org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle
output of map attempt_1544413042966_0495_m_000002_0 decomp: 59732393 len:
9306880 to MEMORY
2019-01-09 14:06:43,595 INFO [fetcher#2]
org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle
output of map attempt_1544413042966_0495_m_000003_0 decomp: 61855877 len:
9709575 to MEMORY
2019-01-09 14:06:43,625 INFO [fetcher#1]
org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 59732393 bytes
from map-output for attempt_1544413042966_0495_m_000002_0
2019-01-09 14:06:43,625 INFO [fetcher#1]
org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile ->
map-output of size: 59732393, inMemoryMapOutputs.size() -> 1, commitMemory ->
0, usedMemory ->121588270
2019-01-09 14:06:43,872 INFO [fetcher#1]
org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle
output of map attempt_1544413042966_0495_m_000001_0 decomp: 60219839 len:
9341252 to MEMORY
2019-01-09 14:06:43,889 INFO [fetcher#2]
org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 61855877 bytes
from map-output for attempt_1544413042966_0495_m_000003_0
2019-01-09 14:06:43,889 INFO [fetcher#2]
org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile ->
map-output of size: 61855877, inMemoryMapOutputs.size() -> 2, commitMemory ->
59732393, usedMemory ->181808109
2019-01-09 14:06:43,889 INFO [fetcher#2]
org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: ap-cdh04:13562
freed by fetcher#2 in 579ms
2019-01-09 14:06:43,938 INFO [fetcher#1]
org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 60219839 bytes
from map-output for attempt_1544413042966_0495_m_000001_0
2019-01-09 14:06:43,938 INFO [fetcher#1]
org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile ->
map-output of size: 60219839, inMemoryMapOutputs.size() -> 3, commitMemory ->
121588270, usedMemory ->181808109
2019-01-09 14:06:43,949 INFO [fetcher#1]
org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle
output of map attempt_1544413042966_0495_m_000000_0 decomp: 61659651 len:
9657307 to MEMORY
2019-01-09 14:06:43,994 INFO [fetcher#1]
org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 61659651 bytes
from map-output for attempt_1544413042966_0495_m_000000_0
2019-01-09 14:06:43,995 INFO [fetcher#1]
org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile ->
map-output of size: 61659651, inMemoryMapOutputs.size() -> 4, commitMemory ->
181808109, usedMemory ->243467760
2019-01-09 14:06:43,995 INFO [fetcher#1]
org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: ap-cdh03:13562
freed by fetcher#1 in 685ms
2019-01-09 14:06:44,001 INFO [EventFetcher for fetching Map Completion Events]
org.apache.hadoop.mapreduce.task.reduce.EventFetcher: EventFetcher is
interrupted.. Returning
2019-01-09 14:06:44,014 INFO [main]
org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: finalMerge called
with 4 in-memory map-outputs and 0 on-disk map-outputs
2019-01-09 14:06:44,024 INFO [main] org.apache.hadoop.mapred.Merger: Merging 4
sorted segments
2019-01-09 14:06:44,026 INFO [main] org.apache.hadoop.mapred.Merger: Down to
the last merge-pass, with 4 segments left of total size: 243467522 bytes
2019-01-09 14:06:47,997 INFO [main]
org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Merged 4 segments,
243467760 bytes to disk to satisfy reduce memory limit
2019-01-09 14:06:47,998 INFO [main]
org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Merging 1 files,
35816160 bytes from disk
2019-01-09 14:06:47,998 INFO [main]
org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Merging 0 segments, 0
bytes from memory into reduce
2019-01-09 14:06:47,999 INFO [main] org.apache.hadoop.mapred.Merger: Merging 1
sorted segments
2019-01-09 14:06:48,004 INFO [main] org.apache.hadoop.mapred.Merger: Down to
the last merge-pass, with 1 segments left of total size: 243467668 bytes
^@^A^@^@^V^@
^@^GVERSION*(^@&container_1544413042966_0495_01_000002^H*(^@&container_1544413042966_0495_01_000039^D*(^@&container_1544413042966_0495_01_000019^F*(^@&container_1544413042966_0495_01_000025^D^Dnone^D^P¬<90>¥¬<90>¥¬<90>µ¬w
¬w
±^GÕ¬`~¬`~µhS«^O^A«^O^A^C^Qdata:BCFile.index^Dnone<90>^Px^Q((^Pdata:TFile.index^Dnone<90>^PwZÌ·Ì·^Odata:TFile.meta^Dnone<90>^PwT^F^F^@^@^@^@^@^Px9^@^A^@^@Ñ^QÓh<91>µ×¶9ßA@<92>ºáP
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
