[ https://issues.apache.org/jira/browse/KYLIN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784332#comment-16784332 ]
zhao jintao commented on KYLIN-3762: ------------------------------------ 这是构建的哪一步出现的? > 构建cube出现error > -------------- > > Key: KYLIN-3762 > URL: https://issues.apache.org/jira/browse/KYLIN-3762 > Project: Kylin > Issue Type: Bug > Affects Versions: v2.5.2 > Reporter: 王振强 > Priority: Blocker > Attachments: mr_error_log.jpg > > > 构建cube出现error,以下是mr的log > 2019-01-09 14:06:43,552 INFO [fetcher#1] > org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle > output of map attempt_1544413042966_0495_m_000002_0 decomp: 59732393 len: > 9306880 to MEMORY > 2019-01-09 14:06:43,595 INFO [fetcher#2] > org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle > output of map attempt_1544413042966_0495_m_000003_0 decomp: 61855877 len: > 9709575 to MEMORY > 2019-01-09 14:06:43,625 INFO [fetcher#1] > org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 59732393 > bytes from map-output for attempt_1544413042966_0495_m_000002_0 > 2019-01-09 14:06:43,625 INFO [fetcher#1] > org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile > -> map-output of size: 59732393, inMemoryMapOutputs.size() -> 1, commitMemory > -> 0, usedMemory ->121588270 > 2019-01-09 14:06:43,872 INFO [fetcher#1] > org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle > output of map attempt_1544413042966_0495_m_000001_0 decomp: 60219839 len: > 9341252 to MEMORY > 2019-01-09 14:06:43,889 INFO [fetcher#2] > org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 61855877 > bytes from map-output for attempt_1544413042966_0495_m_000003_0 > 2019-01-09 14:06:43,889 INFO [fetcher#2] > org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile > -> map-output of size: 61855877, inMemoryMapOutputs.size() -> 2, commitMemory > -> 59732393, usedMemory ->181808109 > 2019-01-09 14:06:43,889 INFO [fetcher#2] > org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: ap-cdh04:13562 > freed by fetcher#2 in 579ms > 2019-01-09 14:06:43,938 INFO [fetcher#1] > org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 60219839 > bytes from map-output for attempt_1544413042966_0495_m_000001_0 > 2019-01-09 14:06:43,938 INFO [fetcher#1] > org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile > -> map-output of size: 60219839, inMemoryMapOutputs.size() -> 3, commitMemory > -> 121588270, usedMemory ->181808109 > 2019-01-09 14:06:43,949 INFO [fetcher#1] > org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle > output of map attempt_1544413042966_0495_m_000000_0 decomp: 61659651 len: > 9657307 to MEMORY > 2019-01-09 14:06:43,994 INFO [fetcher#1] > org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 61659651 > bytes from map-output for attempt_1544413042966_0495_m_000000_0 > 2019-01-09 14:06:43,995 INFO [fetcher#1] > org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile > -> map-output of size: 61659651, inMemoryMapOutputs.size() -> 4, commitMemory > -> 181808109, usedMemory ->243467760 > 2019-01-09 14:06:43,995 INFO [fetcher#1] > org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: ap-cdh03:13562 > freed by fetcher#1 in 685ms > 2019-01-09 14:06:44,001 INFO [EventFetcher for fetching Map Completion > Events] org.apache.hadoop.mapreduce.task.reduce.EventFetcher: EventFetcher is > interrupted.. Returning > 2019-01-09 14:06:44,014 INFO [main] > org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: finalMerge called > with 4 in-memory map-outputs and 0 on-disk map-outputs > 2019-01-09 14:06:44,024 INFO [main] org.apache.hadoop.mapred.Merger: Merging > 4 sorted segments > 2019-01-09 14:06:44,026 INFO [main] org.apache.hadoop.mapred.Merger: Down to > the last merge-pass, with 4 segments left of total size: 243467522 bytes > 2019-01-09 14:06:47,997 INFO [main] > org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Merged 4 segments, > 243467760 bytes to disk to satisfy reduce memory limit > 2019-01-09 14:06:47,998 INFO [main] > org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Merging 1 files, > 35816160 bytes from disk > 2019-01-09 14:06:47,998 INFO [main] > org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Merging 0 segments, > 0 bytes from memory into reduce > 2019-01-09 14:06:47,999 INFO [main] org.apache.hadoop.mapred.Merger: Merging > 1 sorted segments > 2019-01-09 14:06:48,004 INFO [main] org.apache.hadoop.mapred.Merger: Down to > the last merge-pass, with 1 segments left of total size: 243467668 bytes > ^@^A^@^@^V^@ > > ^@^GVERSION*(^@&container_1544413042966_0495_01_000002^H*(^@&container_1544413042966_0495_01_000039^D*(^@&container_1544413042966_0495_01_000019^F*(^@&container_1544413042966_0495_01_000025^D^Dnone^D^P¬<90>¥¬<90>¥¬<90>µ¬w > ¬w > ±^GÕ¬`~¬`~µhS«^O^A«^O^A^C^Qdata:BCFile.index^Dnone<90>^Px^Q((^Pdata:TFile.index^Dnone<90>^PwZÌ·Ì·^Odata:TFile.meta^Dnone<90>^PwT^F^F^@^@^@^@^@^Px9^@^A^@^@Ñ^QÓh<91>µ×¶9ßA@<92>ºáP -- This message was sent by Atlassian JIRA (v7.6.3#76005)