[
https://issues.apache.org/jira/browse/KYLIN-4279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048447#comment-17048447
]
wangrupeng commented on KYLIN-4279:
-----------------------------------
Hi,
It seems like the problem of mapreduce job not kylin. I cannot find the
root cause through the log you shared. You may check out your yarn log to get
more details about your job failed infomation. Besides, you'd better tell us
your environment information(hdp or cdh version).
> Mapreduce Exception when building cube at step 3
> ------------------------------------------------
>
> Key: KYLIN-4279
> URL: https://issues.apache.org/jira/browse/KYLIN-4279
> Project: Kylin
> Issue Type: Bug
> Components: Tools, Build and Test
> Affects Versions: v2.6.4
> Reporter: Kanivel
> Priority: Major
> Attachments: Screenshot from 2019-12-05 12-55-22.png, Screenshot from
> 2019-12-05 12-55-47.png
>
>
> I have setup hadoop multinode cluster through ambari .ambari running as
> master node and hive running in another aws instance.I have installed kylin
> in master node and configured hive instance in kylin.properties. I can create
> model,can create cube.But exception occur when build cube.Build fails at 3rd
> step.When I check logs it shows Mapreduce exception.2nd step also taking more
> time.I have 3 tables and each have 10 records.sales,customers,products.sales
> is a fact table.customers and products are dimesions table..Please look at
> the attached screenshots.
> The below error I got,
> org.apache.kylin.engine.mr.exception.MapReduceException: Counters: 13 Job
> Counters Failed map tasks=4 Killed reduce tasks=3 Launched map tasks=4 Other
> local map tasks=3 Data-local map tasks=1 Total time spent by all maps in
> occupied slots (ms)=194628 Total time spent by all reduces in occupied slots
> (ms)=0 Total time spent by all map tasks (ms)=27804 Total vcore-milliseconds
> taken by all map tasks=27804 Total megabyte-milliseconds taken by all map
> tasks=199299072 Map-Reduce Framework CPU time spent (ms)=0 Physical memory
> (bytes) snapshot=0 Virtual memory (bytes) snapshot=0 Job Diagnostics:Task
> failed task_1575385745059_0009_m_000000 Job failed as tasks failed.
> failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0 Failure task
> Diagnostics: [2019-12-04 07:44:23.184]Exception from container-launch.
> Container id: container_e03_1575385745059_0009_01_000004 Exit code: 255
> [2019-12-04 07:44:23.186]Container exited with a non-zero exit code 255.
> Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes
> of stderr : [2019-12-04 07:44:23.186]Container exited with a non-zero exit
> code 255. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last
> 4096 bytes of stderr : at
> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:173)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
