Kanivel created KYLIN-4279:
------------------------------
Summary: Mapreduce Exception when building cube at step 3
Key: KYLIN-4279
URL: https://issues.apache.org/jira/browse/KYLIN-4279
Project: Kylin
Issue Type: Bug
Components: Tools, Build and Test
Affects Versions: v2.6.4
Reporter: Kanivel
Attachments: Screenshot from 2019-12-05 12-55-22.png, Screenshot from
2019-12-05 12-55-47.png
I have setup hadoop multinode cluster through ambari .ambari running as master
node and hive running in another aws instance.I have installed kylin in master
node and configured hive instance in kylin.properties. I can create model,can
create cube.But exception occur when build cube.Build fails at 3rd step.When I
check logs it shows Mapreduce exception.2nd step also taking more time.I have 3
tables and each have 10 records.sales,customers,products.sales is a fact
table.customers and products are dimesions table..Please look at the attached
screenshots.
The below error I got,
org.apache.kylin.engine.mr.exception.MapReduceException: Counters: 13 Job
Counters Failed map tasks=4 Killed reduce tasks=3 Launched map tasks=4 Other
local map tasks=3 Data-local map tasks=1 Total time spent by all maps in
occupied slots (ms)=194628 Total time spent by all reduces in occupied slots
(ms)=0 Total time spent by all map tasks (ms)=27804 Total vcore-milliseconds
taken by all map tasks=27804 Total megabyte-milliseconds taken by all map
tasks=199299072 Map-Reduce Framework CPU time spent (ms)=0 Physical memory
(bytes) snapshot=0 Virtual memory (bytes) snapshot=0 Job Diagnostics:Task
failed task_1575385745059_0009_m_000000 Job failed as tasks failed.
failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0 Failure task
Diagnostics: [2019-12-04 07:44:23.184]Exception from container-launch.
Container id: container_e03_1575385745059_0009_01_000004 Exit code: 255
[2019-12-04 07:44:23.186]Container exited with a non-zero exit code 255. Error
file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of
stderr : [2019-12-04 07:44:23.186]Container exited with a non-zero exit code
255. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096
bytes of stderr : at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:173)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)