Based on my limited experience, here are some source code changes needed because some YARN APIs changed since Hadoop 2.2.
The code is in JobTaskCounterExtractor and HadoopStatusChecker 2016-11-10 11:23 GMT+08:00 胡志华(万里通科技及数据中心商务智能团队数据分析组) < huzhihua...@pingan.com.cn>: > Hi all > > As the request of department, I need to deploy another kylin > cluster. The problem is hadoop cluster is too old , hadoop2.2.0, cube > building will stop at step 3 “Extract Fact Table Distinct Columns”, the > error code from mapreduce is as below: > > I don’t know whether kylin support hadoop 2.2.0, by the way, I have > run “wordcount” on kylin’s hadoop client ,it worked. > > Hadoop cluster won’t be upgraded easily, So I can’t doploy kylin > with my present environment ? > > > “Application application_1468678294220_132943 failed 2 times due to AM > Container for appattempt_1468678294220_132943_000002 exited with > exitCode: 1 due to: Exception from container-launch: > org.apache.hadoop.util.Shell$ExitCodeException: > at org.apache.hadoop.util.Shell.runCommand(Shell.java:464) > at org.apache.hadoop.util.Shell.run(Shell.java:379) > at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute( > Shell.java:589) > at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor. > launchContainer(DefaultContainerExecutor.java:195) > at org.apache.hadoop.yarn.server.nodemanager.containermanager. > launcher.ContainerLaunch.call(ContainerLaunch.java:283) > at org.apache.hadoop.yarn.server.nodemanager.containermanager. > launcher.ContainerLaunch.call(ContainerLaunch.java:79) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > .Failing this attempt.. Failing the application.” > > > ************************************************************ > ******************************************************************** > The information in this email is confidential and may be legally > privileged. If you have received this email in error or are not the > intended recipient, please immediately notify the sender and delete this > message from your computer. Any use, distribution, or copying of this email > other than by the intended recipient is strictly prohibited. All messages > sent to and from us may be monitored to ensure compliance with internal > policies and to protect our business. > Emails are not secure and cannot be guaranteed to be error free as they > can be intercepted, amended, lost or destroyed, or contain viruses. Anyone > who communicates with us by email is taken to accept these risks. > > 收发邮件者请注意： > 本邮件含保密信息，若误收本邮件，请务必通知发送人并直接删去，不得使用、传播或复制本邮件。 > 进出邮件均受到本公司合规监控。邮件可能发生被截留、被修改、丢失、被破坏或包含计算机病毒等不安全情况。 > ************************************************************ > ******************************************************************** > -- With Warm regards Yiming Liu (刘一鸣)
