Hello,Na Zhai step: Kylin: Extract Fact TableDistinct Columns
Kylin can’t submit the MR Task and throw the Counter: 0 # Best wishes! > 在 2018年10月24日,下午9:06,liuzhixin <liuz...@163.com> 写道: > > Hello Na Zhai: > # > The beeline connect hive successful, and There are no more messages! > # > <PastedGraphic-1.png> > > Best wishes! > >> 在 2018年10月23日,上午11:35,Na Zhai <na.z...@kyligence.io >> <mailto:na.z...@kyligence.io>> 写道: >> >> Hi, liuzhixin, >> Beeline connect hive, you mean the first step of build cube as the place >> circled in the picture? >> If you mean that, you can check whether the other cube can build >> successfully? You should make sure the health of the hive and the beeline >> connect hive successfully. >> >> Best wishes! >> >> 发送自 Windows 10 版邮件 <https://go.microsoft.com/fwlink/?LinkId=550986>应用 >> >> 发件人: liuzhixin <liuz...@163.com <mailto:liuz...@163.com>> >> 发送时间: Monday, October 22, 2018 8:05:09 PM >> 收件人: Na Zhai >> 抄送: 335960...@qq.com <mailto:335960...@qq.com> >> 主题: Re: MapReduceException: Counter 0 >> >> Hello, Beeline connect hive >> >> # >> # >> >> 018-10-22 20:03:32,945 DEBUG [Scheduler 1236831559 Job >> 23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f-142] common.HadoopCmdOutput:98 : >> Counters: 0 >> 2018-10-22 20:03:32,987 DEBUG [Scheduler 1236831559 Job >> 23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f-142] common.HadoopCmdOutput:104 : >> outputFolder >> ishdfs://hdfscluster/mnt/kylin/kylin_metadata/kylin-23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f/kylin_sales_mode1/fact_distinct_columns >> >> <hdfs://hdfscluster/mnt/kylin/kylin_metadata/kylin-23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f/kylin_sales_mode1/fact_distinct_columns> >> 2018-10-22 20:03:32,999 DEBUG [Scheduler 1236831559 Job >> 23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f-142] common.HadoopCmdOutput:109 : Seems >> no counter found for hdfs >> 2018-10-22 20:03:33,014 INFO [Scheduler 1236831559 Job >> 23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f-142] execution.ExecutableManager:434 : >> job id:23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f-02 from RUNNING to ERROR >> 2018-10-22 20:03:33,015 ERROR [Scheduler 1236831559 Job >> 23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f-142] execution.AbstractExecutable:165 : >> error running Executable: CubingJob{id=23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f, >> name=BUILD CUBE - kylin_sales_mode1 - 20120101000000_20160101000000 - >> GMT+08:00 2018-10-22 19:49:39, state=RUNNING} >> 2018-10-22 20:03:33,020 DEBUG [pool-7-thread-1] cachesync.Broadcaster:113 : >> Servers in the cluster: [localhost:7070] >> 2018-10-22 20:03:33,021 DEBUG [pool-7-thread-1] cachesync.Broadcaster:123 : >> Announcing new broadcast to all: BroadcastEvent{entity=execute_output, >> event=update, cacheKey=23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f} >> 2018-10-22 20:03:33,024 INFO [Scheduler 1236831559 Job >> 23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f-142] execution.ExecutableManager:434 : >> job id:23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f from RUNNING to ERROR >> 2018-10-22 20:03:33,024 DEBUG [pool-7-thread-1] cachesync.Broadcaster:113 : >> Servers in the cluster: [localhost:7070] >> 2018-10-22 20:03:33,024 DEBUG [Scheduler 1236831559 Job >> 23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f-142] execution.AbstractExecutable:316 : >> no need to send email, user list is empty >> 2018-10-22 20:03:33,024 DEBUG [pool-7-thread-1] cachesync.Broadcaster:123 : >> Announcing new broadcast to all: BroadcastEvent{entity=execute_output, >> event=update, cacheKey=23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f} >> 2018-10-22 20:03:33,028 DEBUG [http-nio-7070-exec-10] >> cachesync.Broadcaster:247 : Broadcasting UPDATE, execute_output, >> 23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f >> 2018-10-22 20:03:33,029 ERROR [pool-11-thread-1] >> threadpool.DefaultScheduler:115 : ExecuteException >> job:23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f >> org.apache.kylin.job.exception.ExecuteException: >> org.apache.kylin.job.exception.ExecuteException: >> org.apache.kylin.engine.mr.exception.MapReduceException: Counters: 0 >> >> at >> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178) >> at >> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >> at java.lang.Thread.run(Thread.java:748) >> Caused by: org.apache.kylin.job.exception.ExecuteException: >> org.apache.kylin.engine.mr.exception.MapReduceException: Counters: 0 >> >> at >> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178) >> at >> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69) >> at >> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) >> ... 4 more >> Caused by: org.apache.kylin.engine.mr.exception.MapReduceException: >> Counters: 0 >> >> at >> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:173) >> at >> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) >> ... 6 more >> 2018-10-22 20:03:33,030 DEBUG [http-nio-7070-exec-10] >> cachesync.Broadcaster:281 : Done broadcasting UPDATE, execute_output, >> 23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f >> 2018-10-22 20:03:33,039 DEBUG [http-nio-7070-exec-8] >> cachesync.Broadcaster:247 : Broadcasting UPDATE, execute_output, >> 23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f >> 2018-10-22 20:03:33,041 DEBUG [http-nio-7070-exec-8] >> cachesync.Broadcaster:281 : Done broadcasting UPDATE, execute_output, >> 23b694f2-c7cc-9d0e-4e3d-0b91ce16e21f >> 2018-10-22 20:03:33,048 INFO [FetcherRunner 2109416458-69] >> threadpool.DefaultFetcherRunner:96 : Job Fetcher: 0 should running, 0 actual >> running, 0 stopped, 0 ready, 0 already succeed, 9 error, 1 discarded, 0 >> others >> 2018-10-22 20:03:44,360 INFO [FetcherRunner 2109416458-69] >> threadpool.DefaultFetcherRunner:96 : Job Fetcher: 0 should running, 0 actual >> running, 0 stopped, 0 ready, 0 already succeed, 9 error, 1 discarded, 0 >> others >> >> # >> #Hadoop job log >> >> <PastedGraphic-3.png> >> >> >> >> Best wishes! >> >>> 在 2018年10月22日,下午7:58,Na Zhai <na.z...@kyligence.io >>> <mailto:na.z...@kyligence.io>> 写道: >>> >>> Hi, liuzhixin, >>> Sorry for my unclear question. I mean that which step does this mistake >>> take place in building cube? Can you provide the log info? >>> >>> 发送自 Windows 10 版邮件 <https://go.microsoft.com/fwlink/?LinkId=550986>应用 >>> >>> 发件人: liuzhixin <liuz...@163.com <mailto:liuz...@163.com>> >>> 发送时间: Monday, October 22, 2018 7:32:22 PM >>> 收件人: dev@kylin.apache.org <mailto:dev@kylin.apache.org> >>> 抄送: Na Zhai >>> 主题: Re: MapReduceException: Counter 0 >>> >>> Hello: >>> >>> Kylin version: kylin2.5.0-hadoop3.1-hdp >>> >>> Step : cube build >>> >>> >>>> 在 2018年10月22日,下午7:19,Na Zhai <na.z...@kyligence.io >>>> <mailto:na.z...@kyligence.io>> 写道: >>>> >>>> Hi, liuzhixin, >>>> What’s your Kylin version? Which step does this mistake take place? >>>> >>>> 发送自 Windows 10 版邮件 <https://go.microsoft.com/fwlink/?LinkId=550986>应用 >>>> >>>> 发件人: liuzhixin <liuz...@163.com <mailto:liuz...@163.com>> >>>> 发送时间: Monday, October 22, 2018 6:44:49 PM >>>> 收件人: dev@kylin.apache.org <mailto:dev@kylin.apache.org> >>>> 抄送: 335960...@qq.com <mailto:335960...@qq.com> >>>> 主题: MapReduceException: Counter 0 >>>> >>>> Hello kylin team: what’s wrong with the Counter 0? Thank you. >>>> >>>> >>>> # >>>> Best wishes! >> >> <step.png> >