[ https://issues.apache.org/jira/browse/KYLIN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16603857#comment-16603857 ]
Chao Long commented on KYLIN-3534: ---------------------------------- Root cause: The output file has been compressed in SparkFactDistinct.java,and at the step of updateCubeInfo it read compressed file directly(read as txt file), so it can not get the correct data. > Failed at update cube info step > ------------------------------- > > Key: KYLIN-3534 > URL: https://issues.apache.org/jira/browse/KYLIN-3534 > Project: Kylin > Issue Type: Bug > Reporter: Yichen Zhou > Assignee: Chao Long > Priority: Major > Fix For: v2.5.0 > > > When building cube with spark(full build), I got the following error in the > step of "Update Cube Info": > {quote}2018-09-04 14:49:49,007 INFO [Scheduler 1888858588 Job > d05156bb-2635-cb2f-ac19-b38f6147fcb2-699] > steps.UpdateCubeInfoAfterBuildStep:158 : updateSegment step. TRANS_ID > minValue:x�3�.�) maxValue:null > 2018-09-04 14:49:49,008 ERROR [Scheduler 1888858588 Job > d05156bb-2635-cb2f-ac19-b38f6147fcb2-699] execution.AbstractExecutable:165 : > error running Executable: > UpdateCubeInfoAfterBuildStep\{id=d05156bb-2635-cb2f-ac19-b38f6147fcb2-09, > name=Update Cube Info, state=RUNNING} > 2018-09-04 14:49:49,011 INFO [Scheduler 1888858588 Job > d05156bb-2635-cb2f-ac19-b38f6147fcb2-699] execution.ExecutableManager:434 : > job id:d05156bb-2635-cb2f-ac19-b38f6147fcb2-09 from RUNNING to ERROR > 2018-09-04 14:49:49,012 ERROR [Scheduler 1888858588 Job > d05156bb-2635-cb2f-ac19-b38f6147fcb2-699] execution.AbstractExecutable:165 : > error running Executable: CubingJob\{id=d05156bb-2635-cb2f-ac19-b38f6147fcb2, > name=BUILD CUBE - cube_global_dictionary_spark - FULL_BUILD - GMT+08:00 > 2018-09-04 11:51:58, state=RUNNING} > 2018-09-04 14:49:49,014 DEBUG [pool-6-thread-1] cachesync.Broadcaster:113 : > Servers in the cluster: [localhost:7070] > 2018-09-04 14:49:49,014 DEBUG [pool-6-thread-1] cachesync.Broadcaster:123 : > Announcing new broadcast to all: BroadcastEvent\{entity=execute_output, > event=update, cacheKey=d05156bb-2635-cb2f-ac19-b38f6147fcb2} > 2018-09-04 14:49:49,015 INFO [Scheduler 1888858588 Job > d05156bb-2635-cb2f-ac19-b38f6147fcb2-699] execution.ExecutableManager:434 : > job id:d05156bb-2635-cb2f-ac19-b38f6147fcb2 from RUNNING to ERROR > 2018-09-04 14:49:49,015 DEBUG [pool-6-thread-1] cachesync.Broadcaster:113 : > Servers in the cluster: [localhost:7070] > 2018-09-04 14:49:49,015 DEBUG [pool-6-thread-1] cachesync.Broadcaster:123 : > Announcing new broadcast to all: BroadcastEvent\{entity=execute_output, > event=update, cacheKey=d05156bb-2635-cb2f-ac19-b38f6147fcb2} > 2018-09-04 14:49:49,015 DEBUG [Scheduler 1888858588 Job > d05156bb-2635-cb2f-ac19-b38f6147fcb2-699] execution.AbstractExecutable:316 : > no need to send email, user list is empty > 2018-09-04 14:49:49,017 ERROR [pool-10-thread-10] > threadpool.DefaultScheduler:115 : ExecuteException > job:d05156bb-2635-cb2f-ac19-b38f6147fcb2 > org.apache.kylin.job.exception.ExecuteException: > org.apache.kylin.job.exception.ExecuteException:java.lang.IllegalStateException > at > org.apache.kylin.cube.DimensionRangeInfo.<init>(DimensionRangeInfo.java:86) > at > org.apache.kylin.engine.mr.steps.UpdateCubeInfoAfterBuildStep.updateSegment(UpdateCubeInfoAfterBuildStep.java:166) > at > org.apache.kylin.engine.mr.steps.UpdateCubeInfoAfterBuildStep.doWork(UpdateCubeInfoAfterBuildStep.java:85) > at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) > at > org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69) > at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163) > at > org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > {quote} -- This message was sent by Atlassian JIRA (v7.6.3#76005)