[
https://issues.apache.org/jira/browse/KYLIN-5065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
andy peng updated KYLIN-5065:
-----------------------------
Description:
when i build my cube，an error appeared, but the same cube built succeed in test
environment.
i dont konw why.
who can help me. thank you very much.
my kylin version is 3.1.2 , the latest version .
Job Error Details
|*Error Step* |Extract Fact Table Distinct Columns|
|*MR Job* |job_1628056838389_5692|
error information：
org.apache.kylin.job.exception.ExecuteException:
org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job
job_1628056838389_5692Job Diagnostics:Failure task Diagnostics:Error:
java.lang.IllegalStateException: Invalid input data. Unordered data can not be
split into multi trees at
org.apache.kylin.dict.TrieDictionaryForestBuilder.build(TrieDictionaryForestBuilder.java:117)
at
org.apache.kylin.dict.DictionaryGenerator\$NumberTrieDictForestBuilder.build(DictionaryGenerator.java:227)
at
org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(FactDistinctColumnsReducer.java:211)
at
org.apache.kylin.engine.mr.KylinReducer.cleanup(KylinReducer.java:103)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179) at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at
org.apache.hadoop.mapred.YarnChild\$2.run(YarnChild.java:163) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:422) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
at
org.apache.kylin.job.impl.threadpool.DistributedScheduler\$JobRunner.run(DistributedScheduler.java:238)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor\$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)Caused by:
org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job
job_1628056838389_5692Job Diagnostics:Failure task Diagnostics:Error:
java.lang.IllegalStateException: Invalid input data. Unordered data can not be
split into multi trees at
org.apache.kylin.dict.TrieDictionaryForestBuilder.build(TrieDictionaryForestBuilder.java:117)
at
org.apache.kylin.dict.DictionaryGenerator\$NumberTrieDictForestBuilder.build(DictionaryGenerator.java:227)
at
org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(FactDistinctColumnsReducer.java:211)
at
org.apache.kylin.engine.mr.KylinReducer.cleanup(KylinReducer.java:103)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179) at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at
org.apache.hadoop.mapred.YarnChild\$2.run(YarnChild.java:163) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:422) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:235)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
... 6 more
was:
when i build my cube，a error appeared, but the same cube built succeed.
i dont konw why.
who can help me. thank you very much.
my kylin version is 3.1.2 , the latest version .
Job Error Details
|*Error Step* |Extract Fact Table Distinct Columns|
|*MR Job* |job_1628056838389_5692|
error information：
org.apache.kylin.job.exception.ExecuteException:
org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job
job_1628056838389_5692Job Diagnostics:Failure task Diagnostics:Error:
java.lang.IllegalStateException: Invalid input data. Unordered data can not be
split into multi trees at
org.apache.kylin.dict.TrieDictionaryForestBuilder.build(TrieDictionaryForestBuilder.java:117)
at
org.apache.kylin.dict.DictionaryGenerator\$NumberTrieDictForestBuilder.build(DictionaryGenerator.java:227)
at
org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(FactDistinctColumnsReducer.java:211)
at
org.apache.kylin.engine.mr.KylinReducer.cleanup(KylinReducer.java:103)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179) at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at
org.apache.hadoop.mapred.YarnChild\$2.run(YarnChild.java:163) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:422) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
at
org.apache.kylin.job.impl.threadpool.DistributedScheduler\$JobRunner.run(DistributedScheduler.java:238)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor\$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)Caused by:
org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job
job_1628056838389_5692Job Diagnostics:Failure task Diagnostics:Error:
java.lang.IllegalStateException: Invalid input data. Unordered data can not be
split into multi trees at
org.apache.kylin.dict.TrieDictionaryForestBuilder.build(TrieDictionaryForestBuilder.java:117)
at
org.apache.kylin.dict.DictionaryGenerator\$NumberTrieDictForestBuilder.build(DictionaryGenerator.java:227)
at
org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(FactDistinctColumnsReducer.java:211)
at
org.apache.kylin.engine.mr.KylinReducer.cleanup(KylinReducer.java:103)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179) at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at
org.apache.hadoop.mapred.YarnChild\$2.run(YarnChild.java:163) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:422) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:235)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
... 6 more
> error when TrieDictionaryForestBuilder.build
> --------------------------------------------
>
> Key: KYLIN-5065
> URL: https://issues.apache.org/jira/browse/KYLIN-5065
> Project: Kylin
> Issue Type: Bug
> Components: Measure - Count Distinct
> Affects Versions: v3.1.2
> Reporter: andy peng
> Priority: Blocker
>
> when i build my cube，an error appeared, but the same cube built succeed in
> test environment.
> i dont konw why.
> who can help me. thank you very much.
> my kylin version is 3.1.2 , the latest version .
> Job Error Details
> |*Error Step* |Extract Fact Table Distinct Columns|
> |*MR Job* |job_1628056838389_5692|
>
> error information：
> org.apache.kylin.job.exception.ExecuteException:
> org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job
> job_1628056838389_5692Job Diagnostics:Failure task Diagnostics:Error:
> java.lang.IllegalStateException: Invalid input data. Unordered data can not
> be split into multi trees at
> org.apache.kylin.dict.TrieDictionaryForestBuilder.build(TrieDictionaryForestBuilder.java:117)
> at
> org.apache.kylin.dict.DictionaryGenerator\$NumberTrieDictForestBuilder.build(DictionaryGenerator.java:227)
> at
> org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(FactDistinctColumnsReducer.java:211)
> at
> org.apache.kylin.engine.mr.KylinReducer.cleanup(KylinReducer.java:103)
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179) at
> org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at
> org.apache.hadoop.mapred.YarnChild\$2.run(YarnChild.java:163) at
> java.security.AccessController.doPrivileged(Native Method) at
> javax.security.auth.Subject.doAs(Subject.java:422) at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:201)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:72)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
> at
> org.apache.kylin.job.impl.threadpool.DistributedScheduler\$JobRunner.run(DistributedScheduler.java:238)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor\$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)Caused by:
> org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job
> job_1628056838389_5692Job Diagnostics:Failure task Diagnostics:Error:
> java.lang.IllegalStateException: Invalid input data. Unordered data can not
> be split into multi trees at
> org.apache.kylin.dict.TrieDictionaryForestBuilder.build(TrieDictionaryForestBuilder.java:117)
> at
> org.apache.kylin.dict.DictionaryGenerator\$NumberTrieDictForestBuilder.build(DictionaryGenerator.java:227)
> at
> org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doCleanup(FactDistinctColumnsReducer.java:211)
> at
> org.apache.kylin.engine.mr.KylinReducer.cleanup(KylinReducer.java:103)
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:179) at
> org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at
> org.apache.hadoop.mapred.YarnChild\$2.run(YarnChild.java:163) at
> java.security.AccessController.doPrivileged(Native Method) at
> javax.security.auth.Subject.doAs(Subject.java:422) at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> at
> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:235)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:180)
> ... 6 more
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
