Richard Calaba created KYLIN-1810: ------------------------------------- Summary: NPE in org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164) Key: KYLIN-1810 URL: https://issues.apache.org/jira/browse/KYLIN-1810 Project: Kylin Issue Type: Bug Affects Versions: v1.5.2.1 Reporter: Richard Calaba Attachments: job_2016_06_21_16_23_51-err.zip
Hello, running into weird issue. I have designed Kylin cube. Clonned it to another cube without any changes and run the Build job. The Build succeeded. Then I have discarder the build job and disabled and dropped the cube. Clonned the same cube again (into different name than previously) and then again started to build the cube. Getting an NPE below every time in Step 4 - Build Dimension Dictionary": Kylin jambajuice_3_0 Insight Model Monitor System Help Welcome, ADMIN Jobs Slow Queries Cube Name: Filter ... Jobs in: NEW PENDING RUNNING FINISHED ERROR DISCARDED Job Name Cube Progress Last Modified Time Duration Actions JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:29:03 JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone ERROR 2016-06-21 15:35:21 PST 5.80 mins Action JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:06:48 JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone 100% 2016-06-21 15:14:24 PST 6.85 mins Action JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626000000 - BUILD - PDT 2016-06-21 14:10:10 JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone 14.29% 2016-06-21 14:59:37 PST 5.70 mins Action Total: 3 Detail Information Job Name JAMBAJUICE_3_0_REL_TRX_POS_CHECK_clone - 19700101000000_20160626042000 - BUILD - PDT 2016-06-21 16:29:03 Job ID ac090c87-496d-4173-9503-6a9ec97a764e Status ERROR Duration 5.80 mins MapReduce Waiting 0.18 mins Start 2016-06-21 15:29:32 PST 2016-06-21 15:29:32 PST #1 Step Name: Create Intermediate Flat Hive Table Duration: 2.82 mins 2016-06-21 15:32:21 PST #2 Step Name: Materialize Hive View in Lookup Tables Duration: 2.11 mins 2016-06-21 15:34:28 PST #3 Step Name: Extract Fact Table Distinct Columns Duration: 0.86 mins 2016-06-21 15:35:20 PST #4 Step Name: Build Dimension Dictionary Duration: 0.02 mins #5 Step Name: Save Cuboid Statistics Duration: 0 seconds #6 Step Name: Create HTable Duration: 0 seconds #7 Step Name: Build Base Cuboid Data Duration: 0 seconds #8 Step Name: Build N-Dimension Cuboid Data : 8-Dimension Duration: 0 seconds #9 Step Name: Build N-Dimension Cuboid Data : 7-Dimension Duration: 0 seconds #10 Step Name: Build N-Dimension Cuboid Data : 6-Dimension Duration: 0 seconds #11 Step Name: Build N-Dimension Cuboid Data : 5-Dimension Duration: 0 seconds #12 Step Name: Build N-Dimension Cuboid Data : 4-Dimension Duration: 0 seconds #13 Step Name: Build N-Dimension Cuboid Data : 3-Dimension Duration: 0 seconds #14 Step Name: Build N-Dimension Cuboid Data : 2-Dimension Duration: 0 seconds #15 Step Name: Build N-Dimension Cuboid Data : 1-Dimension Duration: 0 seconds #16 Step Name: Build N-Dimension Cuboid Data : 0-Dimension Duration: 0 seconds #17 Step Name: Build Cube Duration: 0 seconds #18 Step Name: Convert Cuboid Data to HFile Duration: 0 seconds #19 Step Name: Load HFile to HBase Table Duration: 0 seconds #20 Step Name: Update Cube Info Duration: 0 seconds #21 Step Name: Garbage Collection Duration: 0 seconds End Apache Kylin | Apache Kylin Community Output java.lang.NullPointerException at org.apache.kylin.dict.lookup.SnapshotTable.equals(SnapshotTable.java:164) at org.apache.kylin.dict.lookup.SnapshotManager.checkDupByContent(SnapshotManager.java:167) at org.apache.kylin.dict.lookup.SnapshotManager.trySaveNewSnapshot(SnapshotManager.java:128) at org.apache.kylin.dict.lookup.SnapshotManager.buildSnapshot(SnapshotManager.java:108) at org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:215) at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:59) at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:42) at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:56) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:60) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) result code:2 Attaching the Diagnostic logs. Any clue how to resolve this ??? I am thinking to wipe all Kylin metadata from repository and try to restore from backup. -- This message was sent by Atlassian JIRA (v6.3.4#6332)