qianqiaoneng created KYLIN-1590: ----------------------------------- Summary: 2 Kylin Steaming merge jobs of same time range triggered and failed Key: KYLIN-1590 URL: https://issues.apache.org/jira/browse/KYLIN-1590 Project: Kylin Issue Type: Bug Components: streaming Affects Versions: v1.4.0 Reporter: qianqiaoneng Assignee: Zhong Yanghong Priority: Critical
2 issues: 1. Kylin allows 2 merge jobs with same time range running. 2. when 2 merge jobs with same time range are running on the same time, they mixed up metadata, always get the HTable not found error. Build Result of Job site_gmb - 20160415212000_20160415215000 - MERGE - PDT 2016-04-15 14:58:38 Build Result: ERROR Job Engine: *** Cube Name: site_gmb Source Records Count: 0 Start Time: Fri Apr 15 14:58:44 PDT 2016 Duration: 2mins MR Waiting: 0mins Last Update Time: Fri Apr 15 15:01:42 PDT 2016 Submitter: SYSTEM Error Log: org.apache.hadoop.hbase.TableNotFoundException: KYLIN_NB2J0SRADJ at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1299) at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1128) at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1111) at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1070) at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:347) at org.apache.hadoop.hbase.client.HTable.(HTable.java:201) at org.apache.hadoop.hbase.client.HTable.(HTable.java:159) at org.apache.kylin.storage.hbase.steps.CubeHFileJob.run(CubeHFileJob.java:87) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:118) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:105) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:105) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) result code:2 -- This message was sent by Atlassian JIRA (v6.3.4#6332)