[ https://issues.apache.org/jira/browse/KYLIN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hao Chen updated KYLIN-1447: ---------------------------- Component/s: Job Engine > Hive Duplicate Entry Exception while creating Intermediate Flat Hive Table > during step#1 of Kylin cube building > --------------------------------------------------------------------------------------------------------------- > > Key: KYLIN-1447 > URL: https://issues.apache.org/jira/browse/KYLIN-1447 > Project: Kylin > Issue Type: Bug > Components: Job Engine > Affects Versions: v2.1, v2.0 > Reporter: Hao Chen > > h1. Error Log > {code} > Build Result of Job SOURCE_TABLE - 20160101000000_20160201000000 - BUILD - > PST 2016-02-24 20:02:07 > Build Result: ERROR > Job Engine: kylin-job-engine.company.com > Cube Name: SOURCE_TABLE > Source Records Count: 0 > Start Time: Wed Feb 24 20:02:57 PST 2016 > Duration: 0mins > MR Waiting: 0mins > Last Update Time: Wed Feb 24 20:03:42 PST 2016 > Submitter: SOURCE_TABLE_USER > Error Log: OS command error exit with 1 -- hive -e "USE default; > DROP TABLE IF EXISTS kylin_intermediate_; > CREATE EXTERNAL TABLE IF NOT EXISTS > kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000 > ... > ROW FORMAT DELIMITED FIELDS TERMINATED BY '\177' > STORED AS SEQUENCEFILE > LOCATION '/kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000'; > SET mapred.job.queue.name=hddq-gdi-kylin; > SET dfs.replication=2; > SET dfs.block.size=32000000; > SET hive.exec.compress.output=true; > SET hive.auto.convert.join.noconditionaltask=true; > SET hive.auto.convert.join.noconditionaltask.size=300000000; > SET > mapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.SnappyCodec; > SET > mapreduce.output.fileoutputformat.compress.codec=org.apache.hadoop.io.compress.SnappyCodec; > SET hive.merge.mapfiles=true; > SET hive.merge.mapredfiles=true; > SET mapred.output.compression.type=BLOCK; > SET hive.merge.size.per.task=256000000; > SET hive.support.concurrency=false; > SET mapreduce.job.split.metainfo.maxsize=-1; > INSERT OVERWRITE TABLE > kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000 SELECT > ... > " > Logging initialized using configuration in file: > hive/conf/hive-log4j.properties > OK > Time taken: 0.598 seconds > OK > Time taken: 0.23 seconds > FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.DDLTask. > MetaException(message:javax.jdo.JDODataStoreException: Insert of object > "org.apache.hadoop.hive.metastore.model.MTable@3eff1c5f" using statement > "INSERT INTO "TBLS" > ("TBL_ID","VIEW_ORIGINAL_TEXT","CREATE_TIME","VIEW_EXPANDED_TEXT","RETENTION","SD_ID","LAST_ACCESS_TIME","DB_ID","TBL_NAME","OWNER","TBL_TYPE") > VALUES (?,?,?,?,?,?,?,?,?,?,?)" failed : Duplicate entry > 'kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000-' for key > 'UNIQUETABLE' > NestedThrowables: > com.mysql.jdbc.exceptions.MySQLIntegrityConstraintViolationException: > Duplicate entry > 'kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000-' for key > 'UNIQUETABLE') > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)