[ https://issues.apache.org/jira/browse/PHOENIX-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Akshita Malhotra reassigned PHOENIX-4353: ----------------------------------------- Assignee: Akshita Malhotra > Constraint violation error in Snapshot based index rebuild job > -------------------------------------------------------------- > > Key: PHOENIX-4353 > URL: https://issues.apache.org/jira/browse/PHOENIX-4353 > Project: Phoenix > Issue Type: Bug > Affects Versions: 4.13.0 > Reporter: Monani Mihir > Assignee: Akshita Malhotra > Priority: Critical > > When we try to rebuild index with data table snapshot, many mappers fails > with ERROR 218 (23018): Constraint violation. Example below :- > Cmd to run snapshot based index job :- > bin/hbase org.apache.phoenix.mapreduce.index.IndexTool -it DATA_INDEX -dt > DATA -s SCHEMA -snap -op /TEST/DATA_INDEX > Mappers failed with error :- > {code} > 2017-11-06 09:25:24,380 INFO [main] regionserver.HRegion - Onlined > eac5484a276e8d942e9eebf8275f114f; next sequenceid=18399282 > 2017-11-06 09:25:24,522 ERROR [main] index.PhoenixIndexImportMapper - Error > ERROR 218 (23018): Constraint violation. SCHEMA.DATA_INDEX.:DATA_ID may not > be null while read/write of a record > 2017-11-06 09:25:24,545 INFO [42e9eebf8275f114f.-1] regionserver.HStore - > Closed 0 > 2017-11-06 09:25:24,546 INFO [main] regionserver.HRegion - Closed > SCHEMA.DATA_INDEX,userID1234orgid1234,1509939061852.eac5484a276e8d942e9eebf8275f114f. > 2017-11-06 09:25:24,547 INFO [main] mapred.MapTask - Starting flush of map > output > 2017-11-06 09:25:24,557 INFO [main] compress.CodecPool - Got brand-new > compressor [.snappy] > 2017-11-06 09:25:24,560 WARN [main] mapred.YarnChild - Exception running > child : java.lang.RuntimeException: java.sql.SQLException: ERROR 218 (23018): > Constraint violation. SCHEMA.DATA_INDEX.:DATA_ID may not be null > at > org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(PhoenixIndexImportMapper.java:122) > at > org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(PhoenixIndexImportMapper.java:48) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1751) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164) > Caused by: java.sql.SQLException: ERROR 218 (23018): Constraint violation. > SCHEMA.DATA_INDEX.:DATA_ID may not be null > at > org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:488) > at > org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:150) > at > org.apache.phoenix.schema.ConstraintViolationException.<init>(ConstraintViolationException.java:39) > at org.apache.phoenix.schema.PTableImpl.newKey(PTableImpl.java:753) > at > org.apache.phoenix.compile.UpsertCompiler.setValues(UpsertCompiler.java:154) > at > org.apache.phoenix.compile.UpsertCompiler.access$500(UpsertCompiler.java:116) > at > org.apache.phoenix.compile.UpsertCompiler$4.execute(UpsertCompiler.java:1078) > at > org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:393) > at > org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:376) > at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53) > at > org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:374) > at > org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:363) > at > org.apache.phoenix.jdbc.PhoenixStatement.execute(PhoenixStatement.java:269) > at > org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPreparedStatement.java:172) > at > org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPreparedStatement.java:177) > at > org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(PhoenixIndexImportMapper.java:101) > ... 9 more > 2017-11-06 09:25:24,563 INFO [main] mapred.Task - Runnning cleanup for the > task > 2017-11-06 09:25:24,564 WARN [main] output.FileOutputCommitter - Could not > delete > hdfs://hdfs-local/TEST/DATA_INDEX/SCHEMA.DATA_INDEX/_temporary/1/_temporary/attempt_1508241002000_5658_m_000014_0 > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029)