Sergey Shelukhin created HBASE-21787: ----------------------------------------
Summary: proc WAL replaces a RIT that holds a lock with a RIT that doesn't Key: HBASE-21787 URL: https://issues.apache.org/jira/browse/HBASE-21787 Project: HBase Issue Type: Bug Affects Versions: 3.0.0 Reporter: Sergey Shelukhin This is not the same as the other bug I just filed, but related - after master restart, 2 RITs are both in proc WAL. According to the comment where RIT is restored, this is expected. However what happens is that master takes lock for the older RIT, and then replaces the older RIT with the newer RIT on the region. You can see two "to restore RIT" log lines. Both RITs are still active in procedures view (and stuck due to yet another bug that I will file later). However, it seems wrong that lock is held by one RIT but region points to the other RIT as the correct one. {noformat} 2019-01-25 11:26:54,616 INFO [master/master:17000:becomeActiveMaster] procedure.MasterProcedureScheduler: Took xlock for pid=1738, ppid=3, state=WAITING:REGION_STATE_TRANSITION_CONFIRM_OPENED, hasLock=false; TransitRegionStateProcedure table=table, region=27f7ab2a05d9d730b2ab2339d1531b8e, ASSIGN 2019-01-25 11:26:54,834 INFO [master/master:17000:becomeActiveMaster] assignment.AssignmentManager: Attach pid=1738, ppid=3, state=WAITING:REGION_STATE_TRANSITION_CONFIRM_OPENED, hasLock=false; TransitRegionStateProcedure table=table, region=27f7ab2a05d9d730b2ab2339d1531b8e, ASSIGN to rit=OFFLINE, location=null, table=table, region=27f7ab2a05d9d730b2ab2339d1531b8e to restore RIT 2019-01-25 11:26:54,853 INFO [master/master:17000:becomeActiveMaster] assignment.AssignmentManager: Attach pid=4351, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, hasLock=false; TransitRegionStateProcedure table=table, region=27f7ab2a05d9d730b2ab2339d1531b8e, ASSIGN to rit=OFFLINE, location=null, table=table, region=27f7ab2a05d9d730b2ab2339d1531b8e to restore RIT 2019-01-25 11:27:02,460 INFO [master/master:17000:becomeActiveMaster] assignment.RegionStateStore: Load hbase:meta entry region=27f7ab2a05d9d730b2ab2339d1531b8e, regionState=OPENING, lastHost=server1,17020,1548290445704, regionLocation=server2,17020,1548442571056, openSeqNum=120108 2019-01-25 11:27:10,184 INFO [PEWorker-11] procedure.MasterProcedureScheduler: Waiting on xlock for pid=4351, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, hasLock=false; TransitRegionStateProcedure table=table, region=27f7ab2a05d9d730b2ab2339d1531b8e, ASSIGN held by pid=1738 {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)