[jira] [Commented] (HBASE-18810) TestClientScannerRPCTimeout failing in branch-1 / branch-1.4
[ https://issues.apache.org/jira/browse/HBASE-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169167#comment-16169167 ] Chia-Ping Tsai commented on HBASE-18810: I have attached the patch in HBASE-18415. [~apurtell] Please take a look if you have free time. Thanks. > TestClientScannerRPCTimeout failing in branch-1 / branch-1.4 > > > Key: HBASE-18810 > URL: https://issues.apache.org/jira/browse/HBASE-18810 > Project: HBase > Issue Type: Bug >Reporter: Andrew Purtell >Assignee: Andrew Purtell > Fix For: 1.4.0, 1.5.0 > > > TestClientScannerRPCTimeout is failing in branch-1 / branch-1.4, but it's a > setup problem involving CreateTableProcedure. Fails for me the first time in > both Linux and MacOS dev environments. > Bisect says this is the cause, been there for a while > {noformat} > commit af359d03b5e2cc798cee8ba52d2a9fcbb1022104 > Author: Stephen Yuan Jiang > Date: Tue Jul 18 06:58:29 2017 -0700 > HBASE-16488 Starting namespace and quota services in master startup > asynchronizely (Stephen Yuan Jiang) > {noformat} > and sure enough, if I revert HBASE-16488 from branch-1 / branch-1.4 then the > test passes again. > {noformat} > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.211 sec <<< > FAILURE! - in org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout > testScannerNextRPCTimesout(org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout) > Time elapsed: 6.248 sec <<< ERROR! > org.apache.hadoop.hbase.TableExistsException: testScannerNextRPCTimesout > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:526) > at > org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) > at > org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95) > at > org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45) > at > org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4774) > at > org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4732) > at > org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4665) > at > org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:679) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1500) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1547) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1438) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1414) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1370) > at > org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout.testScannerNextRPCTimesout(TestClientScannerRPCTimeout.java:87) > Caused by: org.apache.hadoop.ipc.RemoteException: testScannerNextRPCTimesout > at > org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.prepareCreate(CreateTableProcedure.java:286) > at > org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:107) > at > org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:59) > at > org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:139) > at > org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:506) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1152) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:940) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:893) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:76) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:478) > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-18810) TestClientScannerRPCTimeout failing in branch-1 / branch-1.4
[ https://issues.apache.org/jira/browse/HBASE-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167374#comment-16167374 ] Chia-Ping Tsai commented on HBASE-18810: The error is due to the retry mechanism. If the first quest is timeout, the client will retry with different group/nonce. And then, the TableExistsException occurs if the second request is executed after first request has be finished. This bug can be reproduced by making MasterObserver#postCreateTable() sleep. > TestClientScannerRPCTimeout failing in branch-1 / branch-1.4 > > > Key: HBASE-18810 > URL: https://issues.apache.org/jira/browse/HBASE-18810 > Project: HBase > Issue Type: Bug >Reporter: Andrew Purtell >Assignee: Andrew Purtell > Fix For: 1.4.0, 1.5.0 > > > TestClientScannerRPCTimeout is failing in branch-1 / branch-1.4, but it's a > setup problem involving CreateTableProcedure. Fails for me the first time in > both Linux and MacOS dev environments. > Bisect says this is the cause, been there for a while > {noformat} > commit af359d03b5e2cc798cee8ba52d2a9fcbb1022104 > Author: Stephen Yuan Jiang > Date: Tue Jul 18 06:58:29 2017 -0700 > HBASE-16488 Starting namespace and quota services in master startup > asynchronizely (Stephen Yuan Jiang) > {noformat} > and sure enough, if I revert HBASE-16488 from branch-1 / branch-1.4 then the > test passes again. > {noformat} > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.211 sec <<< > FAILURE! - in org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout > testScannerNextRPCTimesout(org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout) > Time elapsed: 6.248 sec <<< ERROR! > org.apache.hadoop.hbase.TableExistsException: testScannerNextRPCTimesout > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:526) > at > org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) > at > org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95) > at > org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45) > at > org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4774) > at > org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4732) > at > org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4665) > at > org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:679) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1500) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1547) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1438) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1414) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1370) > at > org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout.testScannerNextRPCTimesout(TestClientScannerRPCTimeout.java:87) > Caused by: org.apache.hadoop.ipc.RemoteException: testScannerNextRPCTimesout > at > org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.prepareCreate(CreateTableProcedure.java:286) > at > org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:107) > at > org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:59) > at > org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:139) > at > org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:506) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1152) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:940) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:893) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:76) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:478) > {noformat} -- This message was sent by Atlassian JIRA (
[jira] [Commented] (HBASE-18810) TestClientScannerRPCTimeout failing in branch-1 / branch-1.4
[ https://issues.apache.org/jira/browse/HBASE-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165244#comment-16165244 ] Andrew Purtell commented on HBASE-18810: I'm checking for impact of the revert on other tests, but I plan to revert. > TestClientScannerRPCTimeout failing in branch-1 / branch-1.4 > > > Key: HBASE-18810 > URL: https://issues.apache.org/jira/browse/HBASE-18810 > Project: HBase > Issue Type: Bug >Reporter: Andrew Purtell > > TestClientScannerRPCTimeout is failing in branch-1 / branch-1.4, but it's a > setup problem involving CreateTableProcedure. Fails for me the first time in > both Linux and MacOS dev environments. > Bisect says this is the cause, been there for a while > {noformat} > commit af359d03b5e2cc798cee8ba52d2a9fcbb1022104 > Author: Stephen Yuan Jiang > Date: Tue Jul 18 06:58:29 2017 -0700 > HBASE-16488 Starting namespace and quota services in master startup > asynchronizely (Stephen Yuan Jiang) > {noformat} > and sure enough, if I revert HBASE-16488 from branch-1 / branch-1.4 then the > test passes again. > {noformat} > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.211 sec <<< > FAILURE! - in org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout > testScannerNextRPCTimesout(org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout) > Time elapsed: 6.248 sec <<< ERROR! > org.apache.hadoop.hbase.TableExistsException: testScannerNextRPCTimesout > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:526) > at > org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) > at > org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95) > at > org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45) > at > org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4774) > at > org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4732) > at > org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4665) > at > org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:679) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1500) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1547) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1438) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1414) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1370) > at > org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout.testScannerNextRPCTimesout(TestClientScannerRPCTimeout.java:87) > Caused by: org.apache.hadoop.ipc.RemoteException: testScannerNextRPCTimesout > at > org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.prepareCreate(CreateTableProcedure.java:286) > at > org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:107) > at > org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:59) > at > org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:139) > at > org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:506) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1152) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:940) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:893) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:76) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:478) > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HBASE-18810) TestClientScannerRPCTimeout failing in branch-1 / branch-1.4
[ https://issues.apache.org/jira/browse/HBASE-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165230#comment-16165230 ] Andrew Purtell commented on HBASE-18810: Oddly a bisect traces this failure to HBASE-16488, and if I revert that commit from branch-1 / branch-1.4, then the test passes again. I find that HBASE-16488 is still in PA state even though the change was committed at least to implicated branches, so I am inclined to revert the change given that irregularity. > TestClientScannerRPCTimeout failing in branch-1 / branch-1.4 > > > Key: HBASE-18810 > URL: https://issues.apache.org/jira/browse/HBASE-18810 > Project: HBase > Issue Type: Bug >Reporter: Andrew Purtell > > TestClientScannerRPCTimeout is failing in branch-1 / branch-1.4, but it's a > setup problem involving CreateTableProcedure. Fails for me the first time in > both Linux and MacOS dev environments. > Bisect says this is the cause, been there for a while > {noformat} > commit af359d03b5e2cc798cee8ba52d2a9fcbb1022104 > Author: Stephen Yuan Jiang > Date: Tue Jul 18 06:58:29 2017 -0700 > HBASE-16488 Starting namespace and quota services in master startup > asynchronizely (Stephen Yuan Jiang) > {noformat} > and sure enough, if I revert HBASE-16488 from branch-1 / branch-1.4 then the > test passes again. > {noformat} > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.211 sec <<< > FAILURE! - in org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout > testScannerNextRPCTimesout(org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout) > Time elapsed: 6.248 sec <<< ERROR! > org.apache.hadoop.hbase.TableExistsException: testScannerNextRPCTimesout > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:526) > at > org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) > at > org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95) > at > org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45) > at > org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.convertResult(HBaseAdmin.java:4774) > at > org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4732) > at > org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4665) > at > org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:679) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1500) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1547) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1438) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1414) > at > org.apache.hadoop.hbase.HBaseTestingUtility.createTable(HBaseTestingUtility.java:1370) > at > org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout.testScannerNextRPCTimesout(TestClientScannerRPCTimeout.java:87) > Caused by: org.apache.hadoop.ipc.RemoteException: testScannerNextRPCTimesout > at > org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.prepareCreate(CreateTableProcedure.java:286) > at > org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:107) > at > org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:59) > at > org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:139) > at > org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:506) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1152) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:940) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:893) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$400(ProcedureExecutor.java:76) > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor$2.run(ProcedureExecutor.java:478) > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)