Trying out the at rest encryption feature is very much appreciated, but perhaps we can spend a bit more time excluding other issues before declaring an encryption bug. So far there hasn't been one (knock on wood!) but a cursory search of user@hbase might imply the feature is buggy.
On Fri, Aug 8, 2014 at 2:24 AM, Esteban Gutierrez <[email protected]> wrote: > Good to know Shankar! that would also explain getting an EOF in the client. > > cheers, > esteban. > > > -- > Cloudera, Inc. > > > > On Fri, Aug 8, 2014 at 2:16 AM, Shankar hiremath < > [email protected]> wrote: > > > Hi Anoop/Esteban, > > > > I verified it, it not a problem. > > > > After the analysis we found that when our Hbase test client was trying to > > connect to Hmaster at that time file descriptors in the > > Hmaster side exhausted and it failed, after providing the sufficient file > > descriptors to Hmaster it worked fine. > > > > Thanks > > -Shankar > > > > > > This e-mail and its attachments contain confidential information from > > HUAWEI, which is intended only for the person or entity whose address is > > listed above. Any use of the information contained herein in any way > > (including, but not limited to, total or partial disclosure, > reproduction, > > or dissemination) by persons other than the intended recipient(s) is > > prohibited. If you receive this e-mail in error, please notify the sender > > by phone or email immediately and delete it! > > > > > > > > > > -----Original Message----- > > From: Shankar hiremath [mailto:[email protected]] > > Sent: 08 August 2014 PM 01:00 > > To: Anoop John; [email protected] > > Cc: [email protected] > > Subject: RE: flush table with AES encryption enabled for CF, randomly > > wrapException observed > > > > Hi Anoop/ Esteban, > > > > I will check it, as per your below suggestions, And I will update you the > > result. > > > > Thanks > > -Shankar > > > > ________________________________ > > This e-mail and its attachments contain confidential information from > > HUAWEI, which is intended only for the person or entity whose address is > > listed above. Any use of the information contained herein in any way > > (including, but not limited to, total or partial disclosure, > reproduction, > > or dissemination) by persons other than the intended recipient(s) is > > prohibited. If you receive this e-mail in error, please notify the sender > > by phone or email immediately and delete it! > > ________________________________ > > > > > > > > From: Anoop John [mailto:[email protected]] > > Sent: 08 August 2014 PM 12:08 > > To: [email protected] > > Cc: Shankar hiremath > > Subject: Re: flush table with AES encryption enabled for CF, randomly > > wrapException observed > > > > Shankar > > You are getting this only when the HFile encryption is enabled? > > Seeing the exception dont think it is directly related to Encryption or > > so. Suggest test with out encryption multiple times and see any time you > > get the same in that also > > > > -Anoop- > > On Fri, Aug 8, 2014 at 11:29 AM, Esteban Gutierrez <[email protected] > > <mailto:[email protected]>> wrote: > > Hi Shankar, > > > > Seems that your unit test is connecting to a HBase cluster and not using > > the HBaseTestingUtility, is that correct? since the exception is local > and > > not remote probably the master went down at the time your test tried to > > flush the region and that would explain the EOF. > > > > regards, > > esteban. > > > > > > > > -- > > Cloudera, Inc. > > > > > > > > On Thu, Aug 7, 2014 at 10:43 PM, Shankar hiremath < > > [email protected]<mailto:[email protected]>> wrote: > > > > > Hbase 0.98.3 > > > Hadoop 2.4.1 > > > > > > [X] > > > This e-mail and its attachments contain confidential information from > > > HUAWEI, which is intended only for the person or entity whose address > > > is listed above. Any use of the information contained herein in any > > > way (including, but not limited to, total or partial disclosure, > > > reproduction, or dissemination) by persons other than the intended > > > recipient(s) is prohibited. If you receive this e-mail in error, > > > please notify the sender by phone or email immediately and delete it! > > > [X] > > > > > > > > > > > > > > > _____________________________________________ > > > From: Shankar hiremath > > > Sent: 08 August 2014 AM 11:06 > > > To: '[email protected]<mailto:[email protected]>' > > > Subject: flush table with AES encryption enabled for CF, randomly > > > wrapException observed > > > > > > > > > I am getting the below exception during 'flush table' operation (when > > > the table with column families are AES encrypted) And it is randomly > > > coming, not always. > > > > > > Is it a bug, or any thing I missed in my test/config setup. > > > > > > java.io.IOException: Call to host1/hos1:60020 failed on local > exception: > > > java.io.EOFException > > > at > > > > org.apache.hadoop.hbase.ipc.RpcClient.wrapException(RpcClient.java:1485) > > > at > > org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1457) > > > at > > > > > > org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1657) > > > at > > > > > > org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1715) > > > at > > > > > > org.apache.hadoop.hbase.protobuf.generated.AdminProtos$AdminService$BlockingStub.flushRegion(AdminProtos.java:21705) > > > at > > > org.apache.hadoop.hbase.client.HBaseAdmin.flush(HBaseAdmin.java:1507) > > > at > > > org.apache.hadoop.hbase.client.HBaseAdmin.flush(HBaseAdmin.java:1487) > > > at > > > org.apache.hadoop.hbase.client.HBaseAdmin.flush(HBaseAdmin.java:1454) > > > at > > > com.huawei.csi.test.datasight.hadoop.hbase.HBase_limitConnection_DML.t > > > estForMultiplePutTableWithMultipleColumnHFileEncryption(HBase_limitCon > > > nection_DML.java:731) ==> our test case performing 'flush table' > > > operation > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > at > > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > > > at > > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > > > at java.lang.reflect.Method.invoke(Method.java:597) > > > at junit.framework.TestCase.runTest(TestCase.java:168) > > > at junit.framework.TestCase.runBare(TestCase.java:134) > > > at junit.framework.TestResult$1.protect(TestResult.java:110) > > > at junit.framework.TestResult.runProtected(TestResult.java:128) > > > at junit.framework.TestResult.run(TestResult.java:113) > > > at junit.framework.TestCase.run(TestCase.java:124) > > > at junit.framework.TestSuite.runTest(TestSuite.java:232) > > > at junit.framework.TestSuite.run(TestSuite.java:227) > > > at > > > > > > org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83) > > > at > > > > > > org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50) > > > at > > > > > > org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38) > > > at > > > > > > org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467) > > > at > > > > > > org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683) > > > at > > > > > > org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390) > > > at > > > org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTest > > > Runner.java:197) > > > Caused by: java.io.EOFException > > > at java.io.DataInputStream.readInt(DataInputStream.java:375) > > > at > > > > > > org.apache.hadoop.hbase.ipc.RpcClient$Connection.readResponse(RpcClient.java:1072) > > > at > > > org.apache.hadoop.hbase.ipc.RpcClient$Connection.run(RpcClient.java:72 > > > 8) > > > > > > > > > > > > [X] > > > This e-mail and its attachments contain confidential information from > > > HUAWEI, which is intended only for the person or entity whose address > > > is listed above. Any use of the information contained herein in any > > > way (including, but not limited to, total or partial disclosure, > > > reproduction, or dissemination) by persons other than the intended > > > recipient(s) is prohibited. If you receive this e-mail in error, > > > please notify the sender by phone or email immediately and delete it! > > > [X] > > > > > > > > > > > > > > > > > > > > > > > -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)
