RE: flush table with AES encryption enabled for CF, randomly wrapException observed

2014-08-08 Thread Shankar hiremath
or email immediately and delete it! From: Anoop John [mailto:anoop.hb...@gmail.com] Sent: 08 August 2014 PM 12:08 To: user@hbase.apache.org Cc: Shankar hiremath Subject: Re: flush table with AES encryption enabled for CF, randomly wrapException observed Shankar

flush table with AES encryption enabled for CF, randomly wrapException observed

2014-08-07 Thread Shankar hiremath
I am getting the below exception during 'flush table' operation (when the table with column families are AES encrypted) And it is randomly coming, not always. Is it a bug, or any thing I missed in my test/config setup. java.io.IOException: Call to host1/hos1:60020 failed on local exception:

RE: flush table with AES encryption enabled for CF, randomly wrapException observed

2014-08-07 Thread Shankar hiremath
disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! [X] _ From: Shankar hiremath Sent: 08

Problem reading HFile Trailer by using HFile tool

2014-08-01 Thread Shankar hiremath
When I am reading the Hfile using the './hbase org.apache.hadoop.hbase.io.hfile.Hfile' tool (the HFile which is compressed with SNAPPY encrypted with AES) I am getting the below error Problem reading HFile Trailer by using HFile tool Is there any problem in the usage of the below command, or

RE: Problem reading HFile Trailer by using HFile tool

2014-08-01 Thread Shankar hiremath
, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! [X] _ From: Shankar hiremath Sent: 01 August 2014 PM 07:43 To: user

RE: Problem reading HFile Trailer by using HFile tool

2014-08-01 Thread Shankar hiremath
] _ From: Shankar hiremath Sent: 01 August 2014 PM 07:53 To: 'user@hbase.apache.org' Subject: RE: Problem reading HFile Trailer by using HFile tool Actually the AES encryption for Hfile WAL is enabled in hbase-site.xml. But for the table 't3' column Family 'cf1' is not encrypted

RE: HBase file encryption, inconsistencies observed and data loss

2014-07-26 Thread Shankar hiremath
printed by the client. What kind of exceptions appear in the regionserver logs? Or appear in the master log? If the logs are large your best bet is to pastebin them and then send the URL to the paste in your response. On Fri, Jul 25, 2014 at 7:08 AM, Shankar hiremath shankar.hirem

HBase file encryption, inconsistencies observed and data loss

2014-07-25 Thread Shankar hiremath
HBase file encryption some inconsistencies observed and data loss happens after running the hbck tool, the operation steps are as below.(one thing what I observed is, on startup of HMaster if it is not able to process the WAL file, then also it moved to /oldWALs) Procedure: 1. Start the

Multiple RegionServers with different kerberose principle

2014-07-25 Thread Shankar hiremath
We have cluster with 1 Master and 2 Region Servers(RS1, RS2) with principle principle1/ho...@hadoop.commailto:principle1/ho...@hadoop.com Master and region server have the same principle as above. We changed the RS2 principle as principle2/ho...@hadoop.commailto:principle2/ho...@hadoop.com in

RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Shankar hiremath
Dear All, Observation: I have HBase cluster with Kerberos enabled, when the Region Server startups then we observed some 20-30 socket fds are in CLOSE_WAIT state, After that when the Region Server starts opening then the socket fds in CLOSE_WAIT starts increasing gradually (almost same as

RE: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Shankar hiremath
reduced based on the number of files compacted. Regards Ram On Thu, Jul 24, 2014 at 12:19 PM, Shankar hiremath shankar.hirem...@huawei.com wrote: Dear All, Observation: I have HBase cluster with Kerberos enabled, when the Region Server startups then we observed some 20-30 socket fds

RE: RegionServer many socket fds are in CLOSE_WAIT and not getting cleared

2014-07-24 Thread Shankar hiremath
? See if things are similar. Regards Ram On Thu, Jul 24, 2014 at 12:33 PM, Shankar hiremath shankar.hirem...@huawei.com wrote: Hi Ram, Actually It is not file FD, it is socket FD which is in CLOSE_WAIT state (tcp socket connection) java18028 shankar1 194u IPv6 18548560