:36
To: user@hbase.apache.org
Subject: Re: HBase file encryption, inconsistencies observed and data
loss
Yes in btw the restart the config was changed. In steps the #4 was that.
Wal encryption config is changed to false. Well that is ok but the
reader can not be changed. Because we dont find
Hi,
After step 4 ( i.e disabling of WAL encryption, removing
SecureProtobufReader/Writer and restart), read of encrypted WAL fails mainly
due to EOF exception at Basedecoder. This is not considered as error and these
WAL are being moved to /oldWALs.
Following is observed in log files:
Looking at HLogSplitter#getNextLogLine() :
try {
return in.next();
} catch (EOFException eof) {
// truncated files are expected if a RS crashes (see HBASE-2643)
LOG.info(EOF from hlog + path + . continuing);
return null;
The EOFException is not treated as
In BaseDecoder#rethrowEofException() :
if (!isEof) throw ioEx;
LOG.error(Partial cell read caused by EOF: + ioEx);
EOFException eofEx = new EOFException(Partial cell read);
eofEx.initCause(ioEx);
throw eofEx;
throwing EOFException would not propagate the Partial cell
Let's take this to JIRA
On Wed, Jul 30, 2014 at 12:50 PM, Ted Yu yuzhih...@gmail.com wrote:
In BaseDecoder#rethrowEofException() :
if (!isEof) throw ioEx;
LOG.error(Partial cell read caused by EOF: + ioEx);
EOFException eofEx = new EOFException(Partial cell read);
I logged HBASE-11620 for this issue.
If my proposal is accepted, I can provide a patch.
Cheers
On Wed, Jul 30, 2014 at 12:56 PM, Andrew Purtell apurt...@apache.org
wrote:
Let's take this to JIRA
On Wed, Jul 30, 2014 at 12:50 PM, Ted Yu yuzhih...@gmail.com wrote:
In
immediately and delete it!
-Original Message-
From: andrew.purt...@gmail.com [mailto:andrew.purt...@gmail.com
andrew.purt...@gmail.com] On Behalf Of Andrew Purtell
Sent: 26 July 2014 AM 02:21
To: user@hbase.apache.org
Subject: Re: HBase file encryption, inconsistencies observed
[mailto:andrew.purt...@gmail.com
andrew.purt...@gmail.com] On Behalf Of Andrew Purtell
Sent: 26 July 2014 AM 02:21
To: user@hbase.apache.org
Subject: Re: HBase file encryption, inconsistencies observed and data
loss
Encryption (or the lack of it) doesn't explain missing HFiles
Purtell
Sent: 26 July 2014 AM 02:21
To: user@hbase.apache.org
Subject: Re: HBase file encryption, inconsistencies observed and data
loss
Encryption (or the lack of it) doesn't explain missing HFiles.
Most likely if you are having a problem with encryption, this will
manifest
July 2014 AM 02:21
To: user@hbase.apache.org
Subject: Re: HBase file encryption, inconsistencies observed and data
loss
Encryption (or the lack of it) doesn't explain missing HFiles.
Most likely if you are having a problem with encryption, this will
manifest
it!
-Original Message-
From: andrew.purt...@gmail.com [mailto:andrew.purt...@gmail.com
andrew.purt...@gmail.com] On Behalf Of Andrew Purtell
Sent: 26 July 2014 AM 02:21
To: user@hbase.apache.org
Subject: Re: HBase file encryption, inconsistencies observed
-
From: andrew.purt...@gmail.com [mailto:andrew.purt...@gmail.com
andrew.purt...@gmail.com] On Behalf Of Andrew Purtell
Sent: 26 July 2014 AM 02:21
To: user@hbase.apache.org
Subject: Re: HBase file encryption, inconsistencies observed and data
loss
Encryption (or the lack
the sender by phone or email immediately and
delete it!
-Original Message-
From: andrew.purt...@gmail.com [mailto:andrew.purt...@gmail.com] On Behalf Of
Andrew Purtell
Sent: 26 July 2014 AM 02:21
To: user@hbase.apache.org
Subject: Re: HBase file encryption, inconsistencies observed and data
-
From: andrew.purt...@gmail.com [mailto:andrew.purt...@gmail.com] On Behalf Of
Andrew Purtell
Sent: 26 July 2014 AM 02:21
To: user@hbase.apache.org
Subject: Re: HBase file encryption, inconsistencies observed and data loss
Encryption (or the lack of it) doesn't explain missing HFiles
immediately and delete it!
-Original Message-
From: andrew.purt...@gmail.com [mailto:andrew.purt...@gmail.com
andrew.purt...@gmail.com] On Behalf Of Andrew Purtell
Sent: 26 July 2014 AM 02:21
To: user@hbase.apache.org
Subject: Re: HBase file encryption, inconsistencies observed
Encryption (or the lack of it) doesn't explain missing HFiles.
Most likely if you are having a problem with encryption, this will manifest
as follows: HFiles will be present. However, you will find many
IOExceptions in the regionserver logs as they attempt to open the HFiles
but fail because the
16 matches
Mail list logo
