[
https://issues.apache.org/jira/browse/HBASE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
stack updated HBASE-2340:
-------------------------
Attachment: 2244-v6.patch
TestFullLogReconstruction works now after enabling dfs.append.support=true (and
other configs. from Nicolas hbase-2345) and making it so exiting regionserver
doesn't shutdown the filesystem (because then the filesystem is closed for
daemons in the JVM). The test runs for 200 seconds, mostly because we're
loading up a good bit of data. Could make it less I suppose.
I see this in test log:
{code}
2010-03-22 23:10:33,232 INFO [HMaster] regionserver.HLog(1096): Splitting 1
hlog(s) in
hdfs://localhost:61468/user/stack/.logs/192.168.1.157,61497,1269324534078
2010-03-22 23:10:33,232 DEBUG [HMaster] regionserver.HLog(1183): Splitting hlog
1 of 1:
hdfs://localhost:61468/user/stack/.logs/192.168.1.157,61497,1269324534078/hlog.dat.1269324534191,
length=0
2010-03-22 23:10:33,233 WARN [IPC Server handler 8 on 61468]
namenode.FSNamesystem(1144): DIR* NameSystem.startFile: failed to create file
/user/stack/.logs/192.168.1.157,61497,1269324534078/hlog.dat.1269324534191 for
DFSClient_343812212 on client 127.0.0.1 because current leaseholder is trying
to recreate file.
2010-03-22 23:10:33,240 INFO [HMaster] regionserver.HLog(1427): Failed open
for append, waiting on lease recovery:
hdfs://localhost:61468/user/stack/.logs/192.168.1.157,61497,1269324534078/hlog.dat.1269324534191
org.apache.hadoop.ipc.RemoteException:
org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: failed to create
file /user/stack/.logs/192.168.1.157,61497,1269324534078/hlog.dat.1269324534191
for DFSClient_343812212 on client 127.0.0.1 because current leaseholder is
trying to recreate file.
...
{code}
... and after RS fully goes down we're able to open the log and process its
content.
> Add end-to-end test of sync/flush
> ---------------------------------
>
> Key: HBASE-2340
> URL: https://issues.apache.org/jira/browse/HBASE-2340
> Project: Hadoop HBase
> Issue Type: Task
> Reporter: stack
> Assignee: stack
> Priority: Blocker
> Fix For: 0.20.4, 0.21.0
>
> Attachments: 2244-v6.patch, 2340.patch
>
>
> Add a test to do the following:
> {code}
> + Start a HBase/HDFS cluster (local node is fine).
> + Use top-level (HTable) level APIs to put items.
> + Try about single column puts, as well as puts which span multiple
> columns/multiple column families, etc.
> + Then kill one region server.
> + Wait for recovery to happen.
> + And then check the rows exist.
> {code}
> Assigning myself.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
