[
https://issues.apache.org/jira/browse/HDFS-543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hairong Kuang updated HDFS-543:
-------------------------------
Attachment: writeToReplica.patch
This patch
1. replaces writeToBlock by append, writeToTemporary, and writeToRbw to
FSDatasetInterface and implements these 3 APIs in both FSDataset and
SimulatedFSDataset.
2. Changes ReplicaInPipeline to make sure that each replica has only one writer.
3. When DataNode starts, replicas under tmp are removed.
4. Starting from this patch, any replicas created by a client are initially
placed under rbw sbudir and are loaded as RWR (ReplicaWaitingToBeRecovered) at
DataNode startup time. RWR replicas are sent as part of block reports.
Finalized & RWR are not distinguished in a block report for now.
> Break FSDatasetInterface#writeToBlock() into writeToTemporary, writeToRBW,
> and append
> -------------------------------------------------------------------------------------
>
> Key: HDFS-543
> URL: https://issues.apache.org/jira/browse/HDFS-543
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: data-node
> Affects Versions: Append Branch
> Reporter: Hairong Kuang
> Assignee: Hairong Kuang
> Fix For: Append Branch
>
> Attachments: writeToReplica.patch
>
>
> FSDatasetInterface#writeToBlock() currently allows to create/recover a
> temporary replica, create/recover a RBW replica, or append to a replica. The
> implementation of the method in FSDataset is very complicated and error
> prone. I'd like to break this method into 3:
> 1. writeToTemporary allows to create a Temporary replica or recover from a
> packet error for a Tempoary replica;
> 2. writeToRBW allows to create a RBW replica or recover from a packet error
> for a RBW replica;
> 3. append allows to append to an existing Finalized replica.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
