[ 
https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

SammiChen updated HDFS-11268:
-----------------------------
    Description: Currently, FSImageFormatProtoBuf has the information about 
whether the file is striped or not and saved file's erasure coding policy ID in 
replication field. But later, when FSImage is loaded to create the name space, 
the default system erasure coding policy is used to reconstruct file's block 
structure.  In case if the erasure coding policy of file is not the default 
erasure coding policy, the content of the file cannot be accessed correctly.   
(was: Currently, FSImage only has the information about whether the file is 
striped or not. It doesn't save the erasure coding policy ID. Later, when the 
FSImage is loaded to create the name space, the default system ec policy is 
used to as file's ec policy.  In case if the ec policy on file is not the 
default ec policy, then the content of the file cannot be accessed correctly in 
this case. )

> Correctly reconstruct erasure coding file from FSImage
> ------------------------------------------------------
>
>                 Key: HDFS-11268
>                 URL: https://issues.apache.org/jira/browse/HDFS-11268
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: erasure-coding
>    Affects Versions: 3.0.0-alpha1
>            Reporter: SammiChen
>            Assignee: SammiChen
>            Priority: Critical
>              Labels: hdfs-ec-3.0-must-do
>
> Currently, FSImageFormatProtoBuf has the information about whether the file 
> is striped or not and saved file's erasure coding policy ID in replication 
> field. But later, when FSImage is loaded to create the name space, the 
> default system erasure coding policy is used to reconstruct file's block 
> structure.  In case if the erasure coding policy of file is not the default 
> erasure coding policy, the content of the file cannot be accessed correctly. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to