[
https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15864944#comment-15864944
]
Kai Zheng commented on HDFS-7859:
---------------------------------
Thanks Andrew for working on this and bringing up the discussion.
1. For the system default EC policy, I agree its importance becomes weak now. A
question is, when users set a EC policy to a folder, do they want to or have to
specify a policy in most time? Making the policy parameter optional could be
friendly considering they may have no idea before the list of available
policies promoted to them.
2. EC policy and schema could be a nice fit and thought of file meta data. EC
is another form of replica, I guess replica factor is recorded per file. If EC
policy info get persisted and stay along with data, users might feel more
confident and comfortable to do data validation and transformation in system
upgrading. I may echo what's said in previous comments by others, configuration
and codes may change and evolve.
> Erasure Coding: Persist erasure coding policies in NameNode
> -----------------------------------------------------------
>
> Key: HDFS-7859
> URL: https://issues.apache.org/jira/browse/HDFS-7859
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Kai Zheng
> Assignee: Andrew Wang
> Priority: Blocker
> Labels: BB2015-05-TBR, hdfs-ec-3.0-must-do
> Attachments: HDFS-7859.001.patch, HDFS-7859.002.patch,
> HDFS-7859.004.patch, HDFS-7859.005.patch, HDFS-7859.006.patch,
> HDFS-7859.007.patch, HDFS-7859.008.patch, HDFS-7859.009.patch,
> HDFS-7859-HDFS-7285.002.patch, HDFS-7859-HDFS-7285.002.patch,
> HDFS-7859-HDFS-7285.003.patch
>
>
> In meetup discussion with [~zhz] and [~jingzhao], it's suggested that we
> persist EC schemas in NameNode centrally and reliably, so that EC zones can
> reference them by name efficiently.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
