[
https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115739#comment-14115739
]
Stephen Watt commented on HDFS-6843:
------------------------------------
Andrew to your point about lowering the on-ramp for external folks to commit
code - I'd argue that the community would explicitly want a high on-ramp with
commensurate scrutiny for any modification to the Hadoop FileSystem Interface
given that the entire Hadoop ecosystem might be impacted by any change to that
interface.
I maintain glusterfs-hadoop (the hadoop filesystem plugin for glusterfs) and I
am a huge fan of having up-to-date filesystem contract tests. Yes, it requires
additional effort, but the advantage that you get is a broad alternative Hadoop
filesystem ecosystem that can validate their implementation of the Hadoop
FileSystem Interface contract. I think its unlikely that people will
voluntarily ensure the contract documentation and contract tests are up to date
whenever a change is made unless they are incented somehow to do so. I think
the question before the community is, "what process can we use to always ensure
the Hadoop FS contracts and tests are up to date?"
> Create FSDataInputStream & FSDataOutputStream isEncrypted() method
> ------------------------------------------------------------------
>
> Key: HDFS-6843
> URL: https://issues.apache.org/jira/browse/HDFS-6843
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: namenode, security
> Affects Versions: 3.0.0
> Reporter: Charles Lamb
> Assignee: Charles Lamb
> Attachments: HDFS-6843.001.patch, HDFS-6843.002.patch,
> HDFS-6843.003.patch
>
>
> FileStatus should have a 'boolean isEncrypted()' method. (it was in the
> context of discussing with AndreW about FileStatus being a Writable).
> Having this method would allow MR JobSubmitter do the following:
> -----
> BOOLEAN intermediateEncryption = false
> IF jobconf.contains("mr.intermidate.encryption") THEN
> intermediateEncryption = jobConf.getBoolean("mr.intermidate.encryption")
> ELSE
> IF (I/O)Format INSTANCEOF File(I/O)Format THEN
> intermediateEncryption = ANY File(I/O)Format HAS a Path with status
> isEncrypted()==TRUE
> FI
> jobConf.setBoolean("mr.intermidate.encryption", intermediateEncryption)
> FI
--
This message was sent by Atlassian JIRA
(v6.2#6252)
