[ 
https://issues.apache.org/jira/browse/HADOOP-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13613654#comment-13613654
 ] 

Steve Loughran commented on HADOOP-9371:
----------------------------------------

I've just published a copy of my branch of hadoop-trunk with this patch to 
github

This has auto rendering of the [MD 
file|https://github.com/steveloughran/hadoop-trunk/blob/stevel/HADOOP-9361-filesystem-contract/hadoop-common-project/hadoop-common/src/site/markdown/filesystem-contract.md]

I've merged in Mike's and Matt's comments already. 

Matt: that {{mkdirs()}} point is significant. Have you found code that expects 
atomic directory creation? If so, we'd better fix it.

(this makes me think of something else: a front end client to {{DFSClient}} 
that downconverts some of the ops to non-atomic. In the case of mkdirs, simply 
doing the mkdir chain client-side would suffice. I don't see an easy way to do 
the equivalent of {{mv}} without creating the dest dir then moving the entries 
below the original.)
                
> Define Semantics of FileSystem and FileContext more rigorously
> --------------------------------------------------------------
>
>                 Key: HADOOP-9371
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9371
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs
>    Affects Versions: 1.2.0, 3.0.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>         Attachments: HADOOP-9361.2.patch, HADOOP-9361.patch, 
> HadoopFilesystemContract.pdf
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> The semantics of {{FileSystem}} and {{FileContext}} are not completely 
> defined in terms of 
> # core expectations of a filesystem
> # consistency requirements.
> # concurrency requirements.
> # minimum scale limits
> Furthermore, methods are not defined strictly enough in terms of their 
> outcomes and failure modes.
> The requirements and method semantics should be defined more strictly.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to