[ 
https://issues.apache.org/jira/browse/HADOOP-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703171#comment-17703171
 ] 

Steve Loughran commented on HADOOP-18671:
-----------------------------------------

i do think the api could be pulled up, but it MUST be in its own interface(s) 
that only hdfs and ozone clients would have, not  FileSystem.

* add specs and contract tests
* use hasPathCapability to allow for an fs to implement the interface yet 
downgrade to not supporting.

Azure storage might be able to do the lease stuff. the safe mode calls are more 
cluster admin and maybe ought to be separated from leasing, possibly with 
security policy defined
* the outcome changed from bool to some enum of true/false/unsupported
* spec to define what a store should downgrade if unsupported. raising a new 
exception may be overkill and is certainly an api change. 


> Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem
> --------------------------------------------------------------------
>
>                 Key: HADOOP-18671
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18671
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs
>            Reporter: Wei-Chiu Chuang
>            Priority: Major
>
> We are in the midst of enabling HBase and Solr to run on Ozone.
> An obstacle is that HBase relies heavily on HDFS APIs and semantics for its 
> Write Ahead Log (WAL) file (similarly, for Solr's transaction log). We 
> propose to push up these HDFS APIs, i.e. recoverLease(), setSafeMode(), 
> isFileClosed() to FileSystem abstraction so that HBase and other applications 
> do not need to take on Ozone dependency at compile time. This work will 
> (hopefully) enable HBase to run on other storage system implementations in 
> the future.
> There are other HDFS features that HBase uses, including hedged read and 
> favored nodes. Those are FS-specific optimizations and are not critical to 
> enable HBase on Ozone.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to