[
https://issues.apache.org/jira/browse/HADOOP-18181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572428#comment-17572428
]
Steve Loughran commented on HADOOP-18181:
-----------------------------------------
I would like to move them to common so that the other cloud connectors can pick
up. abfs has its own, but the chinese cloudstore clients would benefit from all
this work.
for standard fs options, interesting thought. we could have them for openFile
calls -but should it really be the app making that decision explicitly?
What I don't want is hard coded options in binaries which stop you tuning in
deployments
with the read policy option of fs.option.openfile.read.policy coce can say
whether they are whole-file, sequential or random. would that suffice
maybe prefetch block size could be a hint, as all could use it. for things like
distcp a big value would be used and the other stores could also pick up
> move org.apache.hadoop.fs.common package into hadoop-common module
> -------------------------------------------------------------------
>
> Key: HADOOP-18181
> URL: https://issues.apache.org/jira/browse/HADOOP-18181
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.4.0
> Reporter: Steve Loughran
> Priority: Minor
>
> move org.apache.hadoop.fs.common package from hadoop-aws, along with any
> tests, into hadoop-common jar and the+ package org.apache.hadoop.fs.impl
> (except for any bits we find are broadly useful in applications to use any
> new APIs, in which case somewhere more public, such as o.a.h.util.functional
> for the futures work)
> we can and should pick on new package and move the classes there, even while
> they are in hadoop-aws. why so? lets us add checkstyle/findbugs rules with
> the final classnames
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
