RE: [DISCUSS] Deprecate fuse-dfs

2018-10-03 Thread Shingo Furuyama
for our use case. If no one has use case of fuse-dfs in the community, there is no reason for us to adhere to using and maintaining fuse-dfs. Shingo -Original Message- From: Wei-Chiu Chuang Sent: Tuesday, October 2, 2018 11:22 PM To: 古山 慎悟 Cc: Hadoop Common Subject: Re: [DISCUSS] De

Re: [DISCUSS] Deprecate fuse-dfs

2018-10-02 Thread Wei-Chiu Chuang
Thank you Shingo, Could you shade more lights on the ML use case? Is it because the ML frameworks are not written in Java so they can't use HDFS client libraries? How about using WebHDFS? I'm sure there are python bindings for WebHDFS. Or NFS Gateway? The fact is, there are a few ways to access H

Re: [DISCUSS] Deprecate fuse-dfs

2018-10-01 Thread Shingo Furuyama
Hi folks, Recently we started investigating fuse-dfs for use of ML frameworks on k8s. I think that it is convenient way for data scientist to support access to HDFS via FUSE. We also expect that we do not need to implement a function for HDFS access each ML frameworks. I guess it is common use

[DISCUSS] Deprecate fuse-dfs

2018-10-01 Thread Wei-Chiu Chuang
Hi fellow Hadoop developers, I want to start this thread to raise the awareness of the quality of fuse-dfs. It appears that this sub-component is not being developed and maintained, and appears not many are using it. In the past two years, there has been only one bug fixed (HDFS-13322). https:/