RE: DFSClient/DistriburedFileSystem fault injection?

2019-02-13 Thread Sergey Shelukhin
Loughran Sent: Tuesday, February 12, 2019 3:33 PM To: Sergey Shelukhin Cc: hdfs-dev@hadoop.apache.org Subject: Re: DFSClient/DistriburedFileSystem fault injection? Sergey -you trying to simulate failures client side, or do you have an NN Which actually injects failures all the way up the IPC stack

Re: DFSClient/DistriburedFileSystem fault injection?

2019-02-12 Thread Stephen Loughran
Sergey -you trying to simulate failures client side, or do you have an NN Which actually injects failures all the way up the IPC stack? as if its just client, couldn't registering a fault-injecting client as fs.hdfs.impl could do that FWIW, in the s3a connector we have the "inconsistent" s3 clien

Re: DFSClient/DistriburedFileSystem fault injection?

2019-02-12 Thread Wei-Chiu Chuang
For what is worth, At Cloudera we have an internal fault injection tool that is based on Chaos Monkey. We use it to kill disks or kill nodes, for example. So it doesn't instrument HDFS directly. On Mon, Feb 11, 2019 at 3:42 PM Sergey Shelukhin wrote: > Hi. > I've been looking for a client-side s

RE: DFSClient/DistriburedFileSystem fault injection?

2019-02-12 Thread Sergey Shelukhin
Adding the user list :) -Original Message- From: Sergey Shelukhin Sent: Monday, February 11, 2019 3:42 PM To: hdfs-dev@hadoop.apache.org Subject: DFSClient/DistriburedFileSystem fault injection? Hi. I've been looking for a client-side solution for fault injection in HDFS. We had a natura