For what is worth, At Cloudera we have an internal fault injection tool that is based on Chaos Monkey. We use it to kill disks or kill nodes, for example. So it doesn't instrument HDFS directly.
On Mon, Feb 11, 2019 at 3:42 PM Sergey Shelukhin <sergey.sheluk...@microsoft.com.invalid> wrote: > Hi. > I've been looking for a client-side solution for fault injection in HDFS. > We had a naturally unstable HDFS cluster that helped uncover a lot of > issues in HBase; now that it has been stabilized, we miss it already :) > > To keep testing without actually disrupting others' use of HDFS or having > to deploy a new version, I was thinking about having a client-side schema > (e.g. fhdfs) map to a wrapper over the standard DFS that would inject > failures and delays according to some configs, similar to > https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/FaultInjectFramework.html > > However I wonder if something like this exists already? > > --------------------------------------------------------------------- > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > >
