steveloughran opened a new pull request #2069: URL: https://github.com/apache/hadoop/pull/2069
IOStatistics API in hadoop common and s3afs impl. @mehakmeet has been working on an abfs version 1. this is #1982 rebased to trunk 1. i do plan to submit the s3a side of the stats separately; but having it together helps me work on an API which is useful for apps. 1. #1982 discusses the evolution of the design. Specifically -------- > having written the new extensible design, I've decided I don't like it. It is too complex as I'm trying to support arbitrary arity tuples of any kind of statistic.it makes iterating/parsing this stuff way too complex > > here's a better idea: we only support a limited set; > > * counter: long > * min; long > * max: long > * mean (double, long) > * gauge; long > > 1. all but gauge have simple aggregation, for gauge i'll add stuff up too, on the assumption that they will be positive values (e.g 'number of active reads') > 2. and every set will have its own iterator. > > what do people think? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
