Steve Loughran created HADOOP-17470: ---------------------------------------
Summary: Collect more S3A IOStatistics Key: HADOOP-17470 URL: https://issues.apache.org/jira/browse/HADOOP-17470 Project: Hadoop Common Issue Type: Sub-task Components: fs/s3 Reporter: Steve Loughran collect more stats of * how long FS API calls are taking * what is going wrong API * Duration of rename(), delete() other common API Calls. * openFile: how long the open operation is taking, split of open and openfile * time to initialize FS instance (maybe better in FileSystem.cache?) * create: Time to complete the create checks * finishedWrite: time to execute finishedWrite operations (which may include bulk deletes) Failure tracking: what failures are we seeing as counters Interrupts, connections, auth failures: This would be done in S3ARetryPolicy with an IOStatisticsStore passed in. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org