steveloughran opened a new pull request, #5144:
URL: https://github.com/apache/hadoop/pull/5144

   
   This has triggered an OOM in a process which was churning through s3a fs 
instances; the increased memory footprint of IOStatistics amplified what must 
have been a long standing issue.
   
   * Makes sure instrumentation is closed when fs is closed
   * Uses a weak reference from metrics to instrumentation, so even if the fs 
wasn't closed (see HADOOP-18478), this ref would not be holding things back.
   
   
   ### How was this patch tested?
   
   cloud tests. no new tests...if there are suggestions, that'd be good
   
   ### For code changes:
   
   - [X] Does the title or this PR starts with the corresponding JIRA issue id 
(e.g. 'HADOOP-17799. Your PR title ...')?
   - [X] Object storage: have the integration tests been executed and the 
endpoint declared according to the connector-specific documentation?
   - [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)?
   - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, 
`NOTICE-binary` files?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to