zuston opened a new issue, #772:
URL: https://github.com/apache/incubator-uniffle/issues/772

   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [X] I have searched in the 
[issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and 
found no similar issues.
   
   
   ### Describe the bug
   
   The hadoop filesystem instance will be created too many time in cache, which 
will cause the shuffle server memory leak.
   
   As we know, the filesystem cache's key is based on the scheme态authority and 
ugi. The scheme and authority are not changed everytime. But for ugi, if we 
invoke the createProxyUser, it will always create a new one, that means the 
every invoking `Filesystem.get()` , it will be cached due to different key.
   
   We should cache the proxy user ugi to avoid caching every time.
   
   ### Affects Version(s)
   
   master
   
   ### Uniffle Server Log Output
   
   _No response_
   
   ### Uniffle Engine Log Output
   
   _No response_
   
   ### Uniffle Server Configurations
   
   _No response_
   
   ### Uniffle Engine Configurations
   
   _No response_
   
   ### Additional context
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to