[ https://issues.apache.org/jira/browse/HDFS-12163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16094984#comment-16094984 ]
Tsz Wo Nicholas Sze commented on HDFS-12163: -------------------------------------------- Running using mvn gives similar results. This problem is not specific to IntelliJ. - mvn test with 1-datanode cluster- | (distributed,1) | init | 5 | | (distributed,1) | MiniOzoneCluster | 401 | | (distributed,1) | shutdown | 53 | | (distributed,1) | sleep | 26 | | (GRPC,1) | init | 26 | | (GRPC,1) | MiniOzoneCluster | 421 | | (GRPC,1) | createRatisCluster | 431 | | (GRPC,1) | shutdown | 84 | | (GRPC,1) | sleep | 65 | | (local,1) | init | 65 | | (local,1) | MiniOzoneCluster | 461 | | (local,1) | shutdown | 113 | | (local,1) | sleep | 104 | | (NETTY,1) | init | 104 | | (NETTY,1) | MiniOzoneCluster | 504 | | (NETTY,1) | createRatisCluster | 526 | | (NETTY,1) | shutdown | 178 | | (NETTY,1) | sleep | 162 | - mvn test with 5-datanode clusters | (distributed,5) | init | 5 | | (distributed,5) | MiniOzoneCluster | 592 | | (distributed,5) | shutdown | 212 | | (distributed,5) | sleep | 93 | | (GRPC,5) | init | 93 | | (GRPC,5) | MiniOzoneCluster | 692 | | (GRPC,5) | createRatisCluster | 739 | | (GRPC,5) | shutdown | 359 | | (GRPC,5) | sleep | 289 | | (local,5) | init | 289 | | (local,5) | MiniOzoneCluster | 902 | | (local,5) | shutdown | 523 | | (local,5) | sleep | 501 | | (NETTY,5) | init | 501 | | (NETTY,5) | MiniOzoneCluster | 1152 | | (NETTY,5) | createRatisCluster | 1280 | | (NETTY,5) | shutdown | 903 | | (NETTY,5) | sleep | 845 | > Ozone: MiniOzoneCluster uses 400+ threads > ----------------------------------------- > > Key: HDFS-12163 > URL: https://issues.apache.org/jira/browse/HDFS-12163 > Project: Hadoop HDFS > Issue Type: Bug > Components: ozone, test > Reporter: Tsz Wo Nicholas Sze > Assignee: Weiwei Yang > Attachments: TestOzoneThreadCount20170719.patch > > > Checked the number of active threads used in MiniOzoneCluster with various > settings: > - Local handlers > - Distributed handlers > - Ratis-Netty > - Ratis-gRPC > The results are similar for all the settings. It uses 400+ threads for an > 1-datanode MiniOzoneCluster. > Moreover, there is a thread leak -- a number of the threads do not shutdown > after the test is finished. Therefore, when tests run consecutively, the > later tests use more threads. > Will post the details in comments. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org