[ https://issues.apache.org/jira/browse/HDFS-12163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16093848#comment-16093848 ]
Tsz Wo Nicholas Sze commented on HDFS-12163: -------------------------------------------- 5-datanode tests - Local handlers with 5 datanode | (local,5) | init | 6 | | (local,5) | MiniOzoneCluster | 589 | | (local,5) | shutdown | 209 | | (local,5) | sleep | 89 | - Distributed handlers with 5 datanode | (distributed,5) | init | 6 | | (distributed,5) | MiniOzoneCluster | 589 | | (distributed,5) | shutdown | 209 | | (distributed,5) | sleep | 89 | - Ratis-Netty handlers with 5 datanode | (NETTY,5) | init | 6 | | (NETTY,5) | MiniOzoneCluster | 600 | | (NETTY,5) | createRatisCluster | 712 | | (NETTY,5) | shutdown | 332 | | (NETTY,5) | sleep | 132 | - Ratis-gRPC handlers with 5 datanode | (GRPC,5) | init | 6 | | (GRPC,5) | MiniOzoneCluster | 596 | | (GRPC,5) | createRatisCluster | 637 | | (GRPC,5) | shutdown | 257 | | (GRPC,5) | sleep | 138 | - All 4 cases above running consecutively. | (distributed,5) | init | 6 | | (distributed,5) | MiniOzoneCluster | 589 | | (distributed,5) | shutdown | 209 | | (distributed,5) | sleep | 90 | | (GRPC,5) | init | 90 | | (GRPC,5) | MiniOzoneCluster | 691 | | (GRPC,5) | createRatisCluster | 740 | | (GRPC,5) | shutdown | 360 | | (GRPC,5) | sleep | 290 | | (local,5) | init | 290 | | (local,5) | MiniOzoneCluster | 907 | | (local,5) | shutdown | 527 | | (local,5) | sleep | 505 | | (NETTY,5) | init | 505 | | (NETTY,5) | MiniOzoneCluster | 1147 | | (NETTY,5) | createRatisCluster | 1269 | | (NETTY,5) | shutdown | 890 | | (NETTY,5) | sleep | 838 | > Ozone: MiniOzoneCluster uses 400+ threads > ----------------------------------------- > > Key: HDFS-12163 > URL: https://issues.apache.org/jira/browse/HDFS-12163 > Project: Hadoop HDFS > Issue Type: Bug > Components: ozone, test > Reporter: Tsz Wo Nicholas Sze > Attachments: TestOzoneThreadCount20170719.patch > > > Checked the number of active threads used in MiniOzoneCluster with various > settings: > - Local handlers > - Distributed handlers > - Ratis-Netty > - Ratis-gRPC > The results are similar for all the settings. It uses 400+ threads for an > 1-datanode MiniOzoneCluster. > Moreover, there is a thread leak -- a number of the threads do not shutdown > after the test is finished. Therefore, when tests run consecutively, the > later tests use more threads. > Will post the details in comments. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org