[ https://issues.apache.org/jira/browse/HDFS-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240597#comment-17240597 ]
Matteo Minardi edited comment on HDFS-5328 at 11/30/20, 9:27 AM: ----------------------------------------------------------------- Any news on this? I get the same error. In the code I still see: {code:java} public void waitClusterUp() throws IOException { int i = 0; if (numDataNodes > 0) { while (!isClusterUp()) { try { LOG.warn("Waiting for the Mini HDFS Cluster to start..."); Thread.sleep(1000); } catch (InterruptedException e) { } if (++i > 10) { final String msg = "Timed out waiting for Mini HDFS Cluster to start"; LOG.error(msg); throw new IOException(msg); } } } } {code} With 10 hardcoded [~rvesse] [~tucu00] was (Author: mino181295): Any news on this? I get the same error. In the code I still see: {code:java} public void waitClusterUp() throws IOException { int i = 0; if (numDataNodes > 0) { while (!isClusterUp()) { try { LOG.warn("Waiting for the Mini HDFS Cluster to start..."); Thread.sleep(1000); } catch (InterruptedException e) { } if (++i > 10) { final String msg = "Timed out waiting for Mini HDFS Cluster to start"; LOG.error(msg); throw new IOException(msg); } } } } {code} With 10 hardcoded [~rvesse] [~tucu00] > MiniDFSCluster times out at startup > ----------------------------------- > > Key: HDFS-5328 > URL: https://issues.apache.org/jira/browse/HDFS-5328 > Project: Hadoop HDFS > Issue Type: Bug > Components: test > Affects Versions: 2.1.1-beta, 2.7.1, 3.0.0-alpha1 > Reporter: Alejandro Abdelnur > Priority: Major > Attachments: HDFS-5328.001.patch, HDFS-5328.002.patch > > > It seems MiniDFSCluster startup got slower lately and we are observing the > following intermittent failure on startup in our jenkins boxes: > {code} > java.io.IOException: Timed out waiting for Mini HDFS Cluster to start > at > org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:972) > at > org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:665) > at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:585) > at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:511) > {code} > By looking at the code the {{waitClusterUp()}} has a hardcoded 10secs timeout > (10 1 sec waits). > There are two things we should look at it, make the timeout configurable, and > more important, see what has changed to make the startup slower. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org