[ 
https://issues.apache.org/jira/browse/HDFS-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240597#comment-17240597
 ] 

Matteo Minardi edited comment on HDFS-5328 at 11/30/20, 9:27 AM:
-----------------------------------------------------------------

Any news on this? I get the same error.
 In the code I still see:
{code:java}
  public void waitClusterUp() throws IOException {
    int i = 0;
    if (numDataNodes > 0) {
      while (!isClusterUp()) {
        try {
          LOG.warn("Waiting for the Mini HDFS Cluster to start...");
          Thread.sleep(1000);
        } catch (InterruptedException e) {
        }
        if (++i > 10) {
          final String msg = "Timed out waiting for Mini HDFS Cluster to start";
          LOG.error(msg);
          throw new IOException(msg);
        }
      }
    }
  }
{code}
With 10 hardcoded
 [~rvesse] [~tucu00]


was (Author: mino181295):
Any news on this? I get the same error.
 In the code I still see:
{code:java}
  public void waitClusterUp() throws IOException {
    int i = 0;
    if (numDataNodes > 0) {
      while (!isClusterUp()) {
        try {
          LOG.warn("Waiting for the Mini HDFS Cluster to start...");
          Thread.sleep(1000);
        } catch (InterruptedException e) {
        }
        if (++i > 10) {
          final String msg = "Timed out waiting for Mini HDFS Cluster to start";
          LOG.error(msg);
          throw new IOException(msg);
        }
      }
    }
  }
{code}
With 10 hardcoded
[~rvesse] [~tucu00] 

 

> MiniDFSCluster times out at startup
> -----------------------------------
>
>                 Key: HDFS-5328
>                 URL: https://issues.apache.org/jira/browse/HDFS-5328
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 2.1.1-beta, 2.7.1, 3.0.0-alpha1
>            Reporter: Alejandro Abdelnur
>            Priority: Major
>         Attachments: HDFS-5328.001.patch, HDFS-5328.002.patch
>
>
> It seems MiniDFSCluster startup got slower lately and we are observing the 
> following intermittent failure on startup in our jenkins boxes:
> {code}
> java.io.IOException: Timed out waiting for Mini HDFS Cluster to start
>       at 
> org.apache.hadoop.hdfs.MiniDFSCluster.waitClusterUp(MiniDFSCluster.java:972)
>       at 
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:665)
>       at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:585)
>       at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:511)
> {code}
> By looking at the code the {{waitClusterUp()}} has a hardcoded 10secs timeout 
> (10 1 sec waits).
> There are two things we should look at it, make the timeout configurable, and 
> more important, see what has changed to make the startup slower.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to