[jira] [Commented] (SOLR-13297) StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3
[ https://issues.apache.org/jira/browse/SOLR-13297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795873#comment-16795873 ] ASF subversion and git services commented on SOLR-13297: Commit 6064b03ac6f61b077dcfc6262568e466f2bf6467 in lucene-solr's branch refs/heads/branch_8x from Kevin Risden [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=6064b03ac ] SOLR-13330: Improve HDFS tests Related JIRAs: * SOLR-11010 * SOLR-11381 * SOLR-12040 * SOLR-13297 Changes: * Consolidate hdfs configuration into HdfsTestUtil * Ensure socketTimeout long enough for HDFS tests * Ensure HdfsTestUtil.getClientConfiguration used in tests * Replace deprecated HDFS calls * Use try-with-resources to ensure closing of HDFS resources Signed-off-by: Kevin Risden > StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3 > - > > Key: SOLR-13297 > URL: https://issues.apache.org/jira/browse/SOLR-13297 > Project: Solr > Issue Type: Test > Security Level: Public(Default Security Level. Issues are Public) > Components: Hadoop Integration, hdfs, Tests >Reporter: Kevin Risden >Assignee: Kevin Risden >Priority: Major > Attachments: builds.a.o_solr_badapple_nightly_8x_7.txt.gz, > builds.a.o_solr_badapple_nightly_master_51.txt.gz, > builds.a.o_solr_nightly_8x_36.txt.gz, builds.a.o_solr_repro_2965.txt.gz > > > As reported by [~hossman] on SOLR-9515, StressHdfsTest and > HdfsUnloadDistributedZkTest are failing more regularly. Should figure out > what is going on here. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13297) StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3
[ https://issues.apache.org/jira/browse/SOLR-13297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795868#comment-16795868 ] ASF subversion and git services commented on SOLR-13297: Commit cf828163bdfa010c87f1171b6919e444bd0ff01c in lucene-solr's branch refs/heads/master from Kevin Risden [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=cf82816 ] SOLR-13330: Improve HDFS tests Related JIRAs: * SOLR-11010 * SOLR-11381 * SOLR-12040 * SOLR-13297 Changes: * Consolidate hdfs configuration into HdfsTestUtil * Ensure socketTimeout long enough for HDFS tests * Ensure HdfsTestUtil.getClientConfiguration used in tests * Replace deprecated HDFS calls * Use try-with-resources to ensure closing of HDFS resources Signed-off-by: Kevin Risden > StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3 > - > > Key: SOLR-13297 > URL: https://issues.apache.org/jira/browse/SOLR-13297 > Project: Solr > Issue Type: Test > Security Level: Public(Default Security Level. Issues are Public) > Components: Hadoop Integration, hdfs, Tests >Reporter: Kevin Risden >Assignee: Kevin Risden >Priority: Major > Attachments: builds.a.o_solr_badapple_nightly_8x_7.txt.gz, > builds.a.o_solr_badapple_nightly_master_51.txt.gz, > builds.a.o_solr_nightly_8x_36.txt.gz, builds.a.o_solr_repro_2965.txt.gz > > > As reported by [~hossman] on SOLR-9515, StressHdfsTest and > HdfsUnloadDistributedZkTest are failing more regularly. Should figure out > what is going on here. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13297) StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3
[ https://issues.apache.org/jira/browse/SOLR-13297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787963#comment-16787963 ] Kevin Risden commented on SOLR-13297: - In the one case HdfsUnloadDistributedZkTest, should be fixed by SOLR-13307, in the reproduction case there is something else going on. I'll look at that separately after SOLR-13307. > StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3 > - > > Key: SOLR-13297 > URL: https://issues.apache.org/jira/browse/SOLR-13297 > Project: Solr > Issue Type: Test > Security Level: Public(Default Security Level. Issues are Public) > Components: Hadoop Integration, hdfs, Tests >Reporter: Kevin Risden >Assignee: Kevin Risden >Priority: Major > Attachments: builds.a.o_solr_badapple_nightly_8x_7.txt.gz, > builds.a.o_solr_badapple_nightly_master_51.txt.gz, > builds.a.o_solr_nightly_8x_36.txt.gz, builds.a.o_solr_repro_2965.txt.gz > > > As reported by [~hossman] on SOLR-9515, StressHdfsTest and > HdfsUnloadDistributedZkTest are failing more regularly. Should figure out > what is going on here. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13297) StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3
[ https://issues.apache.org/jira/browse/SOLR-13297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787962#comment-16787962 ] Kevin Risden commented on SOLR-13297: - Went through the logs for StressHdfsTest and in each case SOLR-13307 should help. Checking logs for HdfsUnloadDistributedZkTest > StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3 > - > > Key: SOLR-13297 > URL: https://issues.apache.org/jira/browse/SOLR-13297 > Project: Solr > Issue Type: Test > Security Level: Public(Default Security Level. Issues are Public) > Components: Hadoop Integration, hdfs, Tests >Reporter: Kevin Risden >Assignee: Kevin Risden >Priority: Major > Attachments: builds.a.o_solr_badapple_nightly_8x_7.txt.gz, > builds.a.o_solr_badapple_nightly_master_51.txt.gz, > builds.a.o_solr_nightly_8x_36.txt.gz, builds.a.o_solr_repro_2965.txt.gz > > > As reported by [~hossman] on SOLR-9515, StressHdfsTest and > HdfsUnloadDistributedZkTest are failing more regularly. Should figure out > what is going on here. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13297) StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3
[ https://issues.apache.org/jira/browse/SOLR-13297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787462#comment-16787462 ] Kevin Risden commented on SOLR-13297: - Well I think I found part of the problem. There are HDFS tests that don't clear the system properties they set. I found it by mistake by setting some HDFS system properties and caused the tests to fail every time. I looked through the logs and saw that there are a few HDFS tests that don't clear the set properties at the end. > StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3 > - > > Key: SOLR-13297 > URL: https://issues.apache.org/jira/browse/SOLR-13297 > Project: Solr > Issue Type: Test > Security Level: Public(Default Security Level. Issues are Public) > Components: Hadoop Integration, hdfs, Tests >Reporter: Kevin Risden >Assignee: Kevin Risden >Priority: Major > Attachments: builds.a.o_solr_badapple_nightly_8x_7.txt.gz, > builds.a.o_solr_badapple_nightly_master_51.txt.gz, > builds.a.o_solr_nightly_8x_36.txt.gz, builds.a.o_solr_repro_2965.txt.gz > > > As reported by [~hossman] on SOLR-9515, StressHdfsTest and > HdfsUnloadDistributedZkTest are failing more regularly. Should figure out > what is going on here. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13297) StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3
[ https://issues.apache.org/jira/browse/SOLR-13297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787109#comment-16787109 ] Kevin Risden commented on SOLR-13297: - Found one reproducing seed for StressHdfsTest so far: ant test -Dtestcase=StressHdfsTest -Dtests.method=test -Dtests.seed=7CEDDB984CC02F13 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=zh-TW -Dtests.timezone=Africa/Libreville -Dtests.asserts=true -Dtests.file.encoding=UTF-8 > StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3 > - > > Key: SOLR-13297 > URL: https://issues.apache.org/jira/browse/SOLR-13297 > Project: Solr > Issue Type: Test > Security Level: Public(Default Security Level. Issues are Public) > Components: Hadoop Integration, hdfs, Tests >Reporter: Kevin Risden >Assignee: Kevin Risden >Priority: Major > Attachments: builds.a.o_solr_badapple_nightly_8x_7.txt.gz, > builds.a.o_solr_badapple_nightly_master_51.txt.gz, > builds.a.o_solr_nightly_8x_36.txt.gz, builds.a.o_solr_repro_2965.txt.gz > > > As reported by [~hossman] on SOLR-9515, StressHdfsTest and > HdfsUnloadDistributedZkTest are failing more regularly. Should figure out > what is going on here. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13297) StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3
[ https://issues.apache.org/jira/browse/SOLR-13297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786229#comment-16786229 ] Kevin Risden commented on SOLR-13297: - Found one reproducing seed so far: ant test -Dtestcase=HdfsUnloadDistributedZkTest -Dtests.method=test -Dtests.seed=B3481DA6733BF9BC -Dtests.nightly=true -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=de-LU -Dtests.timezone=Europe/Bratislava -Dtests.asserts=true -Dtests.file.encoding=UTF-8 > StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3 > - > > Key: SOLR-13297 > URL: https://issues.apache.org/jira/browse/SOLR-13297 > Project: Solr > Issue Type: Test > Security Level: Public(Default Security Level. Issues are Public) > Components: Hadoop Integration, hdfs, Tests >Reporter: Kevin Risden >Assignee: Kevin Risden >Priority: Major > Attachments: builds.a.o_solr_badapple_nightly_8x_7.txt.gz, > builds.a.o_solr_badapple_nightly_master_51.txt.gz, > builds.a.o_solr_nightly_8x_36.txt.gz, builds.a.o_solr_repro_2965.txt.gz > > > As reported by [~hossman] on SOLR-9515, StressHdfsTest and > HdfsUnloadDistributedZkTest are failing more regularly. Should figure out > what is going on here. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13297) StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3
[ https://issues.apache.org/jira/browse/SOLR-13297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785974#comment-16785974 ] Kevin Risden commented on SOLR-13297: - Uploaded two examples of HdfsUnloadDistributedZkTest * [^builds.a.o_solr_repro_2965.txt.gz] * [^builds.a.o_solr_badapple_nightly_8x_7.txt.gz] > StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3 > - > > Key: SOLR-13297 > URL: https://issues.apache.org/jira/browse/SOLR-13297 > Project: Solr > Issue Type: Test > Security Level: Public(Default Security Level. Issues are Public) >Reporter: Kevin Risden >Priority: Major > Attachments: builds.a.o_solr_badapple_nightly_8x_7.txt.gz, > builds.a.o_solr_badapple_nightly_master_51.txt.gz, > builds.a.o_solr_nightly_8x_36.txt.gz, builds.a.o_solr_repro_2965.txt.gz > > > As reported by [~hossman] on SOLR-9515, StressHdfsTest and > HdfsUnloadDistributedZkTest are failing more regularly. Should figure out > what is going on here. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13297) StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3
[ https://issues.apache.org/jira/browse/SOLR-13297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785969#comment-16785969 ] Kevin Risden commented on SOLR-13297: - Uploaded two examples of StressHdfsTest. > StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3 > - > > Key: SOLR-13297 > URL: https://issues.apache.org/jira/browse/SOLR-13297 > Project: Solr > Issue Type: Test > Security Level: Public(Default Security Level. Issues are Public) >Reporter: Kevin Risden >Priority: Major > Attachments: builds.a.o_solr_badapple_nightly_master_51.txt.gz, > builds.a.o_solr_nightly_8x_36.txt.gz > > > As reported by [~hossman] on SOLR-9515, StressHdfsTest and > HdfsUnloadDistributedZkTest are failing more regularly. Should figure out > what is going on here. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13297) StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3
[ https://issues.apache.org/jira/browse/SOLR-13297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785958#comment-16785958 ] Kevin Risden commented on SOLR-13297: - Need to find some examples of these failures from either Apache Jenkins or [https://jenkins.thetaphi.de/]. I haven't seen these 2 tests fail on my local Jenkins server. > StressHdfsTest and HdfsUnloadDistributedZkTest fail more often after Hadoop 3 > - > > Key: SOLR-13297 > URL: https://issues.apache.org/jira/browse/SOLR-13297 > Project: Solr > Issue Type: Test > Security Level: Public(Default Security Level. Issues are Public) >Reporter: Kevin Risden >Priority: Major > > As reported by [~hossman] on SOLR-9515, StressHdfsTest and > HdfsUnloadDistributedZkTest are failing more regularly. Should figure out > what is going on here. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
