BadApple report

2020-12-21 Thread Erick Erickson
sFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";) TimeRoutedAliasUpdateProcessorTest.testDateMathInStart @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";) TriLevelCompositeIdRoutingTest.test

BadApple report

2020-11-23 Thread Erick Erickson
yVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";) TimeRoutedAliasUpdateProcessorTest.testDateMathInStart @AwaitsFix(bugUrl="https://issues

BadApple report

2020-11-09 Thread Erick Erickson
/issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";) TimeRoutedAliasUpdateProcessorTest

BadApple report

2020-11-02 Thread Erick Erickson
owse/SOLR-12028";) TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.or

BadApple report

2020-10-26 Thread Erick Erickson
tps://issues.apache.org/jira/browse/SOLR-12028";) TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl=&q

BadApple report

2020-10-19 Thread Erick Erickson
The BadApple report remains skewed as the results include the reference impl so this is mostly in case people are curious…. I expect next week to see an uptick in the number of tests that have failed each of the last 4 weeks, that’ll be when the reference-impl parts of the report kick in

BadApple report

2020-10-12 Thread Erick Erickson
https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";) TimeRoutedAliasUpdateProcessorTest

BadApple

2020-10-05 Thread Erick Erickson
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";) TimeRoutedAliasUpdateProcessorTest.testDateMathInStart @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";) TriLevelCompositeIdRoutingT

RE: BadApple report

2020-08-25 Thread Uwe Schindler
same. Uwe - Uwe Schindler Achterdiek 19, D-28357 Bremen https://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: Erick Erickson > Sent: Monday, August 24, 2020 3:59 PM > To: dev@lucene.apache.org > Subject: BadApple report > > We have some pre

BadApple report

2020-08-24 Thread Erick Erickson
e @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14

BadApple report

2020-08-17 Thread Erick Erickson
s.apache.org/jira/browse/SOLR-12028";) TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;http

Re: BadApple report, but please read the first bit

2020-08-13 Thread David Smiley
ow no change to HDFS stuff. Starting June/July failing regularly. > > Kevin Risden > > > > On Wed, Aug 12, 2020 at 9:03 AM Erick Erickson > wrote: > >> I have the weekly rollups (with a few gaps) going back to about April >> 2018, but nothing’s been done to try t

Re: BadApple report, but please read the first bit

2020-08-12 Thread Erick Erickson
Didn’t think at first (only one cup of coffee). Here’s the Emails that test appears in, the formatting is poor… After that is the raw data from Hoss’ rollups that might be easier to ingest. I have 1.3G of this kind of historical data, I’ve had vague thoughts about putting it someplace accessibl

Re: BadApple report, but please read the first bit

2020-08-12 Thread Kevin Risden
Risden On Wed, Aug 12, 2020 at 9:03 AM Erick Erickson wrote: > I have the weekly rollups (with a few gaps) going back to about April > 2018, but nothing’s been done to try to make them generally available. Each > BadApple report has rates for the last 4 weeks in the attached file, jus

Re: BadApple report, but please read the first bit

2020-08-12 Thread Erick Erickson
I have the weekly rollups (with a few gaps) going back to about April 2018, but nothing’s been done to try to make them generally available. Each BadApple report has rates for the last 4 weeks in the attached file, just below "Failures over the last 4 weeks, but not every week. Ordered

Re: BadApple report, but please read the first bit

2020-08-11 Thread David Smiley
Do we have any long term (aka "longitudinal") pass/fail rates for tests? SharedFSAutoReplicaFailoverTest in particular is kinda-sorta tied to HDFS, and that's going away to a plug-in for 9.0. The shared file system notion isn't well supported in SolrCloud, I think. ~ David Smiley Apache Lucene/S

Re: Badapple report

2020-08-11 Thread Atri Sharma
Merged (thanks Mike D!). Atri On Tue, Aug 11, 2020 at 5:32 PM Erick Erickson wrote: > > Great, thanks! Let me know when you push it, I can beast the test again. > > > On Aug 11, 2020, at 3:48 AM, Atri Sharma wrote: > > > > I investigated testRequestRateLimiters and hardened the tests up: > > >

Re: Badapple report

2020-08-11 Thread Erick Erickson
Great, thanks! Let me know when you push it, I can beast the test again. > On Aug 11, 2020, at 3:48 AM, Atri Sharma wrote: > > I investigated testRequestRateLimiters and hardened the tests up: > > https://github.com/apache/lucene-solr/pull/1736 > > This will stop testConcurrentRequests from fa

Re: Badapple report

2020-08-11 Thread Atri Sharma
I investigated testRequestRateLimiters and hardened the tests up: https://github.com/apache/lucene-solr/pull/1736 This will stop testConcurrentRequests from failing and should hopefully stop testSlotBorrowing as well. If testSlotBorrowing continues to fail, I will have to rethink the test. On Mo

Re: Badapple report

2020-08-10 Thread Erick Erickson
OK, thanks. I’m not really annotating things at this point, although occasionally removing some that haven’t failed in a long time. > On Aug 10, 2020, at 1:44 PM, Tomás Fernández Löbbe > wrote: > > Hi Erick, > I've introduced and later fixed a bug in TestConfig. It hasn't failed since, > so p

Re: Badapple report

2020-08-10 Thread Tomás Fernández Löbbe
Hi Erick, I've introduced and later fixed a bug in TestConfig. It hasn't failed since, so please don't annotate it. On Mon, Aug 10, 2020 at 7:47 AM Erick Erickson wrote: > We’re backsliding some. I encourage people to look at: > http://fucit.org/solr-jenkins-reports/failure-report.html, we have

Badapple report

2020-08-10 Thread Erick Erickson
e @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14

BadApple report, but please read the first bit

2020-08-03 Thread Erick Erickson
ry suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;http

BadApple report

2020-07-27 Thread Erick Erickson
waitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";) TimeRoutedAlia

BadApple report

2020-07-20 Thread Erick Erickson
s.apache.org/jira/browse/SOLR-12028";) TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl=&q

BadApple report

2020-07-13 Thread Erick Erickson
;https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";) ThreadDumpHandlerTest.ThreadDumpHandlerT

Re: BadApple report

2020-07-06 Thread Erick Erickson
Megan: There are a number of tests that have been flagged by some devs that, no matter what, should _not_ be annotated with BadApple or AwaitsFix and that’s just a list to remind me what they are. It’s not much of a deal, though, because I’m not doing much annotating lately. The original

Re: BadApple report

2020-07-06 Thread Megan Carey
Hi Erick, I'm wondering what is meant by "DO NOT ANNOTATE LIST" at the start of the report? Better yet, can you please link to the scraping tool used to generate the report? Thank you! Megan On Mon, Jul 6, 2020 at 8:07 AM Erick Erickson wrote: > Holding fairly steady, but IDK whether Hoss’ scr

BadApple report

2020-07-06 Thread Erick Erickson
sRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse

BadApple report

2020-06-29 Thread Erick Erickson
.testBasic @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // this test hits a timeout easily TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery

BadApple report

2020-06-22 Thread Erick Erickson
VsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";) TestZKPropertiesWriter.testZKPropertiesWriter @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12823";) TimeRoutedAliasUp

BadApple report

2020-06-15 Thread Erick Erickson
te @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";) TestZKPropertiesWriter.testZKPropertiesWriter @AwaitsFix(bugUrl = "https://issues.apache.or

Re: BadApple report

2020-06-08 Thread Erick Erickson
Thanks for letting me know Tomás As useful as Hoss’ rollups are, there’s always a lag to deal with, sounds like this is one. > On Jun 8, 2020, at 2:26 PM, Tomás Fernández Löbbe > wrote: > > Thanks for keeping an eye Erick. I took a quick look at the > "TestIndexSearcher" failures and I think

Re: BadApple report

2020-06-08 Thread Tomás Fernández Löbbe
Thanks for keeping an eye Erick. I took a quick look at the "TestIndexSearcher" failures and I think they're related to SOLR-14525. Should be fixed after this[1] commit by Noble. [1] https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=5827ddf On Mon, Jun 8, 2020 at 7:52 AM Erick Erickson wro

BadApple report

2020-06-08 Thread Erick Erickson
AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // this test hits a timeout easily TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Se

Re: BadApple report. It's worth reviewing the SuppressWarnings section even if you ignore the rest.

2020-06-02 Thread Erick Erickson
>> the nonce, ignore it. Eventually, when all the warnings are fixed or >> suppressed, I will be advocating for _not_ introducing new warnings at least >> on Master. To encourage this, I want un-suppressed warnings to become >> compile-time errors. >> >> That’ll

Re: BadApple report. It's worth reviewing the SuppressWarnings section even if you ignore the rest.

2020-06-02 Thread Noble Paul
encourage this, I want un-suppressed warnings to become > compile-time errors. > > That’ll tempt people to just add @SuppressWarnings, and I don’t think that’s > a proper fix, so the BadApple report will flag files that have more > @SuppressWarnings than they did last week and I’l

BadApple report. It's worth reviewing the SuppressWarnings section even if you ignore the rest.

2020-06-01 Thread Erick Erickson
at least on Master. To encourage this, I want un-suppressed warnings to become compile-time errors. That’ll tempt people to just add @SuppressWarnings, and I don’t think that’s a proper fix, so the BadApple report will flag files that have more @SuppressWarnings than they did last week and I’ll

Re: BadApple report

2020-05-27 Thread Jason Gerlowski
> Hoss’s rollups are here: > http://fucit.org/solr-jenkins-reports/failure-report.html which show the > rates, but not where they came from. If I click on a particular test entry on "failure-report.html", I'm presented with dialog with links for each failure. Clicking that link takes me to a fi

Re: BadApple report

2020-05-25 Thread Ilan Ginzburg
Thanks that helps. I'll try to have a look at some of the failures related to areas I know. Ilan On Mon, May 25, 2020 at 7:07 PM Erick Erickson wrote: > Ilan: > > That’s, unfortunately, not an easy question. Hoss’s rollups are here: > http://fucit.org/solr-jenkins-reports/failure-report.html wh

Re: BadApple report

2020-05-25 Thread Erick Erickson
Ilan: That’s, unfortunately, not an easy question. Hoss’s rollups are here: http://fucit.org/solr-jenkins-reports/failure-report.html which show the rates, but not where they came from. Here’s an example of a failure from Jenkins, if you follow the link you can see the full output, (click “co

Re: BadApple report

2020-05-25 Thread Ilan Ginzburg
Where are the test failure details? On Mon, May 25, 2020 at 4:47 PM Erick Erickson wrote: > Here’s the summary: > > Raw fail count by week totals, most recent week first (corresponds to > bits): > Week: 0 had 113 failures > Week: 1 had 103 failures > Week: 2 had 102 failures > Week: 3 had

BadApple report

2020-05-25 Thread Erick Erickson
ssues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";) TimeRoutedAliasUpdateProcessorTest.testDateMath

BadApple report

2020-05-18 Thread Erick Erickson
estCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-1

BadApple report

2020-05-11 Thread Erick Erickson
s.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";) TimeRoutedAliasUpdateProcessorTest.testDateMathInSt

Re: PLEASE READ! BadApple report. Last week was horrible!

2020-05-06 Thread Michael McCandless
Phew! Thanks for digging Erick, and for producing these BadApple reports. Mike McCandless http://blog.mikemccandless.com On Wed, May 6, 2020 at 7:59 AM Erick Erickson wrote: > OK, this morning things are back to normal. I think the disk space issue > was to blame because checking

Re: PLEASE READ! BadApple report. Last week was horrible!

2020-05-06 Thread Erick Erickson
OK, this morning things are back to normal. I think the disk space issue was to blame because checking after Mike’s fix didn’t look like it cured the problem. Thanks all! > On May 5, 2020, at 1:41 PM, Chris Hostetter wrote: > > > : And FWIW, I beasted one of the failing suites last night _with

Re: PLEASE READ! BadApple report. Last week was horrible!

2020-05-05 Thread Erick Erickson
OK, thanks Chris. The 24 hour rollup still shows many failures in the several classes, I’ll check tomorrow to see if that’s a consequence of the disk full problem. > On May 5, 2020, at 1:41 PM, Chris Hostetter wrote: > > > : And FWIW, I beasted one of the failing suites last night _without_

Re: PLEASE READ! BadApple report. Last week was horrible!

2020-05-05 Thread Chris Hostetter
: And FWIW, I beasted one of the failing suites last night _without_ : Mike’s changes and didn’t get any failures so I can’t say anything about : whether Mike’s changes helped or not. IIUC McCandless's failure only affects you if you use the "jenkins" test data file (the really big wikipedia d

Re: PLEASE READ! BadApple report. Last week was horrible!

2020-05-05 Thread Erick Erickson
Uwe > > - > Uwe Schindler > Achterdiek 19, D-28357 Bremen > https://www.thetaphi.de > eMail: u...@thetaphi.de > >> -Original Message- >> From: Erick Erickson >> Sent: Monday, May 4, 2020 1:54 PM >> To: dev@lucene.apache.org >> Subject: P

RE: PLEASE READ! BadApple report. Last week was horrible!

2020-05-05 Thread Uwe Schindler
://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: Erick Erickson > Sent: Monday, May 4, 2020 1:54 PM > To: dev@lucene.apache.org > Subject: PLEASE READ! BadApple report. Last week was horrible! > > I don’t know whether we had some temporary glit

Re: PLEASE READ! BadApple report. Last week was horrible!

2020-05-04 Thread Erick Erickson
Mike: I saw the push. Hoss’ rollups go for “the last 24 hours”, so it’ll be Tuesday evening before things have had a chance to work their way through, I’ll look tomorrow. Meanwhile I’m beasting one of the failing test suites (without the change) and 280 iterations so far and no failures. That

Re: PLEASE READ! BadApple report. Last week was horrible!

2020-05-04 Thread Michael McCandless
Hi Erick, OK I pushed a fix! See if it decreases the failure rate for those newly bad apples? Sorry and thanks :) Mike McCandless http://blog.mikemccandless.com On Mon, May 4, 2020 at 1:06 PM Erick Erickson wrote: > Mike: > > I have no idea. Hoss’ rollups don’t link back to builds, they >

Re: PLEASE READ! BadApple report. Last week was horrible!

2020-05-04 Thread Erick Erickson
Mike: I have no idea. Hoss’ rollups don’t link back to builds, they just aggregate the results. Not a huge deal if it’s something like this of course. Let’s just say I’ve had my share or “moments” ;). And unfortunately, the test failures are pretty rare on a percentage basis, so it’s hard to te

Re: PLEASE READ! BadApple report. Last week was horrible!

2020-05-04 Thread Michael McCandless
Hi Erick, It's possible this was the root cause of many of the failures: https://issues.apache.org/jira/browse/LUCENE-9191 Do these transient failures look something like this? [junit4]> Throwable #1: java.nio.charset.MalformedInputException: Input length = 1 [junit4]>at __

PLEASE READ! BadApple report. Last week was horrible!

2020-05-04 Thread Erick Erickson
I don’t know whether we had some temporary glitch that broke lots of tests and they’ve been fixed or we had a major regression, but this needs to be addressed ASAP if they’re still failing. See everything below the line "ALL OF THE TESTS BELOW HERE HAVE ONLY FAILED IN THE LAST WEEK!” in this e-m

BadApple report

2020-04-27 Thread Erick Erickson
28";) // this test hits a timeout easily TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.ap

BadApple report

2020-04-20 Thread Erick Erickson
ues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183"

Re: BadApple report

2020-04-18 Thread Kevin Risden
> > 0123 59.4 195 92 HdfsSyncSliceTest.test I'm looking into this HdfsSyncSliceTest failure. Jira https://issues.apache.org/jira/browse/SOLR-13886 Kevin Risden Kevin Risden On Mon, Apr 13, 2020 at 8:35 AM Erick Erickson wrote: > We’re backsliding a bit. Note that over the las

BadApple report

2020-04-13 Thread Erick Erickson
sic @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // this test hits a timeout easily TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestT

BadApple report

2020-04-06 Thread Erick Erickson
a/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";) TimeRoutedAliasUpdateProcessorTest.testDateMathInStart @AwaitsFi

BadApple report

2020-03-30 Thread Erick Erickson
There are a couple of tests that can have BadApple removed, MultiThreadedOCPTest.test SolrZkClientTest.testSimpleUpdateACLs I’ll take care of those today or tomorrow. Raw fail count by week totals, most recent week first (corresponds to bits): Week: 0 had 69 failures Week: 1 had 65

BadApple report

2020-03-24 Thread Erick Erickson
8";) // this test hits a timeout easily TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @A

Bad BadApple

2020-03-17 Thread Erick Erickson
sic @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // this test hits a timeout easily TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 6-Sep-2018

BadApple report

2020-03-16 Thread Erick Erickson
I was on vacation the last couple of weeks so missed the BadApple reports. Full results attached Failures in Hoss' reports for the last 4 rollups. There were 373 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->olde

Badapple report

2020-02-24 Thread Erick Erickson
06 SystemCollectionCompatTest.testBackCompat 0123 23.3 95 16 Test2BPostings.test 0123 1.7 1770 20 TestPackages.testPluginLoading 0123 1.5 1780 19 TestStressLiveNodes.testStress Will BadApple all tests above this lin

BadApple report

2020-02-10 Thread Erick Erickson
191 failures As a bonus, here’s are the AwaitsFix and BadApple counts since I’ve been collecting them: e-mail-2018-04-02.txt: Number of AwaitsFix: 15 Number of BadApples: 78 e-mail-2018-04-30.txt: Number of AwaitsFix: 21 Number of BadApples: 90 e-mail-2018-05-21.txt: Number of AwaitsFix: 21

BadApple report

2020-02-03 Thread Erick Erickson
ncSliceTest.test 0123 7.5 1636 53 SystemCollectionCompatTest.testBackCompat 0123 15.0 95 17 Test2BPostings.test 0123 0.7 1597 21 TestStressLiveNodes.testStress Will BadApple all tests above this line except ones listed at the top*

BadApple report

2020-01-20 Thread Erick Erickson
SearchAndRefresh 0123 1.0 1456 28 TestStressLiveNodes.testStress Will BadApple all tests above this line except ones listed at the top** 0122.9 1106 42 BasicDistributedZkTest.test 0120.3 1073 3 ChaosMonkeyNothin

BadApple report

2020-01-13 Thread Erick Erickson
onShouldFailFast 0123 2.1 1316 31 TestStressLiveNodes.testStress Will BadApple all tests above this line except ones listed at the top** 0120.8 990 10 AutoScalingHandlerTest.testReadApi 0120.6 990 5 AutoScalingHandlerTest.testSugges

Re: BadApple report

2020-01-06 Thread Erick Erickson
TestPackedInts.testPackedLongValues > 0123 0.9 1029 9 > TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast > 0123 0.3 1036 12 > TestSkipOverseerOperations.testSkipLeaderOperations > 0123 2.3 1072 25 TestSt

Re: BadApple report

2020-01-06 Thread Robert Muir
0123 0.9 1029 9 >> TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast >> 0123 0.3 1036 12 >> TestSkipOverseerOperations.testSkipLeaderOperations >> 0123 2.3 1072 25 TestStressLiv

Re: BadApple report

2020-01-06 Thread Robert Muir
gt; TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast > 0123 0.3 1036 12 > TestSkipOverseerOperations.testSkipLeaderOperations > 0123 2.3 1072 25 TestStressLiveNodes.testStress > 0123 52.3 155 50 > TestXYMultiPolygonShapeQueries.testRandomB

BadApple report

2020-01-06 Thread Erick Erickson
3 0.3 1036 12 TestSkipOverseerOperations.testSkipLeaderOperations 0123 2.3 1072 25 TestStressLiveNodes.testStress 0123 52.3 155 50 TestXYMultiPolygonShapeQueries.testRandomBig **** Will BadApple all tests above this line except

BadApple report

2019-12-23 Thread Erick Erickson
3.6 862 51 TestModelManagerPersistence.testFilePersistence 0123 3.6 865 54 TestModelManagerPersistence.testWrapperModelPersistence 0123 0.8 781 6 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast 0123 2.6 809

Badapple report

2019-12-02 Thread Erick Erickson
BadApple all tests above this line except ones listed at the top** Full report attached: DO NOT ENABLE LIST: MoveReplicaHDFSTest.testFailedMove MoveReplicaHDFSTest.testNormalFailedMove TestControlledRealTimeReopenThread.testCRTReopen

BadApple report, not a good week.

2019-11-25 Thread Erick Erickson
rations.testSkipLeaderOperations 0123 1.1 895 12 TestStressLiveNodes.testStress Will BadApple all tests above this line except ones listed at the top** 0120.5 573 3 TestPullReplicaErrorHandling.testPullReplicaDisconne

Re: BadApple

2019-11-19 Thread Michael Sokolov
Persistence.testWrapperModelPersistence >> 0123 1.6 921 19 >> TestSkipOverseerOperations.testSkipLeaderOperations >> 0123 0.6 905 11 TestStressLiveNodes.testStress >> 0123 1.1 651 9 TestTlogRepli

Re: BadApple

2019-11-18 Thread Ishan Chattopadhyaya
ce.testFilePersistence > 0123 2.2 940 70 > TestModelManagerPersistence.testWrapperModelPersistence > 0123 1.6 921 19 > TestSkipOverseerOperations.testSkipLeaderOperations > 0123 0.6 905 11 TestStressLiveNodes.testStress > 0123 1.1 651 9

Re: BadApple

2019-11-18 Thread Chris Hostetter
perations.testSkipLeaderOperations : > 0123 0.6 905 11 TestStressLiveNodes.testStress : > 0123 1.1 651 9 TestTlogReplica.testKillTlogReplica : > 0123 4.2

Re: BadApple

2019-11-18 Thread Michael Sokolov
0123 2.7 946 77 > > TestModelManagerPersistence.testFilePersistence > > 0123 2.2 940 70 > > TestModelManagerPersistence.testWrapperModelPersistence > > 0123 1.6 921 19 > > TestSkipOverseerOperations.testSkipLeader

Re: BadApple

2019-11-18 Thread Michael Sokolov
> TestModelManagerPersistence.testWrapperModelPersistence > 0123 1.6 921 19 > TestSkipOverseerOperations.testSkipLeaderOperations > 0123 0.6 905 11 TestStressLiveNodes.testStress > 0123 1.1 651 9 TestTlogReplica.testKil

Re: BadApple

2019-11-18 Thread Tomás Fernández Löbbe
stFilePersistence > 0123 2.2 940 70 > TestModelManagerPersistence.testWrapperModelPersistence > 0123 1.6 921 19 > TestSkipOverseerOperations.testSkipLeaderOperations > 0123 0.6 905 11 TestStressLiveNodes.testStress > 0123 1.1

BadApple

2019-11-18 Thread Erick Erickson
3 1.1 651 9 TestTlogReplica.testKillTlogReplica 0123 4.2 112 11 TestXYMultiPolygonShapeQueries.testRandomBig **** Will BadApple all tests above this line except ones listed at the top** DO NOT ENABLE LIST: MoveReplica

Badapple report. Please read the first 5 lines at least.

2019-11-11 Thread Erick Erickson
istence 0123 0.5 882 6 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast 0123 1.4 913 20 TestSkipOverseerOperations.testSkipLeaderOperations 0123 1.0 899 12 TestStressLiveNodes.testStress **** Will BadApple al

Re: BadApple

2019-11-06 Thread Mark Miller
wrong collection field name - but also that concurrency > is slow. > ZkSolrResourceLoader SHOULD NOT fall back to SolrResourceLoader - a lot of > this type of crap also hides bugs. > > On Wed, Nov 6, 2019 at 11:48 AM Mark Miller wrote: > >> This BadApple stuff would have more va

Re: BadApple

2019-11-06 Thread Mark Miller
cy is slow. ZkSolrResourceLoader SHOULD NOT fall back to SolrResourceLoader - a lot of this type of crap also hides bugs. On Wed, Nov 6, 2019 at 11:48 AM Mark Miller wrote: > This BadApple stuff would have more value after more valuable work though. > > I can't stress it enough - you have to

Re: BadApple

2019-11-06 Thread Mark Miller
This BadApple stuff would have more value after more valuable work though. I can't stress it enough - you have to make this fast to fix it. I'll give you some more items to consider: * Our xml parsing is deathly slow and blocking. All blocking stuff when cores start is death to mult

Re: BadApple

2019-11-06 Thread Mark Miller
t;>>>>> 0123 3.5 912 48 >>>>>> BasicAuthIntegrationTest.testBasicAuth >>>>>> 0123 1.2 934 10 >>>>>> DimensionalRoutedAliasUpdateProcessorTest.testCatTime >>>>>> 0123 0.6

Re: BadApple

2019-11-06 Thread Mark Miller
gt;>> 0123 1.2 934 10 >>>>> DimensionalRoutedAliasUpdateProcessorTest.testCatTime >>>>> 0123 0.6 934 12 >>>>> DimensionalRoutedAliasUpdateProcessorTest.testTimeCat >>>>> 0123 3.4 939 71 >

Re: BadApple

2019-11-06 Thread Mark Miller
witchLegacyCloud >>>> 0123 0.6 906 6 >>>> MathExpressionTest.testGammaDistribution >>>> 0123 7.1 86 5 >>>> ShardSplitTest.testSplitWithChaosMonkey >>>> 0123 6.1 922 48 >>>> Tes

Re: BadApple

2019-11-06 Thread Mark Miller
0123 6.1 922 48 >>> TestCloudSearcherWarming.testRepFactor1LeaderStartup >>> 0123 6.1 936 75 >>> TestModelManagerPersistence.testFilePersistence >>> 0123 5.2 936 74 >>> TestModelManagerPersistence.testW

Re: BadApple

2019-11-06 Thread Mark Miller
5 >> TestModelManagerPersistence.testFilePersistence >> 0123 5.2 936 74 >> TestModelManagerPersistence.testWrapperModelPersistence >> 0123 2.8 903 20 >> TestSkipOverseerOperations.testSkipLeaderOperations >> Will BadApple all te

Re: BadApple

2019-11-06 Thread Mark Miller
0123 6.1 936 75 > TestModelManagerPersistence.testFilePersistence > 0123 5.2 936 74 > TestModelManagerPersistence.testWrapperModelPersistence > 0123 2.8 903 20 > TestSkipOvers

BadApple

2019-11-04 Thread Erick Erickson
3 2.8 903 20 TestSkipOverseerOperations.testSkipLeaderOperations **** Will BadApple all tests above this line except ones listed at the top** "Suite?","Class","Method","Rate","Runs","Fails" "false","org

BadApple report

2019-10-28 Thread Erick Erickson
gerPersistence.testFilePersistence 0123 11.2 857 66 TestModelManagerPersistence.testWrapperModelPersistence Will BadApple all tests above this line except ones listed at the top** 0123.7 58 3 Shard

BadApple report

2019-09-16 Thread Erick Erickson
I’m going to suspend these until we build up a better backlog of tests since a number of machines weren’t being collected by Hoss’ rollups. I’ll continue to gather the rollups every week, but for a while I don’t think it’s worth cluttering your inbox.

No BadApple report this week

2019-09-02 Thread Erick Erickson
I’ll probably just continue to gather Hoss’ rollups each week, but until we get the jenkins stuff back running it’s probably not worth the effort. - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands

Badapple report

2019-08-19 Thread Erick Erickson
s test 0123 1.3 365 8 AliasIntegrationTest.testClusterStateProviderAPI 0123 26.7 44 15 HdfsAutoAddReplicasIntegrationTest.testSimple Will BadApple all tests above this line except ones listed at the top** DO NOT ENA

Badapple report

2019-08-12 Thread Erick Erickson
st 4 reports.. Report Pct runsfails test 0123 1.3 597 11 AliasIntegrationTest.testClusterStateProviderAPI 0123 26.7 65 17 HdfsAutoAddReplicasIntegrationTest.testSimple 0123 1.0 686 9 HttpPartitionWithTlogReplic

  1   2   3   4   >