date:20191223

Re: Propose eliminate "Versions of Major Components"

2019-12-23 Thread David Smiley

+1 to all that Jan; your response was very thoughtful.

Except "Perhaps just keep Jetty version in CHANGES".Why?  Since the WAR
option went away, we now think of Jetty as a component of Solr instead of
something we deploy to, at least in communication to our users.  If an
advanced user wants to mess with Jetty configuration, I'm sure he/she will
figure it out.

~ David Smiley
Apache Lucene/Solr Search Developer
http://www.linkedin.com/in/davidwsmiley


On Mon, Dec 23, 2019 at 5:59 PM Jan Høydahl  wrote:

> In the binary distro there is no version.properties...
>
> Perhaps just keep Jetty version in CHANGES?
> The Zookeeper version is useful if you want to choose an external ZK to
> install, but the refGuide should help here.
> Unfortunately we do not link to the Reference Guide from README in Solr
> binary download so that info is not readily available either.
> I think we should link to online ref-guide both from README and from
> online docs https://lucene.apache.org/solr/8_2_0/
> Also, recommended ZK version for Cloud should be part of
> SYSTEM_REQUIREMENTS.txt, i.e.
> https://lucene.apache.org/solr/8_2_0/SYSTEM_REQUIREMENTS.html ?
>
> Jan
>
> 23. des. 2019 kl. 22:49 skrev David Smiley :
>
> Our CHANGES.txt has "Versions of Major Components" as follows:
>
> Versions of Major Components
> -
> Apache Tika 1.23
> Carrot2 3.16.0
> Velocity 2.0 and Velocity Tools 3.0
> Apache ZooKeeper 3.5.5
> Jetty 9.4.24.v20191120
>
>
> I think we should just eliminate this.  Some of this stuff is really in
> our contribs, and some of those will be ejected soon.  But even for the
> others, this sort of thing is pretty easy to figure out (e.g.
> version.properties or simply *look* at the jar names).
>
> ~ David Smiley
> Apache Lucene/Solr Search Developer
> http://www.linkedin.com/in/davidwsmiley
>
>
>

Re: Propose eliminate "Versions of Major Components"

2019-12-23 Thread Jan Høydahl

In the binary distro there is no version.properties...

Perhaps just keep Jetty version in CHANGES?
The Zookeeper version is useful if you want to choose an external ZK to 
install, but the refGuide should help here.
Unfortunately we do not link to the Reference Guide from README in Solr binary 
download so that info is not readily available either.
I think we should link to online ref-guide both from README and from online 
docs https://lucene.apache.org/solr/8_2_0/ 
 
Also, recommended ZK version for Cloud should be part of 
SYSTEM_REQUIREMENTS.txt, i.e.  
https://lucene.apache.org/solr/8_2_0/SYSTEM_REQUIREMENTS.html 
 ?

Jan

> 23. des. 2019 kl. 22:49 skrev David Smiley :
> 
> Our CHANGES.txt has "Versions of Major Components" as follows:
> 
> Versions of Major Components
> -
> Apache Tika 1.23
> Carrot2 3.16.0
> Velocity 2.0 and Velocity Tools 3.0
> Apache ZooKeeper 3.5.5
> Jetty 9.4.24.v20191120
> 
> I think we should just eliminate this.  Some of this stuff is really in our 
> contribs, and some of those will be ejected soon.  But even for the others, 
> this sort of thing is pretty easy to figure out (e.g. version.properties or 
> simply *look* at the jar names).
> 
> ~ David Smiley
> Apache Lucene/Solr Search Developer
> http://www.linkedin.com/in/davidwsmiley 
>

Propose eliminate "Versions of Major Components"

2019-12-23 Thread David Smiley

Our CHANGES.txt has "Versions of Major Components" as follows:

Versions of Major Components
-
Apache Tika 1.23
Carrot2 3.16.0
Velocity 2.0 and Velocity Tools 3.0
Apache ZooKeeper 3.5.5
Jetty 9.4.24.v20191120


I think we should just eliminate this.  Some of this stuff is really in our
contribs, and some of those will be ejected soon.  But even for the others,
this sort of thing is pretty easy to figure out (e.g. version.properties or
simply *look* at the jar names).

~ David Smiley
Apache Lucene/Solr Search Developer
http://www.linkedin.com/in/davidwsmiley

Re: [VOTE] Release Lucene/Solr 8.4.0 RC2

2019-12-23 Thread Tomás Fernández Löbbe

+1
SUCCESS! [1:23:00.750081]

On Mon, Dec 23, 2019 at 9:17 AM David Smiley 
wrote:

> +1
>
> SUCCESS! [1:26:31.334270]
>
>
> ~ David Smiley
> Apache Lucene/Solr Search Developer
> http://www.linkedin.com/in/davidwsmiley
>
>
> On Mon, Dec 23, 2019 at 11:00 AM Tommaso Teofili <
> tommaso.teof...@gmail.com> wrote:
>
>> +1
>>
>> SUCCESS! [1:28:25.980994]
>>
>>
>> Regards,
>>
>> Tommaso
>>
>> On Mon, 23 Dec 2019 at 04:34, Nhat Nguyen 
>> wrote:
>>
>>> +1
>>> SUCCESS! [0:57:57.529512]
>>>
>>> On Sat, Dec 21, 2019 at 6:04 PM Michael Sokolov 
>>> wrote:
>>>
 SUCCESS! [1:21:34.167550]

 +1

 On Fri, Dec 20, 2019 at 2:56 PM Anshum Gupta 
 wrote:
 >
 > +1
 >
 > SUCCESS! [1:11:53.626393]
 >
 > The javadocs look good too.
 >
 >
 > On Fri, Dec 20, 2019 at 9:13 AM Tomoko Uchida <
 tomoko.uchida.1...@gmail.com> wrote:
 >>
 >> +1 SUCCESS! [0:57:55.896528]. Luke also works fine.
 >>
 >> 2019年12月20日(金) 23:24 Kevin Risden :
 >> >
 >> > +1 SUCCESS! [1:09:53.172567]
 >> >
 >> >
 >> > Kevin Risden
 >> >
 >> >
 >> > On Fri, Dec 20, 2019 at 9:15 AM Uwe Schindler 
 wrote:
 >> >>
 >> >> Hi,
 >> >>
 >> >>
 >> >>
 >> >> I instructed Policeman Jenkins to do the mechanic tests for me:
 >> >>
 >> >>
 https://jenkins.thetaphi.de/job/Lucene-Solr-Release-Tester/28/console
 >> >>
 >> >>
 >> >>
 >> >> Result:
 >> >>
 >> >> SUCCESS! [2:33:17.003383]
 >> >>
 >> >> Finished: SUCCESS
 >> >>
 >> >>
 >> >>
 >> >> He tested 2 Java versions and it looks like he was happy.
 >> >>
 >> >>
 >> >>
 >> >> I then reviewed Changes and Javadocs: Looks fine. I also started
 Solr with whitespace in my username on Windows and it booted up
 successfully in Java 8, 11 and 14 EA.
 >> >>
 >> >>
 >> >>
 >> >> +1 to release as Lucene/Solr 8.4.0
 >> >>
 >> >>
 >> >>
 >> >> Uwe
 >> >>
 >> >>
 >> >>
 >> >> -
 >> >>
 >> >> Uwe Schindler
 >> >>
 >> >> Achterdiek 19, D-28357 Bremen
 >> >>
 >> >> https://www.thetaphi.de
 >> >>
 >> >> eMail: u...@thetaphi.de
 >> >>
 >> >>
 >> >>
 >> >> From: Adrien Grand 
 >> >> Sent: Friday, December 20, 2019 12:23 AM
 >> >> To: Lucene Dev 
 >> >> Subject: [VOTE] Release Lucene/Solr 8.4.0 RC2
 >> >>
 >> >>
 >> >>
 >> >> Please vote for release candidate 2 for Lucene/Solr 8.4.0
 >> >>
 >> >> The artifacts can be downloaded from:
 >> >>
 https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.4.0-RC2-revbc02ab906445fcf4e297f4ef00ab4a54fdd72ca2
 >> >>
 >> >> You can run the smoke tester directly with this command:
 >> >>
 >> >> python3 -u dev-tools/scripts/smokeTestRelease.py \
 >> >>
 https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.4.0-RC2-revbc02ab906445fcf4e297f4ef00ab4a54fdd72ca2
 >> >>
 >> >> The vote will be open for at least 3 working days, i.e. until
 2019-12-28 00:00 UTC.
 >> >>
 >> >> [ ] +1  approve
 >> >> [ ] +0  no opinion
 >> >> [ ] -1  disapprove (and reason why)
 >> >>
 >> >> Here is my +1
 >> >>
 >> >>
 >> >>
 >> >> --
 >> >>
 >> >> Adrien
 >>
 >> -
 >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 >> For additional commands, e-mail: dev-h...@lucene.apache.org
 >>
 >
 >
 > --
 > Anshum Gupta

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org

BadApple report

2019-12-23 Thread Erick Erickson

As all the security stuff settles down, I’m still taking these snapshots but 
mostly to keep a complete record. The longer records, i.e. for the last 7 days 
contains a lot of noise comparatively.

That said, it’s worth looking at Hoss’ last 7 day rollup, we do have a number 
of tests failing quite regularly although many of those are “suite” level: 
http://fucit.org/solr-jenkins-reports/failure-report.html

Short form:
Failures in Hoss' reports for the last 4 rollups.

There were 1434 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are 
objections

Failures in the last 4 reports..
   Report   Pct runsfails   test
 0123   7.7  675 15  
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
 0123   1.6  801 44  
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
 0123   1.9  805 14  RollingRestartTest.test
 0123   2.9   99  5  ShardSplitTest.testSplitWithChaosMonkey
 0123   3.6  807 18  SystemCollectionCompatTest.testBackCompat
 0123  18.9  115 16  Test2BPostings.test
 0123   3.6  862 51  
TestModelManagerPersistence.testFilePersistence
 0123   3.6  865 54  
TestModelManagerPersistence.testWrapperModelPersistence
 0123   0.8  781  6  
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
 0123   2.6  809 16  TestStressLiveNodes.testStress

Full output attached

DO NOT ENABLE LIST:
MoveReplicaHDFSTest.testFailedMove
MoveReplicaHDFSTest.testNormalFailedMove
TestControlledRealTimeReopenThread.testCRTReopen
TestICUNormalizer2CharFilter.testRandomStrings
TestICUTokenizerCJK
TestImpersonationWithHadoopAuth.testForwarding
TestLTRReRankingPipeline.testDifferentTopN
TestRandomChains


DO NOT ANNOTATE LIST
CdcrBidirectionalTest.testBiDir
IndexSizeTriggerTest.testMergeIntegration
IndexSizeTriggerTest.testMixedBounds
IndexSizeTriggerTest.testSplitIntegration
IndexSizeTriggerTest.testTrigger
InfixSuggestersTest.testShutdownDuringBuild
ShardSplitTest.test
ShardSplitTest.testSplitMixedReplicaTypes
ShardSplitTest.testSplitWithChaosMonkey
TestLatLonShapeQueries.testRandomBig
TestRandomChains.testRandomChainsWithLargeStrings
TestTriggerIntegration.testSearchRate

Processing file (History bit 3): HOSS-2019-12-23.csv
Processing file (History bit 2): HOSS-2019-12-09.csv
Processing file (History bit 1): HOSS-2019-12-02.csv
Processing file (History bit 0): HOSS-2019-11-25.csv


Number of AwaitsFix: 40 Number of BadApples: 7


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  108 failures
Week: 1  had  1170 failures
Week: 2  had  83 failures
Week: 3  had  253 failures


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
 no tests removed

  **Annotations will be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 2
   SolrZkClientTest.testSimpleUpdateACLs
   TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader


Failures in Hoss' reports for the last 4 rollups.

There were 1434 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are 
objections

Failures in the last 4 reports..
   Report   Pct runsfails   test
 0123   7.7  675 15  
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
 0123   1.6  801 44  
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
 0123   1.9  805 14  RollingRestartTest.test
 0123   2.9   99  5  ShardSplitTest.testSplitWithChaosMonkey
 0123   3.6  807 18  SystemCollectionCompatTest.testBackCompat
 0123  18.9  115 16  Test2BPostings.test
 0123   3.6  862 51  
TestModelManagerPersistence.testFilePersistence
 0123   3.6  865 54  
TestModelManagerPersistence.testWrapperModelPersistence
 0123   0.8  781  6  
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
 0123   2.6  809 16  TestStressLiveNodes.testStress
 Will BadApple all tests above this line except ones listed at the 
top**



 0120.8  600  6  
MissingSegmentRecoveryTest.testLeaderRecovery
 0120.4  658  3

Re: [VOTE] Release Lucene/Solr 8.4.0 RC2

2019-12-23 Thread David Smiley

+1

SUCCESS! [1:26:31.334270]


~ David Smiley
Apache Lucene/Solr Search Developer
http://www.linkedin.com/in/davidwsmiley


On Mon, Dec 23, 2019 at 11:00 AM Tommaso Teofili 
wrote:

> +1
>
> SUCCESS! [1:28:25.980994]
>
>
> Regards,
>
> Tommaso
>
> On Mon, 23 Dec 2019 at 04:34, Nhat Nguyen 
> wrote:
>
>> +1
>> SUCCESS! [0:57:57.529512]
>>
>> On Sat, Dec 21, 2019 at 6:04 PM Michael Sokolov 
>> wrote:
>>
>>> SUCCESS! [1:21:34.167550]
>>>
>>> +1
>>>
>>> On Fri, Dec 20, 2019 at 2:56 PM Anshum Gupta 
>>> wrote:
>>> >
>>> > +1
>>> >
>>> > SUCCESS! [1:11:53.626393]
>>> >
>>> > The javadocs look good too.
>>> >
>>> >
>>> > On Fri, Dec 20, 2019 at 9:13 AM Tomoko Uchida <
>>> tomoko.uchida.1...@gmail.com> wrote:
>>> >>
>>> >> +1 SUCCESS! [0:57:55.896528]. Luke also works fine.
>>> >>
>>> >> 2019年12月20日(金) 23:24 Kevin Risden :
>>> >> >
>>> >> > +1 SUCCESS! [1:09:53.172567]
>>> >> >
>>> >> >
>>> >> > Kevin Risden
>>> >> >
>>> >> >
>>> >> > On Fri, Dec 20, 2019 at 9:15 AM Uwe Schindler 
>>> wrote:
>>> >> >>
>>> >> >> Hi,
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> I instructed Policeman Jenkins to do the mechanic tests for me:
>>> >> >>
>>> >> >>
>>> https://jenkins.thetaphi.de/job/Lucene-Solr-Release-Tester/28/console
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> Result:
>>> >> >>
>>> >> >> SUCCESS! [2:33:17.003383]
>>> >> >>
>>> >> >> Finished: SUCCESS
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> He tested 2 Java versions and it looks like he was happy.
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> I then reviewed Changes and Javadocs: Looks fine. I also started
>>> Solr with whitespace in my username on Windows and it booted up
>>> successfully in Java 8, 11 and 14 EA.
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> +1 to release as Lucene/Solr 8.4.0
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> Uwe
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> -
>>> >> >>
>>> >> >> Uwe Schindler
>>> >> >>
>>> >> >> Achterdiek 19, D-28357 Bremen
>>> >> >>
>>> >> >> https://www.thetaphi.de
>>> >> >>
>>> >> >> eMail: u...@thetaphi.de
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> From: Adrien Grand 
>>> >> >> Sent: Friday, December 20, 2019 12:23 AM
>>> >> >> To: Lucene Dev 
>>> >> >> Subject: [VOTE] Release Lucene/Solr 8.4.0 RC2
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> Please vote for release candidate 2 for Lucene/Solr 8.4.0
>>> >> >>
>>> >> >> The artifacts can be downloaded from:
>>> >> >>
>>> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.4.0-RC2-revbc02ab906445fcf4e297f4ef00ab4a54fdd72ca2
>>> >> >>
>>> >> >> You can run the smoke tester directly with this command:
>>> >> >>
>>> >> >> python3 -u dev-tools/scripts/smokeTestRelease.py \
>>> >> >>
>>> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.4.0-RC2-revbc02ab906445fcf4e297f4ef00ab4a54fdd72ca2
>>> >> >>
>>> >> >> The vote will be open for at least 3 working days, i.e. until
>>> 2019-12-28 00:00 UTC.
>>> >> >>
>>> >> >> [ ] +1  approve
>>> >> >> [ ] +0  no opinion
>>> >> >> [ ] -1  disapprove (and reason why)
>>> >> >>
>>> >> >> Here is my +1
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> --
>>> >> >>
>>> >> >> Adrien
>>> >>
>>> >> -
>>> >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>>> >> For additional commands, e-mail: dev-h...@lucene.apache.org
>>> >>
>>> >
>>> >
>>> > --
>>> > Anshum Gupta
>>>
>>> -
>>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>>> For additional commands, e-mail: dev-h...@lucene.apache.org
>>>
>>>

Re: [VOTE] Release Lucene/Solr 8.4.0 RC2

2019-12-23 Thread Tommaso Teofili

+1

SUCCESS! [1:28:25.980994]


Regards,

Tommaso

On Mon, 23 Dec 2019 at 04:34, Nhat Nguyen 
wrote:

> +1
> SUCCESS! [0:57:57.529512]
>
> On Sat, Dec 21, 2019 at 6:04 PM Michael Sokolov 
> wrote:
>
>> SUCCESS! [1:21:34.167550]
>>
>> +1
>>
>> On Fri, Dec 20, 2019 at 2:56 PM Anshum Gupta 
>> wrote:
>> >
>> > +1
>> >
>> > SUCCESS! [1:11:53.626393]
>> >
>> > The javadocs look good too.
>> >
>> >
>> > On Fri, Dec 20, 2019 at 9:13 AM Tomoko Uchida <
>> tomoko.uchida.1...@gmail.com> wrote:
>> >>
>> >> +1 SUCCESS! [0:57:55.896528]. Luke also works fine.
>> >>
>> >> 2019年12月20日(金) 23:24 Kevin Risden :
>> >> >
>> >> > +1 SUCCESS! [1:09:53.172567]
>> >> >
>> >> >
>> >> > Kevin Risden
>> >> >
>> >> >
>> >> > On Fri, Dec 20, 2019 at 9:15 AM Uwe Schindler 
>> wrote:
>> >> >>
>> >> >> Hi,
>> >> >>
>> >> >>
>> >> >>
>> >> >> I instructed Policeman Jenkins to do the mechanic tests for me:
>> >> >>
>> >> >>
>> https://jenkins.thetaphi.de/job/Lucene-Solr-Release-Tester/28/console
>> >> >>
>> >> >>
>> >> >>
>> >> >> Result:
>> >> >>
>> >> >> SUCCESS! [2:33:17.003383]
>> >> >>
>> >> >> Finished: SUCCESS
>> >> >>
>> >> >>
>> >> >>
>> >> >> He tested 2 Java versions and it looks like he was happy.
>> >> >>
>> >> >>
>> >> >>
>> >> >> I then reviewed Changes and Javadocs: Looks fine. I also started
>> Solr with whitespace in my username on Windows and it booted up
>> successfully in Java 8, 11 and 14 EA.
>> >> >>
>> >> >>
>> >> >>
>> >> >> +1 to release as Lucene/Solr 8.4.0
>> >> >>
>> >> >>
>> >> >>
>> >> >> Uwe
>> >> >>
>> >> >>
>> >> >>
>> >> >> -
>> >> >>
>> >> >> Uwe Schindler
>> >> >>
>> >> >> Achterdiek 19, D-28357 Bremen
>> >> >>
>> >> >> https://www.thetaphi.de
>> >> >>
>> >> >> eMail: u...@thetaphi.de
>> >> >>
>> >> >>
>> >> >>
>> >> >> From: Adrien Grand 
>> >> >> Sent: Friday, December 20, 2019 12:23 AM
>> >> >> To: Lucene Dev 
>> >> >> Subject: [VOTE] Release Lucene/Solr 8.4.0 RC2
>> >> >>
>> >> >>
>> >> >>
>> >> >> Please vote for release candidate 2 for Lucene/Solr 8.4.0
>> >> >>
>> >> >> The artifacts can be downloaded from:
>> >> >>
>> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.4.0-RC2-revbc02ab906445fcf4e297f4ef00ab4a54fdd72ca2
>> >> >>
>> >> >> You can run the smoke tester directly with this command:
>> >> >>
>> >> >> python3 -u dev-tools/scripts/smokeTestRelease.py \
>> >> >>
>> https://dist.apache.org/repos/dist/dev/lucene/lucene-solr-8.4.0-RC2-revbc02ab906445fcf4e297f4ef00ab4a54fdd72ca2
>> >> >>
>> >> >> The vote will be open for at least 3 working days, i.e. until
>> 2019-12-28 00:00 UTC.
>> >> >>
>> >> >> [ ] +1  approve
>> >> >> [ ] +0  no opinion
>> >> >> [ ] -1  disapprove (and reason why)
>> >> >>
>> >> >> Here is my +1
>> >> >>
>> >> >>
>> >> >>
>> >> >> --
>> >> >>
>> >> >> Adrien
>> >>
>> >> -
>> >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>> >> For additional commands, e-mail: dev-h...@lucene.apache.org
>> >>
>> >
>> >
>> > --
>> > Anshum Gupta
>>
>> -
>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>> For additional commands, e-mail: dev-h...@lucene.apache.org
>>
>>

Re: Propose eliminate "Versions of Major Components"

Re: Propose eliminate "Versions of Major Components"

Propose eliminate "Versions of Major Components"

Re: [VOTE] Release Lucene/Solr 8.4.0 RC2

BadApple report

Re: [VOTE] Release Lucene/Solr 8.4.0 RC2

Re: [VOTE] Release Lucene/Solr 8.4.0 RC2

7 matches

Site Navigation

Mail list logo

Footer information