Re: [VOTE] Release Lucene 9.11.0 RC1

+1 SUCCESS! [0:24:55.332837] Mike McCandless http://blog.mikemccandless.com On Wed, Jun 5, 2024 at 11:21 AM Adrien Grand wrote: > +1 SUCCESS! [1:09:30.262027] > > On Wed, Jun 5, 2024 at 4:15 PM Tomás Fernández Löbbe < > tomasflo...@gmail.com> wrote: > >> +1 >> >> SUCCESS! [1:12:30.029470] >>

Re: Lucene 9.11

Thanks Ben! Mike McCandless http://blog.mikemccandless.com On Wed, May 29, 2024 at 12:45 AM Stefan Vodita wrote: > Ben, I just merged #13414 , > so it's not a blocker for the release. > Thanks again for volunteering to be release manager! > >

Re: [JENKINS] Lucene » Lucene-NightlyTests-main - Build # 1315 - Still Unstable!

Hmm this failure looks not great. I tried the "Reproduce with:" for one of the failures (see below) but it fails to run any tests at all? Maybe because of the cool parameterized testing we now have for our back compat tests? If I remove the "{...}" pattern then the failures do repro. ./gradlew

Re: Query about the GitHub statistics for Lucene

On Wed, Mar 6, 2024 at 4:41 AM Chris Hegarty wrote: Seems that I’ve fallen into the newbie PMC Chair rabbit hole! ;-) - the > reporting tool has long standing issues. Maybe they’re fixable, maybe not, > but it’s possible we don’t necessarily need it now. > Sorry :) Seems to be a

Re: Query about the GitHub statistics for Lucene

the (regexp?) bug! Mike McCandless http://blog.mikemccandless.com On Tue, Mar 5, 2024 at 1:03 PM Michael McCandless wrote: > > On Tue, Mar 5, 2024 at 4:49 AM Chris Hegarty < > christopher.hega...@elastic.co> wrote: > > In preparation for the project’s upcoming ASF board

Re: Query about the GitHub statistics for Lucene

On Tue, Mar 5, 2024 at 4:49 AM Chris Hegarty wrote: In preparation for the project’s upcoming ASF board report, I came across > and reported [1] an issue with the GH statistics, available at: > https://reporter.apache.org/wizard/statistics?lucene > > It appears that there is no GH activity for

Re: [VOTE] Release PyLucene 9.10.0-rc1

+1 to release. I successfully ran my standard PyLucene smoke test of indexing the first 100K enwiki documents, running a couple queries, force merging to one segment, and running again. This was on Python 3.11, OpenJDK 21, Arch Linux kernel 6.4.1. I am sad that this may be the last official

Re: Announcing githubsearch!

nshum Gupta, wrote: > >> > >> This is great! Like always, thank you Mike! > >> > >> On Mon, Feb 19, 2024 at 8:40 AM Michael McCandless < > luc...@mikemccandless.com> wrote: > >>> > >>> Hi Team, > >>> >

Re: [Vote] Bump the Lucene main branch to Java 21

+1, exciting! Mike McCandless http://blog.mikemccandless.com On Fri, Feb 23, 2024 at 6:24 AM Chris Hegarty wrote: > Hi, > > Since the discussion on bumping the Lucene main branch to Java 21 is > winding down, let's hold a vote on this important change. > > Once bumped, the next major release

Re: Bump the Lucene main branch to Java 21

On Wed, Feb 21, 2024 at 7:41 AM Chris Hegarty wrote: > So I think this means we are now free to use all the newfangled language > features since Java 11 (min required for Lucene 9.x) -> Java 21? > > For the _main_ branch, yes. > > The _branch_9x_ remains unchanged - it stays on Java 11. > > So,

Re: Bump the Lucene main branch to Java 21

Thank you for the heads up Chris. So I think this means we are now free to use all the newfangled language features since Java 11 (min required for Lucene 9.x) -> Java 21? Mike McCandless http://blog.mikemccandless.com On Wed, Feb 21, 2024 at 3:58 AM Chris Hegarty wrote: > Hi, > > A number

Re: Welcome Zhang Chao as Lucene committer

Welcome Chao! Mike McCandless http://blog.mikemccandless.com On Wed, Feb 21, 2024 at 5:02 AM Stefan Vodita wrote: > Congratulations, Chao! > > On Tue, 20 Feb 2024 at 17:28, Adrien Grand wrote: > >> I'm pleased to announce that Zhang Chao has accepted the PMC's >> invitation to become a

Re: Announcing githubsearch!

On Tue, Feb 20, 2024 at 10:06 AM Stefan Vodita wrote: Thank you Mike, I really like all the facets! > Me too lol. It was one of the big motivators for me to build this out. GitHub's search didn't have all the facet drill-downs/up/sideways I wanted. Some of them are super useful like "which

Re: Announcing githubsearch!

you Mike for developing and hosting these services! > > Julie > > On Mon, Feb 19, 2024 at 9:40 AM Michael Wechner > wrote: > >> thank you very much! >> >> Am 19.02.24 um 17:39 schrieb Michael McCandless: >> >> Hi Team, >> >> ~1.5 years ago (

Re: Announcing githubsearch!

On Mon, Feb 19, 2024 at 1:00 PM Walter Underwood wrote: It appears to always search prefixes, so there is no way to search for > “wunder” without getting “wundermap” and “wunderground”. Putting the term > in quotes doesn’t turn that off. > Hmm that shouldn't be the case? It does split on camel

Re: Announcing githubsearch!

On Tue, Feb 20, 2024 at 6:01 AM Michael Sokolov wrote: I love the gray all text UI. Don't change it! But I wonder if it's time for > a favicon? > LOL favicon! You do NOT want to have to confront my artistic skills! Mike McCandless http://blog.mikemccandless.com >

Announcing githubsearch!

Hi Team, ~1.5 years ago (August 2022) we migrated our Lucene issue tracking from Jira to GitHub. Thank you Tomoko for all the hard work doing such a complex, multi-phased, high-fidelity migration! I finally finished also migrating jirasearch to GitHub: githubsearch.mikemccandless.com. It was

Re: [VOTE] Release Lucene 9.10.0 RC1

+1 SUCCESS! [0:19:57.370204] Mike McCandless http://blog.mikemccandless.com On Mon, Feb 19, 2024 at 6:26 AM Chris Hegarty wrote: > > +1 SUCCESS! [1:14:49.683559] > > -Chris. > > > On 15 Feb 2024, at 21:08, Uwe Schindler wrote: > > > > Hi, > > I used Stefan Vodita's Hack to make the

Re: Lucene 9.10

+1 to release 9.10. Thank you for volunteering Adrien! Mike McCandless http://blog.mikemccandless.com On Wed, Feb 7, 2024 at 9:57 AM Adrien Grand wrote: > Hello all, > > It's been 2 months since we released 9.9 and we accumulated a good number > of changes, so I'd like to propose that we

Re: Needs help reviewing on Lucene PostingsFormat memory improvement

Hi Anh Dũng Bùi, Thank you for tackling these and being so gently patient/persisting! Sorry for the delay. I will try to review them soon. The off-heap (streaming?) building of FSTs is really a massive improvement to Lucene, inspired by Tantivy's FST implementation:

Re: [VOTE] Release Lucene 9.9.2 RC1

+1 SUCCESS! [0:18:29.298410] Thank you Chris! Mike McCandless http://blog.mikemccandless.com On Thu, Jan 25, 2024 at 6:57 AM Chris Hegarty wrote: > Please vote for release candidate 1 for Lucene 9.9.2 > > The artifacts can be downloaded from: > >

Welcome Stefan Vodita as Lucene committter

Hi Team, I'm pleased to announce that Stefan Vodita has accepted the Lucene PMC's invitation to become a committer! Stefan, the tradition is that new committers introduce themselves with a brief bio. Congratulations, welcome, and thank you for all your improvements to Lucene and our community,

Re: [JENKINS] Lucene-main-Linux (64bit/hotspot/jdk-21.0.1) - Build # 46049 - Unstable!

Hmm this is an interesting failure ... one of the hits scores is off by a wee bit (one ULP?). Mike McCandless http://blog.mikemccandless.com On Tue, Jan 2, 2024 at 7:33 AM Policeman Jenkins Server wrote: > Build: https://jenkins.thetaphi.de/job/Lucene-main-Linux/46049/ > Java:

Heads up: upcoming GitHub action to mark stale Lucene PRs

Hi Team, Stefan Vodita made an awesome simple PR adding a GitHub action to remind / nag us about stale PRs: https://github.com/apache/lucene/pull/12813 This happened after an in-person discussion at the last Community Over Code NA in Halifax where Stefan learned about the nice automation Apache

Re: [JENKINS] Lucene-main-Linux (64bit/hotspot/jdk-19) - Build # 45856 - Unstable!

I'll try to get to the bottom of this Adrien, thanks for digging! I wonder if we are violating this (subtle) requirement in the Terms.intersect API: Note that the provided startTerm must be accepted by the automaton. The failures involving DirectPostingsFormat seem angry that we are indeed

Re: [JENKINS] Lucene » Lucene-Check-9.x - Build # 7187 - Still Unstable!

I'll try to bottom this one out. Mike McCandless http://blog.mikemccandless.com On Wed, Dec 20, 2023 at 6:25 AM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Check-9.x/7187/ > > 1 tests failed. > FAILED:

Re: [JENKINS] Lucene-main-Linux (64bit/hotspot/jdk-17.0.9) - Build # 45858 - Still Unstable!

Oh this is the new (awesome) check Adrien recent added to CheckIndex, so maybe this check is catching some pre-existing bugs in one of our (hopefully experimental, not default!) codecs? Mike McCandless http://blog.mikemccandless.com On Tue, Dec 19, 2023 at 3:43 PM Michael McCandless <

Re: [JENKINS] Lucene-main-Linux (64bit/hotspot/jdk-17.0.9) - Build # 45858 - Still Unstable!

Hmm anyone know why this test suddenly started failing...? Mike McCandless http://blog.mikemccandless.com On Tue, Dec 19, 2023 at 3:35 PM Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: https://jenkins.thetaphi.de/job/Lucene-main-Linux/45858/ > Java: 64bit/hotspot/jdk-17.0.9

Re: [VOTE] Release Lucene 9.9.1 RC1

On Thu, Dec 14, 2023 at 11:33 AM Adrien Grand wrote: Thanks Chris for taking care of this release. > +1! And sorry about the respin... Mike McCandless http://blog.mikemccandless.com

Re: [JENKINS] Lucene » Lucene-NightlyTests-main - Build # 1209 - Unstable!

stings. > > On Fri, Dec 8, 2023 at 2:16 PM Michael McCandless < > luc...@mikemccandless.com> wrote: > >> OK I reverted the "optimization" to not pull FieldInfo for a field when >> getting Points values from SlowCompositeCodecReaderWrapper! Clearly it was &

Re: [JENKINS] Lucene-MMAPv2-Linux (64bit/hotspot/jdk-17.0.9) - Build # 1537 - Failure!

Timeout. Mike McCandless http://blog.mikemccandless.com On Thu, Dec 14, 2023 at 9:09 AM Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: https://jenkins.thetaphi.de/job/Lucene-MMAPv2-Linux/1537/ > Java: 64bit/hotspot/jdk-17.0.9 -XX:-UseCompressedOops -XX:+UseShenandoahGC > >

Re: Running tests with streaming console output but NOT verbose?

u can turn it > off independently though (-Ptests.infostream=false) or even set the default > in your gradle.properties... > > So I don't think there's anything to do here? For the record, all the test > options and their defaults are displayed with: > > gradlew -p lucene\core testOpts

Re: [VOTE] Release Lucene 9.9.1 RC1

+1 SUCCESS! [0:14:52.296147] I also cracked a bit of rust off our Monster tests and all but one passed: https://github.com/apache/lucene/pull/12942 Mike McCandless http://blog.mikemccandless.com On Wed, Dec 13, 2023 at 4:24 PM Benjamin Trent wrote: > SUCCESS! [1:06:02.232333] > > + 1! > >

Re: [JENKINS] Lucene-9.x-MacOSX (64bit/hotspot/jdk-17.0.9) - Build # 3226 - Failure!

Build timed out. Mike McCandless http://blog.mikemccandless.com On Wed, Dec 13, 2023 at 7:50 PM Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: https://jenkins.thetaphi.de/job/Lucene-9.x-MacOSX/3226/ > Java: 64bit/hotspot/jdk-17.0.9 -XX:+UseCompressedOops -XX:+UseG1GC > > All

Re: Running tests with streaming console output but NOT verbose?

> > def verboseMode = resolvedTestOption("tests.verbose").toBoolean() > > I can't remember why it aligns with Lucene's logger. Maybe it should/could > be a > separate property? I find it difficult to come up with a reasonable name > though. > > D. > >

Running tests with streaming console output but NOT verbose?

Hi Team, This is prolly a Dawid question... Sometimes I want to run a test (like a slow Monster test), seeing its ongoing musings popping out on the console in "real time" (not buffered). I can do this today by adding "-Dtests.verbose=true" to the ./gradlew invocation that's running the test.

Re: The need for a Lucene 9.9.1 release

ike, > > > On 12 Dec 2023, at 12:56, Michael McCandless > wrote: > > > > Hi Chris, > > > > I think we should also regenerate the FSTs for 9.9.1? > > Seems reasonable. > > > https://github.com/apache/lucene/pull/12924 > > I adde

Re: The need for a Lucene 9.9.1 release

Hi Chris, I think we should also regenerate the FSTs for 9.9.1? https://github.com/apache/lucene/pull/12924 Thanks, Mike On Tue, Dec 12, 2023 at 7:54 AM Guo Feng wrote: > Heads up: > > The bug fix PR (https://github.com/apache/lucene/pull/12900) has been > merged to main, and backported

Re: [JENKINS] Lucene » Lucene-NightlyTests-main - Build # 1209 - Unstable!

OK I reverted the "optimization" to not pull FieldInfo for a field when getting Points values from SlowCompositeCodecReaderWrapper! Clearly it was not safe ;) Mike McCandless http://blog.mikemccandless.com On Fri, Dec 8, 2023 at 8:06 AM Michael McCandless wrote: > Uh oh -- I'll

Re: [JENKINS] Lucene » Lucene-NightlyTests-main - Build # 1209 - Unstable!

Uh oh -- I'll dig. We may need to put back the FieldInfo check before pulling points. Tricky! Mike McCandless http://blog.mikemccandless.com On Fri, Dec 8, 2023 at 3:55 AM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > Build: >

Re: [JENKINS] Lucene-MMAPv2-Linux (64bit/openj9/jdk-17.0.8) - Build # 1500 - Unstable!

Oh, nevermind -- we have seen it before, and added a comment on the upstream (Open J9) issue: https://github.com/eclipse-openj9/openj9/issues/18400#issuecomment-1795093834 Mike McCandless http://blog.mikemccandless.com On Thu, Dec 7, 2023 at 8:32 AM Michael McCandless wrote: >

Re: [JENKINS] Lucene-MMAPv2-Linux (64bit/openj9/jdk-17.0.8) - Build # 1500 - Unstable!

Hmm -- this looks like maybe another Open J9 specific failure? I have not seen this one before I think... Mike McCandless http://blog.mikemccandless.com On Fri, Dec 1, 2023 at 10:20 PM Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build:

Re: [JENKINS] Lucene-9.x-Linux (64bit/hotspot/jdk-11.0.21) - Build # 14204 - Unstable!

Hmm this reproduces for me, and looks new/unique. Could it be related to recent 9.9.0 changes / release blocker? Mike On Fri, Dec 1, 2023 at 3:33 PM Policeman Jenkins Server wrote: > Build: https://jenkins.thetaphi.de/job/Lucene-9.x-Linux/14204/ > Java: 64bit/hotspot/jdk-11.0.21

Re: [VOTE] Release Lucene 9.9.0 RC2

+1 SUCCESS! [0:20:12.297376] Mike McCandless http://blog.mikemccandless.com On Fri, Dec 1, 2023 at 9:21 AM Uwe Schindler wrote: > Hi, > > I let Policeman Jenkins run the smoke tester with Java 11 and Java 17 > (unfortunately we have no support for 21 yet, so new MMap and Vectors were >

Re: [VOTE] Release Lucene 9.9.0 RC1

On Thu, Nov 30, 2023 at 9:56 AM Chris Hegarty wrote: P.S. I’m less sure about this, but the RC 2 starts a 72hr voting time > again? (Just so I know what TTL to put on that) > Yeah a new 72 hour clock starts with each new RC :) Mike McCandless http://blog.mikemccandless.com

Re: GitHub issues vs PRs vs Lucene's CHANGES.txt

ike McCandless http://blog.mikemccandless.com On Wed, Nov 29, 2023 at 6:01 AM Michael McCandless < luc...@mikemccandless.com> wrote: > Oh, and that the CHANGES.txt entries in e.g. 9.9.0 section match on 9.x > and main branches... I think that one we have some automation to catch? >

Re: [VOTE] Release Lucene 9.9.0 RC1

+1 to release. I hit a corner-case test failure and opened a PR to fix it: https://github.com/apache/lucene/pull/12859 I don't think this should block the release? -- it looks exotic. Thanks Chris! Mike McCandless http://blog.mikemccandless.com On Thu, Nov 30, 2023 at 1:16 AM Patrick Zhai

Re: [JENKINS] Lucene » Lucene-Check-main - Build # 10750 - Unstable!

I hit this one running the smoke tester on 9.9.0 RC 0, and it repros. I'll open an issue ... I think it's just a missing null check in the SlowCompositeCodecReaderWrapper. Mike McCandless http://blog.mikemccandless.com On Tue, Nov 28, 2023 at 6:37 PM Apache Jenkins Server <

Re: GitHub issues vs PRs vs Lucene's CHANGES.txt

Oh, and that the CHANGES.txt entries in e.g. 9.9.0 section match on 9.x and main branches... I think that one we have some automation to catch? Mike McCandless http://blog.mikemccandless.com On Wed, Nov 29, 2023 at 5:58 AM Michael McCandless < luc...@mikemccandless.com> wrote: >

GitHub issues vs PRs vs Lucene's CHANGES.txt

Hi Team, I see Chris is tagging issues that were left open after their linked PRs were merged (thanks!). Is there something in our release tooling that cross-checks all the weakly linked metadata today: Milestone marked (or more often: not) on an issue vs commits to the respective branches vs

Re: [JENKINS] Lucene-9.x-Linux (64bit/hotspot/jdk-19) - Build # 14180 - Failure!

JVM crashed: # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x7f9fa8545493, pid=2982126, tid=2990096 # # JRE version: OpenJDK Runtime Environment (19.0+36) (build 19+36-2238) # Java VM: OpenJDK 64-Bit Server VM (19+36-2238, mixed mode, sharing,

Re: [JENKINS] Lucene » Lucene-NightlyTests-main - Build # 1199 - Unstable!

OK I pushed a fix. Mike On Tue, Nov 28, 2023 at 7:32 PM Michael McCandless < luc...@mikemccandless.com> wrote: > I think maybe LuceneTestCase.newSearcher is turning on concurrency > (setting the executor randomly). Since this test explicitly passes a "no > concurrency&

Re: [JENKINS] Lucene » Lucene-NightlyTests-main - Build # 1199 - Unstable!

I think maybe LuceneTestCase.newSearcher is turning on concurrency (setting the executor randomly). Since this test explicitly passes a "no concurrency" collector manager I think we should switch to "new IndexSearcher(...)". Mike On Tue, Nov 28, 2023 at 7:29 PM Mich

Re: [JENKINS] Lucene » Lucene-NightlyTests-main - Build # 1199 - Unstable!

This reproduces for me. Maybe related to LUCENE-10002 / #240? Mike On Tue, Nov 28, 2023 at 1:58 AM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > Build: > https://ci-builds.apache.org/job/Lucene/job/Lucene-NightlyTests-main/1199/ > > 1 tests failed. > FAILED:

Re: [JENKINS] Lucene-main-Linux (64bit/hotspot/jdk-19) - Build # 45643 - Failure!

Hmm JVM crashed (there's an hs_err file there): > Process 'Gradle Test Executor 33' finished with non-zero exit value 134 Mike McCandless http://blog.mikemccandless.com On Sat, Nov 25, 2023 at 6:34 AM Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build:

Re: Lucene 9.9.0 Release

+1 Thank you for volunteering as RC Chris! Mike McCandless http://blog.mikemccandless.com On Tue, Nov 21, 2023 at 4:52 AM Chris Hegarty wrote: > Hi, > > It's been a while since the 9.8.0 release and we’ve accumulated quite a > few changes. I’d like to propose that we release 9.9.0. > > If

Re: [JENKINS] Lucene-9.x-MacOSX (64bit/hotspot/jdk-11.0.21) - Build # 3165 - Still Failing!

Build timed out (after 169 minutes). Marking the build as aborted. Build timed out (after 169 minutes). Marking the build as failed. Mike McCandless http://blog.mikemccandless.com On Mon, Nov 20, 2023 at 5:01 PM Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build:

Re: [JENKINS] Lucene-MMAPv2-Linux (64bit/hotspot/jdk-17.0.9) - Build # 1442 - Failure!

Hmm again timeout. Something seems amiss. Do our super slow tests still print out HEARTBEAT periodically? Or did we lose that in the gradle migration maybe? Build timed out (after 126 minutes). Marking the build as aborted. Build timed out (after 126 minutes). Marking the build as failed.

Re: [JENKINS] Lucene-main-Linux (64bit/hotspot/jdk-17.0.9) - Build # 45536 - Failure!

s it (it > has no hard limit, it takes the average time of previous runs and if one > takes much longer it kills). > > Uwe > > Am 14.11.2023 um 11:06 schrieb Michael McCandless: > > Hmm build timed out -- not sure why it's taking so long to run tests: > > Build timed out

Re: [JENKINS] Lucene-main-Linux (64bit/hotspot/jdk-17.0.9) - Build # 45536 - Failure!

Hmm build timed out -- not sure why it's taking so long to run tests: Build timed out (after 137 minutes). Marking the build as aborted. Build timed out (after 137 minutes). Marking the build as failed. Mike McCandless http://blog.mikemccandless.com On Tue, Nov 14, 2023 at 1:39 AM Policeman

Re: Boolean field type

Hi Michael/Mikhails, yet another Mike here: If you create a NumericDocValuesField, and it only ever has one value per doc (0, 1), I think the default Codec will compress it well, though maybe not as well as your idea. It's a neat idea to notice a "very common default value" and not store it and

Re: Healthy PR Approaches from Apache Beam

gt; > Stefan > > > On Thu, 2 Nov 2023 at 15:30, Michael McCandless > wrote: > >> Thanks for raising this Stefan. This is an impressive approach to more >> rigorously responding on PRs and taking them through their lifecycle, >> giving a better community experience esp

Re: [JENKINS] Lucene-9.x-Linux (64bit/openj9/jdk-11.0.20) - Build # 14015 - Still Failing!

I linked to this thread on the upstream (OpenJ9) issue about recent Lucene CI build failures: https://github.com/eclipse-openj9/openj9/issues/18400 Mike McCandless http://blog.mikemccandless.com On Mon, Nov 13, 2023 at 3:09 AM Dawid Weiss wrote: > > Sure, thanks. What's strange is that we

Welcome Patrick Zhai to the Lucene PMC

I'm happy to announce that Patrick Zhai has accepted an invitation to join the Lucene Project Management Committee (PMC)! Congratulations Patrick, thank you for all your hard work improving Lucene's community and source code, and welcome aboard! Mike McCandless http://blog.mikemccandless.com

Re: [JENKINS] Lucene » Lucene-Check-9.x - Build # 6861 - Failure!

I pushed a fix. Curious -- the build indeed fails if I use Java 11 on 9.x, but passes if I use Java 17+. I'm really confused. Did the javadoc checking get weaker with newer JDKs? Anyway, I'll port this fix to main. Mike McCandless http://blog.mikemccandless.com On Mon, Nov 6, 2023 at 10:27 

Re: [JENKINS] Lucene » Lucene-Check-9.x - Build # 6861 - Failure!

Woops -- I'll fix. renderJavadoc failure! Mike McCandless http://blog.mikemccandless.com On Mon, Nov 6, 2023 at 10:27 AM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > Build: https://ci-builds.apache.org/job/Lucene/job/Lucene-Check-9.x/6861/ > > No tests ran. > > Build Log: >

Re: [JENKINS] Lucene-main-Linux (64bit/openj9/jdk-17.0.5) - Build # 45394 - Unstable!

On Sun, Nov 5, 2023 at 5:01 AM Uwe Schindler wrote: > I will update the J9 runtime later this day. But this was a real bug, so > it's good it catched this :-) So - no - I won't remove OpenJ9 support at > all. > I see, that's great that J9 build is indeed catching real Lucene bugs! +1 to keep

Re: [JENKINS] Lucene-main-Linux (64bit/openj9/jdk-17.0.5) - Build # 45394 - Unstable!

OK I opened https://github.com/eclipse-openj9/openj9/issues/18400 -- let's see where that goes. Uwe, should we upgrade to the latest OpenJ9 again maybe? Mike McCandless http://blog.mikemccandless.com On Sat, Nov 4, 2023 at 12:25 PM Michael McCandless < luc...@mikemccandless.com>

Re: [JENKINS] Lucene-main-Linux (64bit/openj9/jdk-17.0.5) - Build # 45394 - Unstable!

Should we maybe stop testing J9? Reduce its frequency? So much noise ... I know I can filter these out from my gmail box. I will try opening an issue in the OpenJ9 GitHub repo: https://github.com/eclipse-openj9/openj9/issues Mike McCandless http://blog.mikemccandless.com On Fri, Nov 3,

Re: [JENKINS] Lucene-main-Linux (64bit/openj9/jdk-17.0.5) - Build # 45409 - Unstable!

Likely J9 specific? Mike McCandless http://blog.mikemccandless.com On Sat, Nov 4, 2023 at 11:34 AM Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: https://jenkins.thetaphi.de/job/Lucene-main-Linux/45409/ > Java: 64bit/openj9/jdk-17.0.5 -XX:-UseCompressedOops -Xgcpolicy:gencon

Re: [JENKINS] Lucene-main-Windows (64bit/openj9/jdk-17.0.5) - Build # 13400 - Unstable!

Maybe J9 specific? Mike McCandless http://blog.mikemccandless.com On Sat, Nov 4, 2023 at 11:01 AM Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: https://jenkins.thetaphi.de/job/Lucene-main-Windows/13400/ > Java: 64bit/openj9/jdk-17.0.5 -XX:-UseCompressedOops -Xgcpolicy:gencon

Re: Squash vs merge of PRs

I didn't realize the community had decided squashing (rewriting history) was our standard. > Comparing histories between branches with git-bisect to find bugs is just one example. But if the bug was introduced in one of the N local commits the developer had done, wouldn't that be helpful? You

Re: Healthy PR Approaches from Apache Beam

Thanks for raising this Stefan. This is an impressive approach to more rigorously responding on PRs and taking them through their lifecycle, giving a better community experience especially for newcomers. I love their docs too. Those graphs are awesome! Much better than the simple PR

Re: [JENKINS] Lucene-9.x-Linux (64bit/openj9/jdk-17.0.5) - Build # 13732 - Unstable!

Wow, thank you Adrien! Cascaded merges count as uncommitted changes ... Mike McCandless http://blog.mikemccandless.com On Tue, Oct 31, 2023 at 4:51 AM Adrien Grand wrote: > I pushed a fix for these failures: > https://github.com/apache/lucene/commit/85f5d3bb0bf84fed46ca4c093c1aa084e4a43873

Re: [JENKINS] Lucene » Lucene-Coverage-main - Build # 937 - Unstable!

OK I pushed a fix: https://github.com/apache/lucene/commit/11436a848cbcc8302b31ca01e63e57dd35a93b1e Mike On Sat, Oct 28, 2023 at 3:10 PM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > Build: > https://ci-builds.apache.org/job/Lucene/job/Lucene-Coverage-main/937/ > > 1 tests failed.

Re: [JENKINS] Lucene » Lucene-Coverage-main - Build # 937 - Unstable!

This repros for me ... silly test bug. I'll commit a fix. Mike On Sat, Oct 28, 2023 at 3:10 PM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > Build: > https://ci-builds.apache.org/job/Lucene/job/Lucene-Coverage-main/937/ > > 1 tests failed. > FAILED:

Re: Welcome Guo Feng to the Lucene PMC

Welcome Feng! Mike McCandless http://blog.mikemccandless.com On Wed, Oct 25, 2023 at 5:05 AM Michael Sokolov wrote: > Welcome, gf2121! > > On Wed, Oct 25, 2023, 3:03 AM Ishan Chattopadhyaya < > ichattopadhy...@gmail.com> wrote: > >> Congratulations and welcome, Feng! >> >> On Tue, 24 Oct

Re: Could we allow an IndexInput to read from a still writing IndexOutput?

Thanks everyone! Responses below: On Thu, Oct 19, 2023 at 11:17 AM Robert Muir wrote: > what will happen on windows? > > sorry, could not resist. > LOL, yeah, sigh. On Thu, Oct 19, 2023 at 10:36 PM Dawid Weiss wrote: > > I think there is a certain beauty (of tape-backed storage flavor...)

Re: Can we get rid of "Approve & Run" on GitHub PRs by new contributors (non-committers)?

Thanks everyone! Responses below: On Mon, Oct 16, 2023 at 7:37 AM Uwe Schindler wrote: > this seems to be a safety feature and is also enabled in general for > Github. I found no options in asf.yaml to enable/disable it: > OK, thanks for checking Uwe. > Nevertheless, I see no problem for

Re: Welcome Luca Cavanna to the Lucene PMC

Welcome Luca! Mike On Sun, Oct 22, 2023 at 4:34 PM Tomás Fernández Löbbe wrote: > Congratulations Luca! > > On Sun, Oct 22, 2023 at 10:51 AM Michael Sokolov > wrote: > >> Congratulations and welcome, Luca! >> >> On Sun, Oct 22, 2023 at 1:42 PM Julie Tibshirani >> wrote: >> > >> >

Could we allow an IndexInput to read from a still writing IndexOutput?

Hi Team, Today, Lucene's Directory abstraction does not allow opening an IndexInput on a file until the file is fully written and closed via IndexOutput. We enforce this in tests, and some of our core Directory implementations demand this (e.g. caching the file's length on opening an

Can we get rid of "Approve & Run" on GitHub PRs by new contributors (non-committers)?

When a non-committer (I think?) opens a PR, one of the committers must notice it and click Approve & Run so the contributor can find out if something broke in our automated tests/precommit/linting. This seems like a waste, and a friction in the worst possible place for our community: new

Re: [VOTE] Release Lucene 9.8.0 RC1

+1 SUCCESS! [0:21:40.221538] Mike McCandless http://blog.mikemccandless.com On Mon, Sep 25, 2023 at 7:01 AM Julie Tibshirani wrote: > +1 > > SUCCESS! [0:41:00.311710] > > Julie > > On Mon, Sep 25, 2023 at 9:38 AM Anshum Gupta > wrote: > >> +1 >> >> Smoke tester is happy! >> >> SUCCESS!

Re: [JENKINS] Lucene » Lucene-NightlyTests-9.x - Build # 665 - Unstable!

OK I opened https://github.com/apache/lucene/pull/12535 Mike McCandless http://blog.mikemccandless.com On Sat, Sep 2, 2023 at 7:17 AM Michael McCandless wrote: > > The code is just good old socket accept loop as we have all learned it > in school when we were fighting to write a s

Re: [JENKINS] Lucene » Lucene-NightlyTests-9.x - Build # 665 - Unstable!

nnection. >>> >>> On Thu, Aug 31, 2023 at 8:16 AM Dawid Weiss wrote: >>> >>>> >>>> >>>> >>>> https://ge.apache.org/s/orksynljk2yp6/tests/task/:lucene:core:test/details/org.apache.lucene.store.TestStressLockFactories/testSimpleFSLockFactor

Re: [JENKINS] Lucene » Lucene-NightlyTests-9.x - Build # 665 - Unstable!

Good grief -- why are we getting SocketTimeoutException in our LockVerifyServer's attempt to accept an incoming connection!? These are all processes running on the same host ... Mike McCandless http://blog.mikemccandless.com On Tue, Aug 29, 2023 at 11:17 PM Apache Jenkins Server <

Re: Vector Search with OpenAI Embeddings: Lucene Is All You Need

Thanks Michael, very interesting! I of course agree that Lucene is all you need, heh ;) Jimmy Lin also tweeted about the strength of Lucene's HNSW: https://twitter.com/lintool/status/1681333664431460353?s=20 Mike McCandless http://blog.mikemccandless.com On Thu, Aug 31, 2023 at 3:31 AM

Re: WrongThreadException using the new Panama MMap on Java 19

Thanks Uwe! Responses inlined below: On Thu, Aug 17, 2023 at 9:46 AM Uwe Schindler wrote: > this error indeed cannot happen as all our segments are shared. It could > still be some bug in the Java 19 version, did you try Java 21 or Java 20? > OK, phew, that is what I thought (from reading

WrongThreadException using the new Panama MMap on Java 19

Hi Team, We hit an interesting and exciting intermittent exception in our customer-facing product search instance (all Lucene!) at Amazon: java.lang.WrongThreadException: Attempted access outside owning thread at

Re: Branchless binary search in Java?

n Thu, Jul 27, 2023 at 1:40 PM Michael McCandless < > luc...@mikemccandless.com> wrote: > >> Hi Team, >> >> At Amazon (customer facing product search team) we've been playing with / >> benchmarking Tantivy (exciting Rust search engine loosely inspired by >>

Re: Branchless binary search in Java?

On Sun, Jul 30, 2023 at 11:17 AM Bruno Roustant wrote: Interesting coincidence, I'm currently working on a learned index on sorted > keys that can advantageously replace binary search. > It is very compact (additional space of 2% of the sorted key array, e.g. > 40KB for 200MB of keys), and it is

Re: Branchless binary search in Java?

On Fri, Jul 28, 2023 at 7:04 AM Dawid Weiss wrote: > Actually this is exactly the same for Java: >> > Yup, I know (we all know by now, I guess). People (including me) evidently > crave this low, iron-level control, while at the same time mostly try to > dodge writing any software in languages

Re: Branchless binary search in Java?

Yeah +1 on waiting/asking/expecting CMOV to be properly utilized by Hotspot, instead of trying to target the instruction ourselves. This is all more of a curiosity / exploration. I am curious whether "branchless binary search" is something Arrays.binarySearch already does / compiles to. Even in

Re: Branchless binary search in Java?

On Thu, Jul 27, 2023 at 9:19 AM Uwe Schindler wrote: See Shipilevs blog: > https://shipilev.net/jvm/anatomy-quarks/30-conditional-moves/ > Really interesting! This is an awesome, quick explanation of the tradeoff CMOV is making (pre-computing both paths) vs branching (have to predict, with

Re: Branchless binary search in Java?

On Thu, Jul 27, 2023 at 8:44 AM Uwe Schindler wrote: > Hi Mike, > > actually Hotspot is using CMOV. Some nodes after bytecode analysis are > converted to CMoveNode and it has implementations to generate machine code > (as far as i see) for x86, s390 and arm. > > The generic code is here: >

Branchless binary search in Java?

Hi Team, At Amazon (customer facing product search team) we've been playing with / benchmarking Tantivy (exciting Rust search engine loosely inspired by Lucene: https://github.com/quickwit-oss/tantivy, created by Paul Masurel and developed now by Quickwit and the Tantivy open source dev

Re: [VOTE] Release PyLucene 9.7.0-rc1

+1 I ran the same exciting smoke test -- indexing first 100K enwiki docs, running a few political searches, force merging, searching again. Everything ran fine! Arch Linux kernel 6.3.2, Java 17.0.7+7, Python 3.11.3. Sorry for the delay! Mike On Sun, Jul 9, 2023 at 3:28 PM Dawid Weiss wrote:

Re: [JENKINS] Lucene-9.x-Linux (64bit/hotspot/jdk-17.0.5) - Build # 11322 - Unstable!

Thanks for digging Patrick! I sort of think MaxScoreBulkScorer should be returning NO_MORE_DOCS in this case? But I'm far from an expert. This may be related to the recent MAXScore improvements for disjunctions? ( https://github.com/apache/lucene/commit/8703e449cee0693e50a7922a86c1cbc7dcf95d13

Re: [VOTE] Release Lucene 9.7.0 RC1

+1 SUCCESS! [0:16:13.144051] Mike On Fri, Jun 23, 2023, 11:48 PM Gautam Worah wrote: > SUCCESS! [0:32:53.769993] > > +1 (non-binding) > > Regards, > Gautam Worah. > > > On Fri, Jun 23, 2023 at 3:50 PM Mayya Sharipova > wrote: > >> Thank you Adrien! >> >> SUCCESS! [0:59:16.681584] >> +1 >>

Re: Welcome Chris Hegarty to the Lucene PMC

Welcome aboard Chris! Mike McCandless http://blog.mikemccandless.com On Mon, Jun 19, 2023 at 7:16 AM Ishan Chattopadhyaya < ichattopadhy...@gmail.com> wrote: > Congratulations Chris! > > On Mon, 19 Jun, 2023, 3:23 pm Adrien Grand, wrote: > >> I'm pleased to announce that Chris Hegarty has

  1   2   3   4   5   6   7   8   9   10   >