Re: scalar quantization heap usage during merge

f functionality :) Best, Gautam Worah. On Wed, Jul 3, 2024 at 8:04 AM Benjamin Trent wrote: > Hey Gautam & Michael, > > I opened a PR that will help slightly. It should reduce the heap usage > by a smallish factor. But, I would still expect the cost to be > dominated by th

Re: scalar quantization heap usage during merge

his maybe could've caused the problems.. but if the ramBufferSizeMB is small and merges are disabled, it's hard to imagine how 40 GB could've been consumed. Best, Gautam Worah. On Wed, Jun 12, 2024 at 9:42 AM Benjamin Trent wrote: > Michael, > > Empirically, I am not su

Trading high latency for better throughput

ace? It's like having too much of a different currency and wondering if there is a way to convert it to a currency that you want :) Appreciate any insights or thoughts. Thanks! - Gautam Worah.

Experience with a round robin or dynamic collection of docs from segments within a Slice

ic smarter? Thanks for the help! - Gautam Worah.

Re: Inlining, virtual calls and BKDPointsTree

ories of products. Performance on both throughput and latency was flat. The change still LGTM. Regards, Gautam Worah. On Sat, Mar 2, 2024 at 8:45 AM Gautam Worah wrote: > > I am running Amazon Product Search's benchmarks to see if the change is > needle moving for us. > > R

Re: Inlining, virtual calls and BKDPointsTree

ad is heavily dominated by TermQueries and their combinations with various clauses. I'll try tweaking the query set to target queries with more Point hits during the week and see what comes out.. Regards, Gautam Worah. On Sat, Mar 2, 2024 at 2:33 AM Anton Hägerstrand wrote: > Thank you G

Re: Inlining, virtual calls and BKDPointsTree

x27;ve been a blog on its own, part 1 maybe.. I got confused when the blog shifted from the performance differences between ElasticSearch and OpenSearch, to how you ended up improving Lucene. Regards, Gautam Worah. On Fri, Mar 1, 2024 at 2:42 AM Anton Hägerstrand wrote: > Hi everyone, long

Re: ./crave pull .. 'heapdumps/* Fwd: [JENKINS] Solr » Solr-Check-9.x - Build # 5949 - Still Failing!

I think you meant to send it to d...@solr.apache.org? On Sun, Nov 26, 2023 at 12:24 AM Mikhail Khludnev wrote: > Hello > It's rather like a logical error in crave pull. How to work around it? > > + status=0 > + ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' > '**/hs_err

Re: [VOTE] Release Lucene 9.7.0 RC1

SUCCESS! [0:32:53.769993] +1 (non-binding) Regards, Gautam Worah. On Fri, Jun 23, 2023 at 3:50 PM Mayya Sharipova wrote: > Thank you Adrien! > > SUCCESS! [0:59:16.681584] > +1 > > On Fri, Jun 23, 2023 at 3:35 AM Uwe Schindler wrote: > >> Hi, >> >

Re: Lucene PMC Chair Greg Miller

Greg >> Miller, and the Board has approved. >> >> Greg, thank you for stepping up, and congratulations! >> >> >> - Bruno >> > > > -- > Anshum Gupta > -- Regards, Gautam Worah.

Re: Welcome Vigya Sharma as Lucene committer

t; I'm pleased to announce that Vigya Sharma has accepted the PMC's >>>> invitation to become a committer. >>>> >>>> Vigya, the tradition is that new committers introduce themselves with a >>>> brief bio. >>>> >>>> Congratulations and welcome! >>>> >>>> -- >>>> Adrien >>>> >>> >>> >>> -- >>> Anshum Gupta >>> >> >> >> -- >> - Vigya >> > -- Regards, Gautam Worah.

Re: [JENKINS] Lucene-main-MacOSX (64bit/jdk-18) - Build # 8148 - Failure!

Hi folks, We've recently started seeing an increased number of failed builds, especially on the TestMergeSchedulerExternal.testSubclassConcurrentMergeScheduler test case. The email that I've replied to is the first instance of these failed attempts. I suspect that the LUCENE-10078: Enable merge-o

Re: Welcome Greg Miller to the Lucene PMC

;>> > Congratulations and welcome, Greg. >>>> >>>> ----- >>>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >>>> For additional commands, e-mail: dev-h...@lucene.apache.org >>>> >>>> -- Regards, Gautam Worah.

Re: [JENKINS] Lucene-main-MacOSX (64bit/jdk-18) - Build # 7969 - Still Failing!

ps we need to check inside the jenkins machine? Gautam Worah. On Mon, Apr 25, 2022 at 1:14 PM Policeman Jenkins Server < jenk...@thetaphi.de> wrote: > Build: https://jenkins.thetaphi.de/job/Lucene-main-MacOSX/7969/ > Java: 64bit/jdk-18 -XX:+UseCompressedOops -XX:+UseSerialG

Re: [JENKINS] Lucene-main-Windows (64bit/jdk-18) - Build # 10725 - Unstable!

Seems to be related to the new TestAlwaysRefreshDirectoryTaxonomyReader test I introduced. Specifically, the loop which checks if any files still remain to be deleted is not ending. ``` SEVERE: 1 thread leaked from SUITE scope at org.apache.lucene.facet.taxonomy.directory.TestAlwaysRefreshDirecto

Re: [VOTE] Release Lucene 9.0.0 RC4

jdk probably have bugs generating the > javadocs. > > > > On Sat, Dec 4, 2021 at 3:04 AM Gautam Worah > wrote: > > > > > > openjdk 11 2018-09-25 > > > OpenJDK Runtime Environment 18.9 (build 11+28) > > > > > > On Fri, Dec 3, 2021 at 1

Re: [VOTE] Release Lucene 9.0.0 RC4

openjdk 11 2018-09-25 OpenJDK Runtime Environment 18.9 (build 11+28) On Fri, Dec 3, 2021 at 11:27 PM Dawid Weiss wrote: > Can you check which exact Java version you are using? (java -version)? > > On Sat, Dec 4, 2021 at 3:55 AM Gautam Worah > wrote: > > > > I tried run

Re: [VOTE] Release Lucene 9.0.0 RC4

I tried running the `python3 -u dev-tools/scripts/smokeTestRelease.py \ https://dist.apache.org/repos/dist/dev/lucene/lucene-9.0.0-RC4-rev-0b18b3b965cedaf5eb129aa41243a44c83ca826d` command directly on Mac OS X and RHEL flavored Linux and it fails on a documentation task for me. ``` > Task :lucene:

Re: Taxonomy backward compatibility tests

I think this makes sense. Lucene 9 continues to be backwards compatible with Lucene 8. Lucene 10 will be able to read Lucene 9,10 taxonomy indexes. LGTM! -- Gautam Worah. On Tue, Nov 2, 2021 at 6:09 AM Adrien Grand wrote: > Hello here, > > As part of changing the version of the ma

Re: Dynamic numeric range

ion. Lots of directions to explore! Regards, Gautam Worah. On Wed, May 26, 2021 at 3:52 PM Yuti G wrote: > Hello everyone, > > I have been exploring the possibilities of getting dynamic numeric range > facet counts without users specifying ranges. > > An example use-case might b

Re: Welcome Greg Miller as Lucene committer

Congratulations Greg :) On Mon, May 31, 2021, 8:02 AM Ilan Ginzburg wrote: > Congrats Greg! > > On Sun, May 30, 2021 at 4:35 PM Greg Miller wrote: > >> Thanks everyone! I'm honored to have been nominated and look forward >> to continuing to work with all of you on Lucene! I'm incredibly >> grat

Re: FacetResult#value semantics?

Hi Greg, I think your understanding is correct. I tried to create test cases for FastTaxonomyFacetCounts (inherits from IntTaxonomyFacets) and LongValueFacetCounts. FastTaxonomyFacetCounts treats common valu

Random disabling of asserts in tests is not working

t this feature when the project transitioned to Gradle. When I change the default value of `tests.asserts` in randomization.gradle to false, the test fails promptly. Has anyone else noticed this/knows more about this? Thanks, Gautam Worah.

Re: Github PR Actions

Hi everyone, I was wondering why we don't run every test on every PR. I saw the earlier comment which said it was too expensive but it would be good if we had that feature. As an experiment I ran all tests in a Github PR action here