Re: Lucene (unexpected ) fsync on existing segments

2021-03-12 Thread Rahul Goswami
Thanks Michael. For your question...yes I am running Solr on Windows and running it with SimpleFSDirectoryFactory (primary reason being that memory mapping multi-terabyte indexes is not feasible through mmap). I will create a Jira later today with the details in this thread and assign it to myself.

Re: Lucene (unexpected ) fsync on existing segments

2021-03-12 Thread Michael McCandless
I think long ago we used to track which files were actually dirty (we had written bytes to) and only fsync those ones. But something went wrong with that, and at some point we "simplified" this logic, I think on the assumption that asking the OS to fsync a file that does in fact exist yet indeed h

Re: Lucene (unexpected ) fsync on existing segments

2021-03-12 Thread Michael Sokolov
Also - I should have said - I think the first step here is to write a focused unit test that demonstrates the existence of the extra fsyncs that we want to eliminate. It would be awesome if you were able to create such a thing. On Fri, Mar 12, 2021 at 9:00 AM Michael Sokolov wrote: > > Yes, pleas

Re: Lucene (unexpected ) fsync on existing segments

2021-03-12 Thread Michael Sokolov
Yes, please go ahead and open an issue. TBH I'm not sure why this is happening - there may be a good reason?? But let's explore it using an issue, thanks. On Fri, Mar 12, 2021 at 12:16 AM Rahul Goswami wrote: > > I can create a Jira and assign it to myself if that's ok (?). I think this > can he

Lucene-Solr-cloud2refimpl

2021-03-12 Thread Michael Sokolov
Should these Jenkins builds be directing their email to bui...@solr.apache.org now? - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org

Re: Welcome Bruno to the Apache Lucene PMC

2021-03-12 Thread Martin Gainty
welcome Bruno! martin From: Dawid Weiss Sent: Thursday, March 11, 2021 10:59 AM To: Lucene Dev Subject: Re: Welcome Bruno to the Apache Lucene PMC Welcome, Bruno! On Thu, Mar 11, 2021 at 4:29 PM Gus Heck wrote: > > Welcome :) > > On Thu, Mar 11, 2021 at 9:58 AM