Re: Question concerning refs on TestDemoParallelLeafReader

2017-10-03 Thread Michael McCandless
On Mon, Oct 2, 2017 at 2:25 PM, Dawid Weiss wrote: > I think the delayed deletes might have to do w/ segment warming? > > I'll have to digest the scenario you described tomorrow. I didn't hit > any exceptions when running those modified code snippets (which I'd be > very

Re: Question concerning refs on TestDemoParallelLeafReader

2017-10-03 Thread Dawid Weiss
Thanks again for the explanation, Mike. I understand it now. Dawid - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org

Re: Question concerning refs on TestDemoParallelLeafReader

2017-10-02 Thread Dawid Weiss
Hi Mike, Thanks for the feedback. > I think the delayed deletes might have to do w/ segment warming? I'll have to digest the scenario you described tomorrow. I didn't hit any exceptions when running those modified code snippets (which I'd be very grateful to see -- they'd provide an immediate

Re: Question concerning refs on TestDemoParallelLeafReader

2017-10-02 Thread David Smiley
On Mon, Oct 2, 2017 at 9:34 AM Michael McCandless wrote: > I am glad you're finding a use for this crazy class! I think it is a > powerful way for Lucene to efficiently add "derived fields" at search time. > +1 agreed! Could be used for NRT updates as well. But

Re: Question concerning refs on TestDemoParallelLeafReader

2017-10-02 Thread Michael McCandless
I think the delayed deletes might have to do w/ segment warming? I.e., after a merge finishes, but before IW exposes that segment in the current SIS, it's merged, at which point (via the merged segment warmer the test installs) we build its parallel index, but then I think (maybe!) its parallel

Re: Question concerning refs on TestDemoParallelLeafReader

2017-10-01 Thread Dawid Weiss
> I'll have to think about the first 2 questions still, but MDW stands for > MockDirectoryWrapper! Ah, sure thing. For what it's worth, I locally removed this delayed 'delete' list and removed the leaf folder immediately -- the tests passed without any problems on my Windows machine. Could be I

Re: Question concerning refs on TestDemoParallelLeafReader

2017-09-30 Thread Michael McCandless
Hi Dawid, I'll have to think about the first 2 questions still, but MDW stands for MockDirectoryWrapper! Mike McCandless http://blog.mikemccandless.com On Fri, Sep 29, 2017 at 5:55 AM, Dawid Weiss wrote: > This one is probably to Mike since he originally wrote this

Question concerning refs on TestDemoParallelLeafReader

2017-09-29 Thread Dawid Weiss
This one is probably to Mike since he originally wrote this "demo", but sending to dev@ for posteriority. I'm looking at something similar to what is shown in TestDemoParallelLeafReader -- creating (or recreating) secondary segments on the fly based on primary segments' data. I spent some time