Re: Soft commit and new replica types

2018-12-14 Thread Tomás Fernández Löbbe
max time is 300 sec then commit happens every > > 300 > > > > sec > > > > > > on > > > > > > > > tlog leader. And new segments pop up on the leader every 300 > > sec, > > > > > > d

Re: Soft commit and new replica types

2018-12-14 Thread Edward Ribeiro
t; > > > > > that on all other tlog replicas(not leaders) commit occurs > every > > > > poll? > > > > > > > воскресенье, 09 декабря 2018г., 19:21 +03:00 от Erick Erickson > > > > > > > erickerick...@gmail.com : &

Re: Soft commit and new replica types

2018-12-13 Thread Tomás Fernández Löbbe
... > > > > > > > > > > > > > >This has always bothered me a little bit, I wonder at the > utility > > > of a > > > > > > >config param. We already have old-style replication with a > > > > > > >co

RE: Soft commit and new replica types

2018-12-13 Thread Vadim Ivanov
searcher(it may be called soft commit). -- Vadim > -Original Message- > From: Edward Ribeiro [mailto:edward.ribe...@gmail.com] > Sent: Thursday, December 13, 2018 8:27 PM > To: solr-user@lucene.apache.org > Subject: Re: Soft commit and new replica types > > Hi Tomás, >

Re: Soft commit and new replica types

2018-12-13 Thread Edward Ribeiro
M Vadim Ivanov > > > > < vadim.iva...@spb.ntk-intourist.ru> wrote: > > > > > > > > > > Thanks, Edward, for clues. > > > > > What bothers me is newSearcher start, warming, cache clear... all > > that &

Re: Soft commit and new replica types

2018-12-10 Thread Tomás Fernández Löbbe
ru> wrote: > > > > > > > > Thanks, Edward, for clues. > > > > What bothers me is newSearcher start, warming, cache clear... all > that > > > CPU consuming stuff in my heavy-indexing scenario. > > > > With NRT I had autoSoftComm

Re: Soft commit and new replica types

2018-12-10 Thread Erick Erickson
ry replica. > > > To have more or less the same effect with TLOG - PULL collection, > > > I suppose, I have to have : 300000 > > > (yes, I understand that newSearchers start asynchronously on leader and > > replicas) > > > Am I right? > > >

Re: Soft commit and new replica types

2018-12-09 Thread Edward Ribeiro
ollection, > > I suppose, I have to have : 30 > > (yes, I understand that newSearchers start asynchronously on leader and > replicas) > > Am I right? > > -- > > Vadim > > > > > >> -Original Message- > >> From: Edward Ribeiro [

Re: Soft commit and new replica types

2018-12-09 Thread vadim . ivanov
...@gmail.com] >> Sent: Sunday, December 09, 2018 12:42 AM >> To: solr-user@lucene.apache.org >> Subject: Re: Soft commit and new replica types >> >> Some insights in the new replica types below: >> >> On Sat, December 8, 2018 08:42, Vadim Ivanov < >&g

Re: Soft commit and new replica types

2018-12-09 Thread Erick Erickson
--- > > From: Edward Ribeiro [mailto:edward.ribe...@gmail.com] > > Sent: Sunday, December 09, 2018 12:42 AM > > To: solr-user@lucene.apache.org > > Subject: Re: Soft commit and new replica types > > > > Some insights in the new replica types below: > > > > On

RE: Soft commit and new replica types

2018-12-09 Thread Vadim Ivanov
018 12:42 AM > To: solr-user@lucene.apache.org > Subject: Re: Soft commit and new replica types > > Some insights in the new replica types below: > > On Sat, December 8, 2018 08:42, Vadim Ivanov < > vadim.iva...@spb.ntk-intourist.ru wrote: > > > > > Fr

Re: Soft commit and new replica types

2018-12-08 Thread Edward Ribeiro
Some insights in the new replica types below: On Sat, December 8, 2018 08:42, Vadim Ivanov < vadim.iva...@spb.ntk-intourist.ru wrote: > > From Ref guide we have: > " NRT is the only type of replica that supports soft-commits..." > "If TLOG replica does become a l

Soft commit and new replica types

2018-12-08 Thread Vadim Ivanov
hat new Searcher always starts on all replicas when hard commit happens on leader? Some words in Ref Guide about new replica types in section #commit-and-softcommit seems to be usefull. -- Vadim

Re: New replica types

2018-01-02 Thread Shalin Shekhar Mangar
Comments inline: On Wed, Jan 3, 2018 at 11:39 AM, S G wrote: > AFAIK, tlog file is truncated with a hard-commit. > So if the TLOG replica is only pulling the tlog-file, it would become out > of date if it does not pull the full index too. > That means that the TLOG

Re: New replica types

2018-01-02 Thread S G
AFAIK, tlog file is truncated with a hard-commit. So if the TLOG replica is only pulling the tlog-file, it would become out of date if it does not pull the full index too. That means that the TLOG replica would do a full copy every time there is a commit on the leader. PULL replica, by definition

Re: New replica types

2018-01-02 Thread Shawn Heisey
On 1/2/2018 8:02 PM, S G wrote: If the above is incorrect, can someone please point that out? Assuming I have a correct understanding of how the different replica types work, I have some small clarifications. If my understanding is incorrect, I hope somebody will point out my errors. TLOG

New replica types

2018-01-02 Thread S G
Hi, I was excited to see some good work in having more replica types for Solr. However, Solr documentation left me with a few questions. https://lucene.apache.org/solr/guide/7_2/shards-and-indexing-data-in-solrcloud.html#types-of-replicas This is what I could come up with: (Note that each