RE: UpdateProcessor as a batch

2016-11-04 Thread Markus Jelsma
Thanks all for sharing your thoughts! -Original message- > From:Joel Bernstein <joels...@gmail.com> > Sent: Friday 4th November 2016 1:28 > To: solr-user@lucene.apache.org > Subject: Re: UpdateProcessor as a batch > > This might be useful. In this scena

Re: UpdateProcessor as a batch

2016-11-03 Thread Joel Bernstein
ch document being > >> indexed. Right now, i make an external connection for each doc being > >> indexed in the current UpdateProcessor. This is still fast. But the > remote > >> backend supports batched lookups, which are faster. > >> > > >> > This is why

Re: UpdateProcessor as a batch

2016-11-03 Thread Alexandre Rafalovitch
l fast. But the remote >> backend supports batched lookups, which are faster. >> > >> > This is why i'd love to be able to buffer documents in an >> UpdateProcessor, and if there are enough, i do a remote lookup for all of >> them, do some processing and let them be index

Re: UpdateProcessor as a batch

2016-11-03 Thread mike st. john
er documents in an > UpdateProcessor, and if there are enough, i do a remote lookup for all of > them, do some processing and let them be indexed. > > > > Thanks, > > Markus > > > > > > > > -Original message- > >> From:Erick Erickson

Re: UpdateProcessor as a batch

2016-11-03 Thread Erick Erickson
m be indexed. > > Thanks, > Markus > > > > -Original message- >> From:Erick Erickson <erickerick...@gmail.com> >> Sent: Thursday 3rd November 2016 19:18 >> To: solr-user <solr-user@lucene.apache.org> >> Subject: Re: UpdateProcessor as a

RE: UpdateProcessor as a batch

2016-11-03 Thread Markus Jelsma
kerick...@gmail.com> > Sent: Thursday 3rd November 2016 19:18 > To: solr-user <solr-user@lucene.apache.org> > Subject: Re: UpdateProcessor as a batch > > I _thought_ you'd been around long enough to know about the options I > mentioned ;). > > Right. I'd guess you're in

Re: UpdateProcessor as a batch

2016-11-03 Thread Erick Erickson
kson <erickerick...@gmail.com> >> Sent: Thursday 3rd November 2016 18:57 >> To: solr-user <solr-user@lucene.apache.org> >> Subject: Re: UpdateProcessor as a batch >> >> Markus: >> >> How are you indexing? SolrJ has a client.add(List) >> form,

RE: UpdateProcessor as a batch

2016-11-03 Thread Markus Jelsma
kerick...@gmail.com> > Sent: Thursday 3rd November 2016 18:57 > To: solr-user <solr-user@lucene.apache.org> > Subject: Re: UpdateProcessor as a batch > > Markus: > > How are you indexing? SolrJ has a client.add(List) > form, and post.jar lets you add as many documents as you w

Re: UpdateProcessor as a batch

2016-11-03 Thread Erick Erickson
Markus: How are you indexing? SolrJ has a client.add(List) form, and post.jar lets you add as many documents as you want in a batch Best, Erick On Thu, Nov 3, 2016 at 10:18 AM, Markus Jelsma wrote: > Hi - i need to process a batch of documents on update but i