Re: update Lucene

2009-05-30 Thread Otis Gospodnetic
Clearly I meant "...along with *Lucene* jars" :) Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Otis Gospodnetic > To: solr-dev@lucene.apache.org > Sent: Wednesday, May 27, 2009 11:59:18 PM > Subject: Re: update Lucene > > > I wonder i

Re: Streaming Docs, Terms, TermVectors

2009-05-30 Thread Yonik Seeley
On a single server, Solr already does streaming of returned documents... the stored fields of selected docs are retrieved one at a time as they are written to the socket. The servlet container already handles sending out chunked encoding for large responses too. -Yonik http://www.lucidimagination

Re: Streaming Docs, Terms, TermVectors

2009-05-30 Thread Walter Underwood
Don't stream, request chunks of 10 or 100 at a time. It works fine and you don't have to write or test any new code. In addition, it works well with HTTP caches, so if two clients want to get the same data, the second can get it from the cache. We do that at Netflix. Each front-end box does a seri

Re: Streaming Docs, Terms, TermVectors

2009-05-30 Thread Kaktu Chakarabati
For a streaming-like solution, it is possible infact to have a working buffer in-memory that emits chunks on an http connection which is kept alive by the server until the full response has been sent. This is quite similar for example to how video streaming protocols which can operate on top of HTT

[jira] Commented: (SOLR-236) Field collapsing

2009-05-30 Thread Martijn van Groningen (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714750#action_12714750 ] Martijn van Groningen commented on SOLR-236: I'm looking forward in your experien

Re: Streaming Docs, Terms, TermVectors

2009-05-30 Thread Dietrich Featherston
I was actually curious about the same thing. Perhaps an endpoint reference could be passed in the request where the documents can be sent asynchronously, such as a jms topic. solr/query?q=*:*&epr=/my/topic&eprtype=jms Then we would need to consider how to break up the response, how to can

Streaming Docs, Terms, TermVectors

2009-05-30 Thread Grant Ingersoll
Anyone have any thoughts on what is involved with streaming lots of results out of Solr? For instance, if I wanted to get something like 1M docs out of Solr (or more) via *:* query, how can I tractably do this? Likewise, if I wanted to return all the terms in the index or all the Term Vect

[jira] Commented: (SOLR-236) Field collapsing

2009-05-30 Thread Oleg Gnatovskiy (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714742#action_12714742 ] Oleg Gnatovskiy commented on SOLR-236: -- Hey guys, are there any plans to make field coll

[jira] Commented: (SOLR-236) Field collapsing

2009-05-30 Thread Thomas Traeger (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714738#action_12714738 ] Thomas Traeger commented on SOLR-236: - The problem is solved, thanks. I will use your pat

Re: [jira] Updated: (SOLR-1155) Change DirectUpdateHandler2 to allow concurrent adds during an autocommit

2009-05-30 Thread Ryan McKinley
Seems ok now... On Fri, May 29, 2009 at 7:47 PM, Mike Klaas wrote: > I'd like to take a look at this but JIRA seems to be down. Is anyone else > experiencing this? > > -Mike > > > On Wed, May 13, 2009 at 7:41 AM, Jayson Minard (JIRA) wrote: > >> >>     [ >> https://issues.apache.org/jira/browse/

[jira] Updated: (SOLR-236) Field collapsing

2009-05-30 Thread Martijn van Groningen (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn van Groningen updated SOLR-236: --- Attachment: field-collapse-solr-236-2.patch Thanks for the feedback, I fixed the proble

[jira] Commented: (SOLR-236) Field collapsing

2009-05-30 Thread Thomas Traeger (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714676#action_12714676 ] Thomas Traeger commented on SOLR-236: - I made some tests with your patch and trunk (rev.