Kinda-sorta realtime?

2010-04-16 Thread Don Werve
We're using Solr as the backbone for our shiny new helpdesk application, and by and large it's been a big win... especially in terms of search performance. But before I pat myself on the back because the Solr devs have done a great job, I had a question regarding commit frequency. While our app

Re: Kinda-sorta realtime?

2010-04-16 Thread Peter Sturge
Hi Don, We've got a similar requirement in our environment - here's what we've found.. Every time you commit, you're doing a relatively disk I/O intensive task to insert the document(s) into the index. For very small indexes (say, 10,000 docs), the commit time is pretty short and you can get

Re: problem querying date field

2010-04-16 Thread Erik Hatcher
You need to use brackets around range queries. See http://wiki.apache.org/solr/SolrQuerySyntax Erik On Apr 16, 2010, at 7:08 AM, Jan-Olav Eide wrote: I have the follwing field in my schema : field name=indextime type=date indexed=true stored=true default=NOW multiValued=false/

Getting the length of a field?

2010-04-16 Thread Oliver Beattie
Hi there, I'm looking around to see if there's a function that will return the length of a string in a field, but not seeing one. This is a field whose data I store, but don't use for querying generally, but I want to be able to take its length into account. Is this possible? Any help much

Re: StreamingUpdateSolrServer hangs

2010-04-16 Thread Sascha Szott
Hi Yonik, Yonik Seeley wrote: Stephen, were you running stock Solr 1.4, or did you apply any of the SolrJ patches? I'm trying to figure out if anyone still has any problems, or if this was fixed with SOLR-1711: I'm using the latest trunk version (rev. 934846) and constantly running into the

Re: StreamingUpdateSolrServer hangs

2010-04-16 Thread Yonik Seeley
Thanks for the report Sascha. So after the hang, it never recovers? Some amount of hanging could be visible if there was a commit on the Solr server or something else to cause the solr requests to block for a while... but it should return to normal on it's own... Looking at the stack trace, it

Re: SOLR Exact match problem - Punctuations, double quotes etc.

2010-04-16 Thread Erick Erickson
Well, I think that's part of your problem. WhitespaceAnalyzer does exactly what it says, splits on whitespace. So indexing carbon and searching carbon. won't generate a hit. If KeywordAnalyzer doesn't work for you, you could consider either using one of the Pattern* guys or write your own.

RE: XSD for Solrv1.4

2010-04-16 Thread Stefan Maric
Thanks I'm taking a look at SolrJ Longer term i'd still like to have access to an XSD - then i can see us integrating this better in the Oracle Service Bus and writing less Java code in our webApp -Original Message- From: hkmortensen [mailto:ko...@yahoo.com] Sent: 15 April 2010 21:26

Solr Index Lock Issue

2010-04-16 Thread Sethi, Parampreet
Hi All, We are facing the issue with the Solr server in the DMOZ data migration. The Solr has 0 records when the migration starts and the data is added into Solr in the batches of 2 records. The commit is called on Solr after 20k records are processed. While commiting the data into Solr,

Re: StreamingUpdateSolrServer hangs

2010-04-16 Thread Sascha Szott
Hi Yonik, thanks for your fast reply. Yonik Seeley wrote: Thanks for the report Sascha. So after the hang, it never recovers? Some amount of hanging could be visible if there was a commit on the Solr server or something else to cause the solr requests to block for a while... but it should

Re: Handling missing date fields in a date-oriented function query

2010-04-16 Thread Chris Harris
I still like this approach, but I've discovered one wrinkle, which is that I have dates in my dataset dated at the epoch (i.e. midnight Jan 1, 1970), as well as before the epoch (e.g. midnight Jan 1, 1950). The docs dated *before* the epoch so far don't seem to be a problem; they end up having a

Re: Handling missing date fields in a date-oriented function query

2010-04-16 Thread Yonik Seeley
On Fri, Apr 16, 2010 at 4:42 PM, Chris Harris rygu...@gmail.com wrote: The docs dated exactly *at* the epoch, though, are trouble, because I can't tell those docs apart from the undated docs in my function query. Neither can Solr currently... it's a Lucene FieldCache limitation. The other

Re: Solr Index Lock Issue

2010-04-16 Thread Otis Gospodnetic
Hi, What you are doing sounds fine. You don't need to commit while indexing, though, just commit/optimize at the end. I'm not saying this will solve your problem, but give it a try. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Hadoop ecosystem search ::

Sum of return fields

2010-04-16 Thread Jim Adams
Is it possible to add or subtract a value and return that field from the index in solr? Or do you have to do it programmatically afterwards? Thanks!

Re: Getting the length of a field?

2010-04-16 Thread Otis Gospodnetic
Hm, I don't follow what you are looking to do, Oliver. You want to take the field length into account. when indexing? Or when searching? You want it to affect relevance? You can certainly get the length of the String (original value) in a field *after* you get your result set, but

Re: Sum of return fields

2010-04-16 Thread Otis Gospodnetic
Jim, like this: https://issues.apache.org/jira/browse/SOLR-1298 ? Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message From: Jim Adams jasolru...@gmail.com To: solr-user@lucene.apache.org Sent:

Re: run in background

2010-04-16 Thread Otis Gospodnetic
Better ye, use screent: http://www.manpagez.com/man/1/screen/ Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message From: Walter Underwood wun...@wunderwood.org To: solr-user@lucene.apache.org

Re: DIH dataimport.properties with

2010-04-16 Thread Otis Gospodnetic
Hm, why not just go to the MySQL master then? Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Hadoop ecosystem search :: http://search-hadoop.com/ - Original Message From: Michael Tibben michael.tib...@stomp.com.au To: solr-user@lucene.apache.org Sent: Thu,

Re: Sum of return fields

2010-04-16 Thread Jim Adams
Yes, that's exactly it. Looks like it is going in to 1.5...hmmm...guess I'll have to do something programmatically instead as I'm not there yet. On Fri, Apr 16, 2010 at 4:24 PM, Otis Gospodnetic otis_gospodne...@yahoo.com wrote: Jim, like this:

Re: StreamingUpdateSolrServer hangs

2010-04-16 Thread Rich Cariens
I experienced the hang described with the Solr 1.4.0 build. Yonik - I also thought the streaming updater was blocking on commits but updates never resumed. To be honest I was in a bit of a rush to meet a deadline so after spending a day or so tinkering I bailed out and just wrote a component by

admin-extra file in multicore

2010-04-16 Thread Jon Baer
Hi, It looks like Im trying to do the same thing in this open JIRA here ... https://issues.apache.org/jira/browse/SOLR-975 I noticed in index.jsp it has a reference to: % // a quick hack to get rid of get-file.jsp -- note this still spits out invalid HTML out.write(

Re: bug using distributed search, highlighting and q.alt

2010-04-16 Thread Otis Gospodnetic
Marc - Mind creating a ticket in JIRA and attaching our patch? Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Hadoop ecosystem search :: http://search-hadoop.com/ - Original Message From: Marc Sturlese marc.sturl...@gmail.com To: solr-user@lucene.apache.org

Re: Supporting multiple index / query analyzer stacks

2010-04-16 Thread Otis Gospodnetic
Gert, You could: * run 1 Solr instance with N cores. Each core would have a different flavour/stack of otherwise the same schema * run 1 Solr instance with 1 core and in it N copies of each fiel, each copy with its flavour/stack * run N Solr instances, each with a different flavour/stack of

Re: DIH

2010-04-16 Thread Lance Norskog
Oops, haven't checked that. The Wiki page generally marks new stuff with a Solr 1.5 marker. On Wed, Apr 14, 2010 at 9:30 PM, Sandhya Agarwal sagar...@opentext.com wrote: Thanks a lot, Lance. So, are these part of solr 1.4 release ? -Original Message- From: Lance Norskog

Re: SOLR Exact match problem - Punctuations, double quotes etc.

2010-04-16 Thread Hid-Mubarmij
Thanks a lot Erick, I just used this solr.PatternReplaceFilterFactory in my field and the problem is solved. Thanks -- View this message in context: http://n3.nabble.com/SOLR-Exact-match-problem-Punctuations-double-quotes-etc-tp720807p725630.html Sent from the Solr - User mailing list