Re: apply a patch on solr

2009-11-04 Thread David Stuart
You should be ok with the the revision option below. Look for the highest revision number in the list of files in the patch as subversion increments revision number on a repo basis not a file basis so the highest number will represent the current state of all the files when the patch was

Re: apply a patch on solr

2009-11-04 Thread Chris Hostetter
: Thanks, but my question here was not about the patch command itself (which I : already know), but about simpler way (if any) to go about guaranteeing a : proper patch with the right file revisions needed by the patch. as i mentioned before, there is no garuntee that you are patching the exact

Re: lucid kstem group and artifact id to put in POM

2009-11-04 Thread Andrey Klochkov
Hi Just install it manually with mvn install On Wed, Nov 4, 2009 at 1:13 AM, darniz rnizamud...@edmunds.com wrote: Hello Right now we are using lucid Kstemmer and it works fine and the two jars required lucid-kstem.jar and lucid-solr-kstem.jar are present in our web app. i am trying to

Re: tf*idf scoring

2009-11-04 Thread Markus Jelsma - Buyways B.V.
Thank you for your explanation On Tue, 2009-11-03 at 07:32 -0800, Grant Ingersoll wrote: On Nov 3, 2009, at 5:54 AM, Markus Jelsma - Buyways B.V. wrote: I see, but why not return the true values of Lucene? I'm not sure what you mean by this. The TVC returns the term frequency and

Connection refused using EmbeddedSolrServer in a web site

2009-11-04 Thread Christian López Espínola
Hi all, Is possible starting a EmbeddedSolrServer in a web site or is only available for desktop apps? I'm facing Connection refused: connect exceptions when trying to create a EmbeddedSolrServer using a local url (C:\mydir, using Windows). Thanks in advance. -- Cheers, Christian López

Re: Highlighting is very slow

2009-11-04 Thread Andrew Clegg
We're on 1.6 already. Any chance you could share your GC settings? Thanks, Andrew. PS apologies for the duplicate message yesterday, Nabble threw an exception when I posted the first one. And the second one actually. Jaco-4 wrote: Hi, We had a similar case once (although not with

Re: Connection refused using EmbeddedSolrServer in a web site

2009-11-04 Thread Erik Hatcher
EmbeddedSolrServer is only accessible through API calls, not through a URL. It is strongly recommended to run Solr through the WAR file, for several reasons including replication and distributed search features that only work over HTTP. Erik On Nov 4, 2009, at 1:44 AM, Christian

Re: character encoding issue

2009-11-04 Thread Jonathan Hendler
Hi Peter, I have the same set of issues and will look for a response here. Sometimes those other chars can be create at the time of input (like extraction from a Microsoft Office doc from third part tool for example). But MySQL looking OK in the browser might be because the encoding of

Bug with DIH and MySQL CONCAT()?

2009-11-04 Thread Jonathan Hendler
Hi All, I have an SQL query that begins with SELECT CONCAT ( 'ID', Subject.id , ':' , Subject.name , ':L', Subject.level) as subject_name and the query runs great against MySQL from the command line. Since this is a nested entity, the schema.xml contains field name=subject_name

solr query help alpha numeric and not

2009-11-04 Thread Joel Nylund
Hi, I have a field called firstLetterTitle, this field has 1 char, it can be anything, I need help with a few queries on this char: 1.) I want all NON ALPHA and NON numbers, so any char that is not A-Z or 0-9 I tried:

Re: solr query help alpha numeric and not

2009-11-04 Thread Jonathan Hendler
Hi Joel, The ID is sent back as a string (instead of as an integer) in your example. Could this be the cause? - Jonathan On Nov 4, 2009, at 9:08 AM, Joel Nylund wrote: Hi, I have a field called firstLetterTitle, this field has 1 char, it can be anything, I need help with a few queries on

Re: Bug with DIH and MySQL CONCAT()?

2009-11-04 Thread Chantal Ackermann
Hi Jonathan, the concatenation seems to return a byte array because those are rendered into a string starting with [B when calling toString() on them. I have no suggestion on how to get a different return value from that sql query. To concatenate you could also use a transformer. Simply

Re: Lock problems: Lock obtain timed out

2009-11-04 Thread Jérôme Etévé
Hi, It seems this situation is caused by some No space left on device exeptions: SEVERE: java.io.IOException: No space left on device at java.io.RandomAccessFile.writeBytes(Native Method) at java.io.RandomAccessFile.write(RandomAccessFile.java:466) at

Re: Bug with DIH and MySQL CONCAT()?

2009-11-04 Thread Avlesh Singh
Try cast(concat(...) as char) ... Cheers Avlesh On Wed, Nov 4, 2009 at 7:36 PM, Jonathan Hendler jonathan.hend...@gmail.com wrote: Hi All, I have an SQL query that begins with SELECT CONCAT ( 'ID', Subject.id , ':' , Subject.name , ':L', Subject.level) as subject_name and the query runs

how to use ajax-solr - example?

2009-11-04 Thread Joel Nylund
Hi, I looked at the documentation and I have no idea how to get started? Can someone point me to or show me an example of how to send a query to a solr server and paginate through the results using ajax- solr. I would glady write a blog tutorial on how to do this if someone can get me

SemaText versus BasisTech

2009-11-04 Thread silke
Hi, We are looking for multi lingual search support - German, English, French in a single Solr instance. I have been told that we need to use third party products like Sematext and BasisTech. Which one would you recommend we use between the two of them? Also, what are the pros an cons of using

RE: dismax + wildcard

2009-11-04 Thread Ankit Bhatnagar
Hi Jan, You could write a dismax request handler and then then in the query you could specify like - q=somethingqt=dismaxhandlerfq=type:something This might help. Thanks -Ankit -Original Message- From: Jan Kammer [mailto:jan.kam...@mni.fh-giessen.de] Sent: Wednesday, November

Re: SemaText versus BasisTech

2009-11-04 Thread Hannes Carl Meyer
Hi Silke, what do you mean with multi lingual search support? Remember, with the MultiCore (http://wiki.apache.org/solr/CoreAdmin) you can have multiple indexes and configurations for preprocessing in one Solr instance. I used it a lot for such cases with multiple language support. Bests

Re: Bug with DIH and MySQL CONCAT()?

2009-11-04 Thread Noble Paul നോബിള്‍ नोब्ळ्
Thanks, It would be nice to add this to the DIH FAQ On Wed, Nov 4, 2009 at 8:27 PM, Jonathan Hendler jonathan.hend...@gmail.com wrote: Thanks Chantal for the explanation of the issue. Avlesh - worked great. Thank you! On Nov 4, 2009, at 9:44 AM, Avlesh Singh wrote: Try cast(concat(...) as

exact match lookup

2009-11-04 Thread Joel Nylund
Hi, I have a field that I want to do exact match lookups using. (when I say exact match, im looking for equivalent to a sql query where with no like clause so where feedClass = Social News) For example the field is called feedClass and im doing:

Re: exact match lookup

2009-11-04 Thread Jérôme Etévé
Hi, you need to quote your phrase when you search for 'Social News': feedClass:Social News (URI encoded of course). otherwise your request will become (I assume you're using a standard query parser) feedClass:Social defaultField:News . Well that's the idea. It should then work using the type

Re: Plugin Performance Issues

2009-11-04 Thread entdeveloper
Interesting...I guess I had logically assumed that having type=index meant it wasn't used for query time, but I see why that's not possible. Here's the thing though: We had one field defined using this fieldtype and we deployed the new schema to solr when we started seeing the issue. However,

Re: latest lucene libraries in maven repo

2009-11-04 Thread Chris Hostetter
: It seems the the latest lucene libraries are not up to date in the Solr maven : repo : (http://people.apache.org/repo/m2-snapshot-repository/org/apache/solr/solr-lucene-core/1.4-SNAPSHOT/) : : Can we expect them to be updated soon? Solr trunk stoped using it's own snapshots of lucene and

Re: Plugin Performance Issues

2009-11-04 Thread Chris Hostetter
: the thing though: We had one field defined using this fieldtype and we : deployed the new schema to solr when we started seeing the issue. However, : we had not yet released our code that was using the new field (obviously we : have to make the change on the solr end before the code, so we :

Re: character encoding issue

2009-11-04 Thread Jérôme Etévé
Hi, How do you post your data to solr? If it's by posting XML, then it should be properly encoded in UTF-8 (which is the XML default). Regardless of what's in the DB (which can be a mystery with MySQL). At query time, if the XML writer is used, then it's encoded in UTF-8. If the json one is

Re: exact match lookup

2009-11-04 Thread Joel Nylund
thank worked for me, changed to: http://localhost:8983/solr/select?q=feedClass:%22social%20news%22 and the matches are correct, I changed the feedClass field back to type text. A followup question has to do with sorting these results. I have a field called title that I want the results

Re: field queries seem slow

2009-11-04 Thread mike anderson
Erik, we are doing a sort by date first, and then by score. I'm not sure what you mean by readers. Since we have nearly 6M authors attached to our 20M documents I'm not sure that autowarming would help that much (especially since we have very little overlap in what users are searching for). But

Re: exact match lookup

2009-11-04 Thread Jérôme Etévé
If feedClass acts as an identifier, better use string :) use sort=title asc,score desc (not sort:) J. 2009/11/4 Joel Nylund jnyl...@yahoo.com: thank worked for me, changed to: http://localhost:8983/solr/select?q=feedClass:%22social%20news%22 and the matches are correct, I changed the

Re: exact match lookup

2009-11-04 Thread Erick Erickson
How did you index your title field? It sholdn't be tokenized, see: http://wiki.apache.org/solr/FAQ#Why_Isn.27t_Sorting_Working_on_my_Text_Fields.3F http://wiki.apache.org/solr/FAQ#Why_Isn.27t_Sorting_Working_on_my_Text_Fields.3F Best Erick On Wed, Nov 4, 2009 at 1:47 PM, Joel Nylund

Re: exact match lookup

2009-11-04 Thread Joel Nylund
that worked, thanks! had to negate the score. thanks Joel On Nov 4, 2009, at 1:57 PM, Jérôme Etévé wrote: If feedClass acts as an identifier, better use string :) use sort=title asc,score desc (not sort:) J. 2009/11/4 Joel Nylund jnyl...@yahoo.com: thank worked for me, changed to:

Re: how to use ajax-solr - example?

2009-11-04 Thread Israel Ekpo
On Wed, Nov 4, 2009 at 10:48 AM, Joel Nylund jnyl...@yahoo.com wrote: Hi, I looked at the documentation and I have no idea how to get started? Can someone point me to or show me an example of how to send a query to a solr server and paginate through the results using ajax-solr. I would glady

Re: field queries seem slow

2009-11-04 Thread Erick Erickson
By readers, I meant your searchers. Perhaps you were shutting down your servers? The warming isn't to pre-load authors, it's to pre-populate, particularly, sort fields. Which are then kept in caches. There is considerable overhead in loading the sort field the first time you sort by it. So, my

Re: exact match lookup

2009-11-04 Thread Paul Libbrecht
if you want to have exactly the same effect as the SQL equality, you need more. The phrase query matches anything with words Social followed by news. It would also match feedClass:... finished. Social News In Our Bulletin. As noted elsewhere on the thread you need to query this on a field

Re: Issues with SolrJ and IndexReader reopening

2009-11-04 Thread Simon Wistow
On Fri, Oct 30, 2009 at 11:20:19AM +0530, Shalin Shekhar Mangar said: That is very strange. IndexReaders do get re-opened after commits. Do you see a commit message in the Solr logs? Sorry for the delay - I've been trying to puzzle over this some more. The code looks like

Re: how to use ajax-solr - example?

2009-11-04 Thread Joel Nylund
Hi Israel, I agree the idea of adding a scripting language in between is good, but I want something simple I can easily test my queries with data and scroll through the results. I have been using the browser and getting xml for now, but would like to save my queries in a simple html page

Re: Highlighting is very slow

2009-11-04 Thread Chris Hostetter
: Has anyone else seen this sort of behaviour before? This is with a nightly : from 2009-10-26. have you tried hl.usePhraseHighlighter=false ? ... http://old.nabble.com/Highlighting-performance-between-1.3-and-1.4rc-to26190790.html ...it doesn't seem like it should be affecting you for a

Re: Highlighting is very slow

2009-11-04 Thread Mark Miller
It should be the same speed wither way for a term query. The highlighted is going to be slow on general for a 1mb + doc. It processes a token at a time. The fast vector highlighter is much faster in those cases and should be in the next release. It handles fewer query types though. -

Wiki on monitoring Solr with Nagios?

2009-11-04 Thread Jason Rutherglen
I couldn't find anything, however I'm thinking of starting one.

Index documents with Solr

2009-11-04 Thread javaxmlsoapdev
Wanted to find out how people are using Solr’s ExtractingRequestHandler to index different types of documents from a configuration file in an import fashion. I want to use this handler in a similar way how DataImportHandler works where you can issue “import” command from the URL to create an

leading and trailing wildcard query

2009-11-04 Thread A. Steven Anderson
I've scoured the archives and JIRA , but the answer to my question is just not clear to me. With all the new Solr 1.4 features, is there any way to do a leading and trailing wildcard query on an *untokenized* field? e.g. q=myfield:*abc* would return a doc with myfield=xxxabcxxx Yes, I know how

Re: dismax + wildcard

2009-11-04 Thread Koji Sekiguchi
Jan Kammer wrote: Hi there, what is the best way to search all fields AND use wildcards? Somewhere I read that there are problems with this combination... (dismax + wildcard) It's a feature of dismax. WildcardQuery cannot be used in dismax q parameter. You can copy the all fields to a

Re: StreamingUpdateSolrServer - indexing process stops in a couple of hours

2009-11-04 Thread Yonik Seeley
Can you open a JIRA issue if you haven't already? How did you reproduce it (what's the simplest method?) -Yonik http://www.lucidimagination.com On Mon, Nov 2, 2009 at 6:05 AM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: I'm able to reproduce this issue consistently using JDK 1.6.0_16

Re: Lock problems: Lock obtain timed out

2009-11-04 Thread Lance Norskog
This will not ever work reliably. You should have 2x total disk space for the index. Optimize, for one, requires this. On Wed, Nov 4, 2009 at 6:37 AM, Jérôme Etévé jerome.et...@gmail.com wrote: Hi, It seems this situation is caused by some No space left on device exeptions: SEVERE:

Re: how to use ajax-solr - example?

2009-11-04 Thread Lance Norskog
http://issues.apache.org/jira/browse/SOLR-1163 This is a really nice index browser. On Wed, Nov 4, 2009 at 12:51 PM, Joel Nylund jnyl...@yahoo.com wrote: Hi Israel, I agree the idea of adding a scripting language in between is good, but I want something simple I can easily test my queries

Re: DIH timezone offset

2009-11-04 Thread Noble Paul നോബിള്‍ नोब्ळ्
DIH relies on the driver to get the date. It does not do any automatic conversion. Is it possible for the driver to give the date with the right offset? On Thu, Nov 5, 2009 at 3:21 AM, Mike mpiluson...@comcast.net wrote: Hi I'm importing database records into SOLR using the DIH. My dates are not