Re: Huge load and long response times during search

Hi, Otis Gospodnetic pisze: Tom, It looks like the machine might simply be running too many things. If the load is around 1 when Solr is not running, and this is a dual-core server, it shows its already relatively busy (cca 50% idle). The server is running the Postgresql and Apache/PHP as

Re: Index time boosts, payloads, and long query strings

Thanks Erick! After reading your answer, and re-reading the Solr wiki, I realized my folly. I used to think that index-time boosts when applied on a per-field basis are equivalent to query time boosts to that field. To ensure that my new understanding is correct , I'll state it in my words.

Re: Huge load and long response times during search

Tom, AFAIK Lucene performance is very much dependent on file system cache size, in case of large index. So if you see lots of IO, this probably means that your system doesn't have enough memory to hold large file system cache, suitable for your index size. In this case you don't need to give more

Output all, from one field

Hallo, I search for a way, to output all content from one field.. Like name: NAME:* And Solr gifs me all Names or color:* and i become all colors can io do this? or is this Impossible? Jörg

Re: Function queries question

Thanks for getting back to me. I've added inline responses below. 2009/11/20 Grant Ingersoll gsing...@apache.org On Nov 20, 2009, at 3:15 AM, Oliver Beattie wrote: Hi all, I'm a relative newcomer to Solr, and I'm trying to use it in a project of mine. I need to do a function query (I

Boost document base on field length

Hi, I would like to boost documents with longer descriptions to move down documents with 0 length description, I'm wondering if there is possibility to boost document basing on the field length while searching or the only way is to store field length as an int in a separate field while

Re: Index time boosts, payloads, and long query strings

Yep G On Mon, Nov 23, 2009 at 4:13 AM, Girish Redekar girish.rede...@aplopio.comwrote: Thanks Erick! After reading your answer, and re-reading the Solr wiki, I realized my folly. I used to think that index-time boosts when applied on a per-field basis are equivalent to query time boosts

ExtractingRequestHandler commitWithin

Any chance of getting the ExtractingRequestHandler to use the commitWithin parameter? -- View this message in context: http://old.nabble.com/ExtractingRequestHandler-commitWithin-tp26478144p26478144.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Boost document base on field length

On Nov 23, 2009, at 8:01 AM, Tomasz Kępski wrote: Hi, I would like to boost documents with longer descriptions to move down documents with 0 length description, I'm wondering if there is possibility to boost document basing on the field length while searching or the only way is to store

Re: Function queries question

On Nov 23, 2009, at 6:54 AM, Oliver Beattie wrote: Thanks for getting back to me. I've added inline responses below. 2009/11/20 Grant Ingersoll gsing...@apache.org On Nov 20, 2009, at 3:15 AM, Oliver Beattie wrote: Hi all, I'm a relative newcomer to Solr, and I'm trying to use it in

[N to M] range search out of sum of field. howto search this?

Hi folks, I got documents like user:1 num:5 user:1 num: 8 user:5 num:7 user:5 num:1 I'd like to get per user that maches sum of num range 5 to 10 In this case it should return user 5 as 7+1=8 and is within range. User 1 will be false cause sum of num is 5+8=13 hence outside range

Re: [N to M] range search out of sum of field. howto search this?

See frange: http://www.lucidimagination.com/blog/2009/07/06/ranges-over-functions-in-solr-14/ fq={!frange l=5 u=10}sum(user,num) -Yonik http://www.lucidimagination.com On Mon, Nov 23, 2009 at 8:49 AM, Julian Davchev j...@drun.net wrote: Hi folks, I got documents like user:1   num:5 user:1

Re: access denied to solr home lib dir

Check. I even verified that the tomcat user could create the directory (i.e. sudo -u tomcat6 mkdir /opt/solr/steve/lib). Still solr complains. On Sun, Nov 22, 2009 at 10:03 PM, Yonik Seeley ysee...@gmail.com wrote: Maybe ensuring that the full parent path (all parent directories) have rx

Re: query function query; what's it for?

Thanks Yonik. That blog post was very interesting but it only has about a sentence or two on the query() function, and it points the user to the same link I have here at the wiki for examples. But those examples (which is really 1 example) doesn't explain the point. -- e.g. when/why would I

Re: query function query; what's it for?

On Mon, Nov 23, 2009 at 9:36 AM, Smiley, David W. dsmi...@mitre.org wrote: Thanks Yonik. That blog post was very interesting but it only has about a sentence or two on the query() function Ah, I had thought that you meant the query QParser. The query function just allows you to use any other

Re: Control DIH from PHP

Thankyou 2009/11/21 Lance Norskog goks...@gmail.com Nice! I didn't notice that before. Very useful. 2009/11/19 Noble Paul നോബിള്‍ नोब्ळ् noble.p...@corp.aol.com: you can pass the uniqueId as a param and use it in a sql query

Very busy search screen

I have a client who wants to search on almost every attribute of an object (nearly 15 attributes) on the search screen. Search sreen looks very crazy/busy. I was wondering if there are better ways to address these requirements and build intelligent categorized/configurable searchs? including

Re: solr artifacts / apache maven repository

On Mon, Nov 23, 2009 at 10:31 PM, TCK moonwatcher32...@gmail.com wrote: Hi, I'd like to pull in the solr war from a public repository. I'm able to find the individual jars at http://repo2.maven.org/maven2/org/apache/solr/ but it seems like the war artifact isn't published. Is there a reason

Re: solr artifacts / apache maven repository

I currently put the war into my own Nexus repository. I use it to build a war-overlay with the solr war to include my plugins customizations (due to classloading issues with Spring and the external plugin solution). On Mon, Nov 23, 2009 at 12:08 PM, Shalin Shekhar Mangar shalinman...@gmail.com

Re: Very busy search screen

On Mon, Nov 23, 2009 at 10:36 PM, javaxmlsoapdev vika...@yahoo.com wrote: I have a client who wants to search on almost every attribute of an object (nearly 15 attributes) on the search screen. Search sreen looks very crazy/busy. I was wondering if there are better ways to address these

error with multicore CREATE action

Hey there, I am using Solr 1.4 out of the box and am trying to create a core at runtime using the CREATE action. I am getting this error when executing: http://localhost:8983/solr/admin/cores?action=CREATEname=xinstanceDir=xpersist=trueconfig=solrconfig.xmlschema=schema.xmldataDir=data

Re: solr artifacts / apache maven repository

On Mon, Nov 23, 2009 at 10:41 PM, Stephen Duncan Jr stephen.dun...@gmail.com wrote: I currently put the war into my own Nexus repository. I use it to build a war-overlay with the solr war to include my plugins customizations (due to classloading issues with Spring and the external plugin

Re: error with multicore CREATE action

On Mon, Nov 23, 2009 at 10:47 PM, Marc Sturlese marc.sturl...@gmail.comwrote: Hey there, I am using Solr 1.4 out of the box and am trying to create a core at runtime using the CREATE action. I am getting this error when executing:

Re: solr artifacts / apache maven repository

Thanks, yes that's what I do as well. I'd like to pull in the standard solr war distribution from a public repository and then explode it and put my own overlays. Shalin, any pointers to where I would look to go about making a patch to the artifact publishing process? Thanks, TCK On Mon, Nov

Re: solr artifacts / apache maven repository

On Mon, Nov 23, 2009 at 11:04 PM, TCK moonwatcher32...@gmail.com wrote: Thanks, yes that's what I do as well. I'd like to pull in the standard solr war distribution from a public repository and then explode it and put my own overlays. Shalin, any pointers to where I would look to go about

Re: Output all, from one field

On Mon, Nov 23, 2009 at 4:29 PM, Jörg Agatz joerg.ag...@googlemail.comwrote: Hallo, I search for a way, to output all content from one field.. Like name: NAME:* And Solr gifs me all Names or color:* and i become all colors can io do this? or is this Impossible? Do you want to

Re: NPE when trying to view a specific document via Luke

: I think thats the case - I'm not seeing the problem - though I didn't : follow your steps exactly, because I also set the data dir. yeah ... i went back and tested again and verified that's what was happening. There is a bug with Luke when viewing binary based fields introduced in Solr 1.4

RE: schema-based Index-time field boosting

: Yeah, like I said, I was mistaken about setting field boost in : schema.xml - doesn't mean it's a bad idea though. At any rate, from : your penultimate sentence I reckon at least one of us is still confused : about field boosting, feel free to reply if you think it's me ;) Yeah ... i think

Re: Fwd: solr index-time boost... help required please

: Now I am trying *index-time *boosting to improve response time. So i created : an algorithm where I do the following:- : 1. sort the records i get from database on approval_dt asc and increase the : boost value of the field element for approval_dt by 0.1 as i encounter : higer approval_dt

Re: Index time boosting troubles

: I had working index time boosting on documents like so: doc boost=10.0 : : Everything was great until I made some changes that I thought where no : related to the doc boost but after that my doc boosting appears to be : missing. : : I'm having a tough time debugging this and didn't have the

Re: Where is upgrading documentation?

: Subject: Re: Where is upgrading documentation? : : CHANGES.txt contains information, but no instructions. Hmmm i see what you mean. we typically have a nice boiler plate set of instructions, and somehow those got removed from the 1.4 changes. in a nutshell, the instructions are the same

Re: how to get the autocomplete feature in solr 1.4?

: how to get the autocomplete/autosuggest feature in the solr1.4.plz give me : the code also... there is no magical one size fits all solution for autocomplete in solr. if you look at the archives there have been lots of discussions about differnet ways ot get auto complete functionality,

Re: Huge load and long response times during search

In addition to some of hte other coments mentioned about IO, this caught my eye... : I'm using SOLR(1.4) to search among about 3,500,000 documents. After the : server kernel was updated to 64bit system has started to suffer. ...if the *only* thing that was upgraded was switching the kernel

Re: how to get the autocomplete feature in solr 1.4?

Chris Hostetter wrote: : how to get the autocomplete/autosuggest feature in the solr1.4.plz give me : the code also... there is no magical one size fits all solution for autocomplete in solr. if you look at the archives there have been lots of discussions about differnet ways ot get auto

Re: Embedded solr with third party libraries

: distirbution. When we run test cases our schema.xml has defintion for lucid : kstem and it throws ClassNotFound Exception. : We declared the depency for the two jars lucid-kstem.jar and : lucid-solr-kstem.jar but still it throws an error. explain what you mean by declared the depency ? :

Re: How to use DataImportHandler with ExtractingRequestHandler?

Anyone any idea? javaxmlsoapdev wrote: did you extend DIH to do this work? can you share code samples. I have similar requirement where I need tp index database records and each record has a column with document path so need to create another index for documents (we allow users to search

Re: Announcing the Apache Solr extension in PHP - 0.9.0

Thanks Israel, exactly what I was looking for, but how would one get a pre-compiled dll for windows? using PHP 5.3 VS9 TS. On Mon, Oct 5, 2009 at 7:03 AM, Israel Ekpo israele...@gmail.com wrote: Fellow Apache Solr users, I have been working on a PHP extension for Apache Solr in C for quite

RE: UTF-8 Character Set not specifed on OutputStreamWriter in StreamingUpdateSolrServer

: Specifying the file.encoding did work, although I don't think it is a : suitable workaround for my use case. Any idea what my next step is to : having a bug opened. no, you shouldn't *have* to specifying -Dfile.encoding=UTF8, Shalin was just asking to try that to verify that really was the

Re: creating Lucene document from an external XML file.

: If I understand you correctly, you really want to be constructing : SolrInputDocuments (not Lucene's Documents) and indexing those with : SolrJ. I don't think there is anything in the API that can read in an I read your question differently then Otis did. My understanding is that you

Complex multi-value boosting

Guys -- What schema will you use for 500K docs with a variety of 0-30 different category ids, each carrying its own weight and completely overriding the default scoring? For example, these documents: A: 1:0.21, 2:0.41, 3:0.15 ... B: 1:0.18, 2:0.65 4:0.98 ... C: 6:0.75 ... D: 2:0.14 ... When

RE: Multi word synonym problem

: The response is not searching for Michael Jackson. Instead it is : searching for (text:Micheal and text: Jackson).To monitor the parsed : query, i turned on debugQuery, but in the present case, the parsed query : string was searching Micheal and Jackson separately. using index time synonyms

Re: Announcing the Apache Solr extension in PHP - 0.9.0

Hi Mike, Thanks to Pierre, the Windows version of the extension are available here compiled from trunk r 291135 http://downloads.php.net/pierre/ I am planning to have 0.9.8 compiled for windows as soon as it is out sometime later this week. The 1.0 release should be out sometime before mid

Re: Question about the message Indexing failed. Rolled back all changes.

This is definitely a bug. Please open a JIRA issue for this. On Sat, Nov 21, 2009 at 10:53 AM, Bertie Shen bertie.s...@gmail.com wrote: Hey,  I figured out why we always we have see str name=Indexing failed. Rolled back all changes./str.  It is because we need a dataimport.properties file at

Re: Output all, from one field

: Do you want to return just one field from all documents? If yes, you can: : :1. Query with q=*:*fl=name :2. Use TermsComponent - http://wiki.apache.org/solr/TermsComponent note that those are very differnet creatures ... #1 gives you all of the stored values for every document. #2

Re: Boost document base on field length

: I would like to boost documents with longer descriptions to move down documents with 0 length description, : I'm wondering if there is possibility to boost document basing on the field length while searching or the only way is to store field length as an int in a separate field while

Re: [N to M] range search out of sum of field. howto search this?

: fq={!frange l=5 u=10}sum(user,num) H, One of us massivly missunderstood the original question - and i'm pretty sure it's Yonik. i don't think he wants results where the user field plus the num field are in the range of 5-10 ... i think he wants the list of user Ids (which are numbers

Re: Oddness with Phrase Query

On Mon, Nov 23, 2009 at 12:10:42PM -0800, Chris Hostetter said: ...hmm, you shouldn't have to reindex everything. arey ou sure you restarted solr after making the enablePositionIncrements=true change to the query analyzer? Yup - definitely restarted what do the offsets look like when you

Re: Announcing the Apache Solr extension in PHP - 0.9.0

Sweeet! you guys rock. On Mon, Nov 23, 2009 at 11:12 PM, Thanh Doan tcd...@gmail.com wrote: Thanks Israel I plan to try it and compare with rsolr On Nov 23, 2009, at 2:28 PM, Michael Lugassy mlu...@gmail.com wrote: Thanks Israel, exactly what I was looking for, but how would one get a

Re: ExternalRequestHandler and ContentStreamUpdateRequest usage

*:* returns me 1 count but when I search for specific word (which was part of .txt file I indexed before) it doesn't return me anything. I don't have luke setup on my end. let me see if I can set that up quickly but otherwise do you see anything I am missing in solrconfig mapping or something?

Re: ExternalRequestHandler and ContentStreamUpdateRequest usage

FYI: weirdly its returning me following when I run rsp.getResults().get(0).getFieldValue(description) [702, text/plain, doc123.txt, ] so it seems like its storing up.setParam(ext.literal.docName, doc123.txt); into description versus file content in description attribute. Any idea?

Webinar: An Introduction to Basics of Search and Relevancy with Apache Solr hosted by Lucid Imagination

In this introductory technical presentation, renowned search expert Mark Bennett, CTO of Search Consultancy New Idea Engineering, will present practical tips and examples to help you quickly get productive with Solr, including: * Working with the web command line and controlling your inputs and

Re: help with dataimport delta query

got to love it when yahoo thinks your own mail is spam, anyone have any ideas how to get logging to work with 1.4. I went to the admin panel and set all logging to finest. In my jetty std out I see no SQL for any of the dataimport handler run. I see Nov 23, 2009 9:26:27 PM

Re: ExternalRequestHandler and ContentStreamUpdateRequest usage

On Nov 23, 2009, at 5:33 PM, javaxmlsoapdev wrote: *:* returns me 1 count but when I search for specific word (which was part of .txt file I indexed before) it doesn't return me anything. I don't have luke setup on my end. http://localhost:8983/solr/admin/luke should give yo some info.

Implementing phrase autopop up

hello all Let me first explain the task i am trying to do. i have article with title for example doc str name=titleCar Insurance for Teenage Drivers/str /doc − doc str name=titleA Total Loss? /str /doc If a user begins to type car insu i want the autopop to show up with the entire phrase. There

auto-completion preview?

Hello Solr users, is there a live demo of the auto-completion feature somewhere? thanks in advance paul

Re: help with dataimport delta query

I guess the field names do not match in the deltaQuery you are selecting the field id and in the deltaImportQuery you us the field as ${dataimporter.delta.job_jobs_id} I guess it should be ${dataimporter.delta.id} On Tue, Nov 24, 2009 at 1:19 AM, Joel Nylund jnyl...@yahoo.com wrote: Hi, I have

Re: auto-completion preview?

On Tue, Nov 24, 2009 at 10:39 AM, Paul Libbrecht p...@activemath.orgwrote: Hello Solr users, is there a live demo of the auto-completion feature somewhere? thanks in advance Well, there is no preview but I can give you a couple of live instances: 1. http://autos.aol.com/ 2.

Re: Implementing phrase autopop up

On Tue, Nov 24, 2009 at 10:12 AM, darniz rnizamud...@edmunds.com wrote: hello all Let me first explain the task i am trying to do. i have article with title for example doc str name=titleCar Insurance for Teenage Drivers/str /doc − doc str name=titleA Total Loss? /str /doc If a user

Re: schema-based Index-time field boosting

On 23.11.2009 19:33 Chris Hostetter wrote: ...if there was a way to oost fields at index time that was configured in the schema.xml, then every doc would get that boost on it's instances of those fields but the only purpose of index time boosting is to indicate that one document is more

Re: Spellcheck: java.lang.RuntimeException: java.io.IOException: read past EOF

On Tue, Nov 24, 2009 at 1:14 AM, ranjitr contact_ranjit_...@yahoo.comwrote: Hello, Solr 1.3 reported the following error when our app tried to query it: java.lang.RuntimeException: java.io.IOException: read past EOF at