Re: payload queries running slow

2009-12-20 Thread Raghuveer Kancherla
Hi Grant, My queries are about 5 times slower when using payloads as compared to queries that dont use payloads on the same index. I have not done any profiling yet, I am trying out lucid gaze now. I do all the load testing after warming up. Since my index is small ~1 GB, was wondering if a

SOLR Performance Tuning: Disable INFO Logging.

2009-12-20 Thread Fuad Efendi
After researching how to configure default SOLR Tomcat logging, I finally disabled INFO-level for SOLR. And performance improved at least 7 times!!! ('at least 7' because I restarted server 5 minutes ago; caches are not prepopulated yet) Before that, I had 300-600 ms in HTTPD log files in

RE: SOLR Performance Tuning: Disable INFO Logging.

2009-12-20 Thread Fuad Efendi
We were talking about GC options a lot; don't forget to enclose following into if (log.isInfoEnabled()): ... final NamedListObject responseHeader = new SimpleOrderedMapObject(); rsp.add(responseHeader, responseHeader); NamedList toLog = rsp.getToLog(); //toLog.add(core,

solr perf

2009-12-20 Thread Matthieu Labour
Hi I have a slr instance in which i created 700 core. 1 Core per user of my application. The total size of the data indexed on disk is 35GB with solr cores going from 100KB and few documents to 1.2GB and 50 000 documents. Searching seems very slow and indexing as well This is running on a EC2 xtra

Re: solr perf

2009-12-20 Thread Walter Underwood
Here is an idea. Don't make one core per user. Use a field with a user id. wunder On Dec 20, 2009, at 12:38 PM, Matthieu Labour wrote: Hi I have a slr instance in which i created 700 core. 1 Core per user of my application. The total size of the data indexed on disk is 35GB with solr cores

query log

2009-12-20 Thread Peter A. Kirk
Hi, I'd like to write a Component that can write to a simple log with query data for every submitted query. So far I have written a simple Component and configured it to be called in the standard requestHandler. However, I have noticed that it is not always called. It's as if some queries are

Re: query log

2009-12-20 Thread Erik Hatcher
Where are the queries coming from? A browser? I bet you've got the HTTP 304 feature enabled and your client is sending etag/last-modified headers, causing Solr to respond with a 304 response and short circuit. Erik On Dec 20, 2009, at 5:46 PM, Peter A. Kirk wrote: Hi, I'd like to

RE: query log

2009-12-20 Thread Peter A. Kirk
Hi, thanks for the reply. Yes, at the moment the queries are coming from a browser (internet explorer) - actually I'm testing with the little webapp that comes with the Solr download. Where is the HTTP 304 feature enabled and disabled? Or how can I at least ensure that my logger always gets

Re: query log

2009-12-20 Thread Erik Hatcher
On Dec 20, 2009, at 7:24 PM, Peter A. Kirk wrote: Where is the HTTP 304 feature enabled and disabled? Or how can I at least ensure that my logger always gets the request, however Solr responds? It's configured in solrconfig.xml - I generally recommend turning it off during development,

Documents are indexed but not searchable

2009-12-20 Thread krosan
Hi, I'm trying to test solr for a proof of concept project, but I'm having some problems. I indexed my document, but when I search for a word which is 100% certain in the document, I don't get any hits. These are my files: First: my data-config.xml dataConfig dataSource type=JdbcDataSource

Re: Documents are indexed but not searchable

2009-12-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
just search for *:* and see if the docs are indeed there in the index. --Noble On Mon, Dec 21, 2009 at 9:26 AM, krosan kro...@gmail.com wrote: Hi, I'm trying to test solr for a proof of concept project, but I'm having some problems. I indexed my document, but when I search for a word which

Re: Optimize not having any effect on my index

2009-12-20 Thread gurudev
Hi, Are you using the compound file format? If yes, then, have u set it properly in solrconfig.xml, if not, then, change to: useCompoundFiletrue/useCompoundFile (this is by default 'false') under the tags: indexDefaults.../indexDefaults and, mainIndex.../mainIndex Aleksander