Re: [resolved] Config issue for deduplication

2010-05-13 Thread Markus Fischer
! Markus Markus Fischer schrieb: I use true and a different field than ID to control duplication. This is about bibliographic data coming from different sources with different IDs which may have the same content... I attached solrconfig.xml if you want to take a look. Thanks a lot! Markus

Re: Config issue for deduplication

2010-05-13 Thread Markus Fischer
x27;s your solrconfig? No deduplication is overwritesDedupes = false and signature field is other than doc ID field (unique) -Original message- From: Markus Fischer Sent: Thu 13-05-2010 17:01 To: solr-user@lucene.apache.org; Subject: Config issue for deduplication I am trying to conf

Re: Config issue for deduplication

2010-05-13 Thread Markus Fischer
Hmm, I can't find in solrconfig.xml anything about dataimporthandler for Vufind. So I suppose, no the import function does not use this method. Import is done by a script. Maybe I do not associate dedupe with the correct requestHandler? I placed it directly after So kind of h

Config issue for deduplication

2010-05-13 Thread Markus Fischer
I am trying to configure automatic deduplication for SOLR 1.4 in Vufind. I followed: http://wiki.apache.org/solr/Deduplication Actually nothing happens. All records are being imported without any deduplication. What am I missing? Thanks Markus I did: - create a duplicated set of records,

[Solved] Re: Commit takes 1 to 2 minutes, CPU usage affects other apps

2010-05-12 Thread Markus Fischer
Hi, On 07.05.2010 22:47, Chris Hostetter wrote: so it's the full request time, and would be inclusive of any postCommit event handlers -- that's important to know. the logs will help clear up wether the underlying "commit" is really taking up a large amount of time or if it's some postCommit ev

Re: Commit takes 1 to 2 minutes, CPU usage affects other apps

2010-05-05 Thread Markus Fischer
Hi, On 05.05.2010 03:49, Chris Hostetter wrote: > > : Are you accidentally building the spellchecker database on each commit? > ... > : > This could also be caused by performing an optimize after the commit, or > it > : > could be caused by auto warming the caches, or a combination of both

Re: Commit takes 1 to 2 minutes, CPU usage affects other apps

2010-05-04 Thread Markus Fischer
On 04.05.2010 11:01, Peter Sturge wrote: It might be worth checking the VMWare environment - if you're using the VMWare scsi vmdk and it's shared across multiple VMs and there's a lot of disk contention (i.e. multiple VMs are all busy reading/writing to/from the same disk channel), this can reall

Re: Commit takes 1 to 2 minutes, CPU usage affects other apps

2010-05-04 Thread Markus Fischer
Hi, On 04.05.2010 03:24, Mark Miller wrote: On 5/3/10 9:06 AM, Markus Fischer wrote: we recently began having trouble with our Solr 1.4 instance. We've about 850k documents in the index which is about 1.2GB in size; the JVM which runs tomcat/solr (no other apps are deployed) has been give

Commit takes 1 to 2 minutes, CPU usage affects other apps

2010-05-03 Thread Markus Fischer
Hi, we recently began having trouble with our Solr 1.4 instance. We've about 850k documents in the index which is about 1.2GB in size; the JVM which runs tomcat/solr (no other apps are deployed) has been given 2GB. We've a forum and run a process every minute which indexes the new messages.

Seeking help setting up solr in eclipse

2009-09-13 Thread Markus Fischer
Hi, I'ld like to set up Eclipse to run solr (in Tomcat for example), but struggling with the issue that I can't get the index.jsp and other files to be properly executed, for debugging and working on a plugin. I've checked out solr via subclipse plugin, created a Dynamic Web Project. It seems tha

Monitoring solr stats with munin?

2008-09-29 Thread Markus Fischer
Hi, has anyone had the need and maybe already written a munin plugin to graph some informations from e.g. admin/stats.jsp ? thanks, - Markus