Re: EmbeddedSolrServer removed quietly in 7.0?

2018-01-09 Thread Robert Krüger
On Tue, Jan 9, 2018 at 11:37 AM, Shawn Heisey wrote: > On 1/9/2018 2:42 AM, Robert Krüger wrote: > >> I am looking to upgrade an application that still uses version 4.6.1 to >> latest solr (7.2) but realized that support for EmbeddedSolrServer seems >> to >> have

EmbeddedSolrServer removed quietly in 7.0?

2018-01-09 Thread Robert Krüger
Hi, I am looking to upgrade an application that still uses version 4.6.1 to latest solr (7.2) but realized that support for EmbeddedSolrServer seems to have vanished with 7.0 but I could find no mention of it in the release notes, which strikes me as odd for such a disruptive change. Is it somewhe

Re: Efficiency of integer storage/use

2015-10-21 Thread Robert Krüger
the index. > > On Sat, Oct 17, 2015 at 1:15 AM, Robert Krüger > wrote: > > > Thanks for the feedback. > > > > What I am trying to do is to "abuse" integers to store 8bit (or even > lower) > > values of metrics I use for content-based image/video search

Re: Efficiency of integer storage/use

2015-10-17 Thread Robert Krüger
;wasted" bits. Especially if you can use > docValues, > that option holds much of the underlying data in MMapDirectory > that uses swappable OS memory > > Best, > Erick > > On Fri, Oct 16, 2015 at 1:53 AM, Robert Krüger > wrote: > > Hi, > > > > I

Efficiency of integer storage/use

2015-10-15 Thread Robert Krüger
Hi, I have a data model where I would store and index a lot of integer values with a very restricted range (e.g. 0-255), so theoretically the 32 bits of Solr's integer fields are complete overkill. I want to be able to to things like vector distance calculations on those fields. Should I worry abo

Problem with custom function on binary content

2015-10-15 Thread Robert Krüger
Hi, I am trying to implement a custom function that evaluates fields stored as type "binary" (BinaryField). I have my ValueSourceParser set up and I can retrieve the arguments of my function correctly and have a reference to the SchemaField. Now I am a bit stuck, how I can retrieve the binary con

Re: Initializing core takes very long at times

2015-08-05 Thread Robert Krüger
> All patches welcome! > > On Wed, Aug 5, 2015 at 12:40 PM, Robert Krüger > wrote: > > I am shipping solr as a local search engine with our software, so I have > no > > way of controlling that environment. Many other software packages > (rdbmss, > > nosql engines

Re: Embedded Solr now deprecated?

2015-08-05 Thread Robert Krüger
it would > require some kind of replacement. > > How are you using it that you care? Wondering what > alternatives exist... > > Best, > Erick > > > On Wed, Aug 5, 2015 at 9:09 AM, Robert Krüger wrote: > > Hi, > > > > I tried to upgrade my application

Re: Initializing core takes very long at times

2015-08-05 Thread Robert Krüger
server-based use. I may suggest a patch on the devel mailing list. On Wed, Aug 5, 2015 at 5:42 PM, Shawn Heisey wrote: > On 8/5/2015 7:56 AM, Robert Krüger wrote: > > OK, now that I had a reproducible setup I could debug where it hangs: > > > > public SystemInfoHan

Re: Initializing core takes very long at times

2015-08-05 Thread Robert Krüger
than patching solr, which I am trying to avoid like hell. On Wed, Aug 5, 2015 at 1:54 PM, Robert Krüger wrote: > Hi, > > for months/years, I have been experiencing occasional very long (30s+) > hangs when programmatically initializing a solr container in Java. The > application has

Embedded Solr now deprecated?

2015-08-05 Thread Robert Krüger
Hi, I tried to upgrade my application from solr 4 to 5 and just now realized that embedded use of solr seems to be on the way out. Is that correct or is there a just new API to use for that? Thanks in advance, Robert

Initializing core takes very long at times

2015-08-05 Thread Robert Krüger
Hi, for months/years, I have been experiencing occasional very long (30s+) hangs when programmatically initializing a solr container in Java. The application has worked for years in production with this setup without any problems apart from this. The code I have is this here: public void initCo

Re: Example of sorting by custom function

2015-04-04 Thread Robert Krüger
gt; Freelance Apache Lucene/Solr Search Consultant/Developer > http://www.linkedin.com/in/davidwsmiley > > On Fri, Apr 3, 2015 at 9:44 AM, Robert Krüger wrote: > > > Hi, > > > > I have been looking around on the web for information on sorting by a > > custom functio

Example of sorting by custom function

2015-04-03 Thread Robert Krüger
Hi, I have been looking around on the web for information on sorting by a custom function but the results are inconclusive to me and some of it seems so old that I suspect it's outdated. What I want to do is the following: I have a field "fingerprint" in my schema that contains a binary data (e.g

Re: Easiest way to embed solr in a desktop application

2015-01-15 Thread Robert Krüger
; > > On Jan 15, 2015, at 9:44 AM, Robert Krüger wrote: > > > > Hi Andrea, > > > > you are assuming correctly. It is a local, non-distributed index that is > > only accessed by the containing desktop application. Do you know if there > > is a poss

Re: Easiest way to embed solr in a desktop application

2015-01-15 Thread Robert Krüger
/ > > Ahmet > > > On Thursday, January 15, 2015 4:45 PM, Robert Krüger > wrote: > Hi Andrea, > > you are assuming correctly. It is a local, non-distributed index that is > only accessed by the containing desktop application. Do you know if there > is a possibility to

Re: Easiest way to embed solr in a desktop application

2015-01-15 Thread Robert Krüger
ributed > feature. > > I think the usage of EmbeddedSolrServer is discouraged in a (distributed) > service scenario, because it is a direct connection to a SolrCore > instance...but this is not a problem in the situation you described (as far > as I know) > > Best, >

Easiest way to embed solr in a desktop application

2015-01-15 Thread Robert Krüger
Hi, I have been using an embedded instance of solr in my desktop application for a long time and it works fine. At the time when I made that decision (vs. firing up a solr web application within my swing application) I got the impression embedded use is somewhat unsupported and I should expect pro

Re: Performance/scaling with custom function queries

2014-06-12 Thread Robert Krüger
r segment, you could cleanly > plug it in. > > Joel Bernstein > Search Engineer at Heliosearch > > > On Wed, Jun 11, 2014 at 9:39 AM, david.w.smi...@gmail.com < > david.w.smi...@gmail.com> wrote: > >> On Wed, Jun 11, 2014 at 7:46 AM, Robert Krüger >> wrot

Re: Performance/scaling with custom function queries

2014-06-11 Thread Robert Krüger
, Jun 10, 2014 at 10:11 AM, Robert Krüger wrote: > Great, I was hoping for that. In my case I will have to deal with the > worst case scenario, i.e. all documents matching the query, because > the only criterion is the fingerprint and the result of the > distance/similarity function which

Re: Performance/scaling with custom function queries

2014-06-10 Thread Robert Krüger
> > Sounds like an interesting project. Please keep us posted. > > Joel Bernstein > Search Engineer at Heliosearch > > > On Sun, Jun 8, 2014 at 6:17 AM, Robert Krüger wrote: > >> Hi, >> >> let's say I have an index that contains a field of type BinaryFi

Performance/scaling with custom function queries

2014-06-08 Thread Robert Krüger
Hi, let's say I have an index that contains a field of type BinaryField called "fingerprint" that stores a few (let's say 100) bytes that are some kind of digital fingerprint-like thing. Let's say I want to perform queries on that field to achieve sorting or filtering based on a kind of custom di

Set up embedded Solr container and cores programmatically to read their configs from the classpath

2014-02-11 Thread Robert Krüger
Hi, I have an application with an embedded Solr instance (and I want to keep it embedded) and so far I have been setting up my Solr installation programmatically using folder paths to specify where the specific container or core configs are. I have used the CoreContainer methods createAndLoad and

Re: Programatic instantiation of solr container and cores with config loaded from a jar

2013-07-22 Thread Robert Krüger
lrResourceLoader and a ConfigSolr object as constructor parameters, and you can create a ConfigSolr object from a string representation of solr.xml using the ConfigSolr.fromString() static method. > > Alan Woodward > www.flax.co.uk > > > On 22 Jul 2013, at 11:41, Robert Krüger wrote:

Programatic instantiation of solr container and cores with config loaded from a jar

2013-07-22 Thread Robert Krüger
Hi, I use solr embedded in a desktop app and I want to change it to no longer require the configuration for the container and core to be in the filesystem but rather be distributed as part of a jar file. Could someone kindly point me to the right docs? So far my impression is, I need to instanti

Re: Is Overlapping onDeckSearchers=2 really a problem?

2013-06-27 Thread Robert Krüger
Shawn, On Thu, Jun 27, 2013 at 5:03 PM, Shawn Heisey wrote: > On 6/27/2013 5:59 AM, Robert Krüger wrote: >> sometime forcing oneself to describe a problem is the first step to a >> solution. I just realized that I also had an autocommit statement in >> my config with the

Re: Is Overlapping onDeckSearchers=2 really a problem?

2013-06-27 Thread Robert Krüger
Hi, On Thu, Jun 27, 2013 at 12:23 PM, Robert Krüger wrote: > Hi, > > I have a desktop application where I am "abusing" solr as an embedded > database accessing it and I am quite happy with everything. > Performance is more than goog enough for my use case and Solr

Is Overlapping onDeckSearchers=2 really a problem?

2013-06-27 Thread Robert Krüger
Hi, I have a desktop application where I am "abusing" solr as an embedded database accessing it and I am quite happy with everything. Performance is more than goog enough for my use case and Solr's query capabilities match the requirements of my app quite well. However, I have the well-known perfo

Re: copyField generates "multiple values encountered for non multiValued field"

2013-06-06 Thread Robert Krüger
On Thu, Jun 6, 2013 at 1:52 PM, Jack Krupansky wrote: > "read current state, manipulate fields and then add the document with the > same id)" > > Ahh... then you have an IMPLICIT reference to the field in your Java code - > you explicitly told Solr that you wanted to start with all existing field

Re: copyField generates "multiple values encountered for non multiValued field"

2013-06-06 Thread Robert Krüger
I don't know what I have to do to use the atomic update feature but I am not aware of using it. But the way you describe it, it means that the copyField directive does not overwrite the existing field content and that's an easy explanation to what is happening in my case. Then the second update (wh

Re: copyField generates "multiple values encountered for non multiValued field"

2013-06-06 Thread Robert Krüger
On Wed, Jun 5, 2013 at 9:12 PM, Jack Krupansky wrote: > Look in the Solr log - the error message should tell you what the multiple > values are. For example, > > 95484 [qtp2998209-11] ERROR org.apache.solr.core.SolrCore – > org.apache.solr.common.SolrException: ERROR: [doc=doc-1] multiple values

Re: copyField generates "multiple values encountered for non multiValued field"

2013-06-05 Thread Robert Krüger
nt twice would not result in a change in the index > (unless you had a date field with a value of "NOW".) Copy field only uses > values from the current document. > > -- Jack Krupansky > > -Original Message- From: Robert Krüger > Sent: Wednesday, June 05, 2013 10

copyField generates "multiple values encountered for non multiValued field"

2013-06-05 Thread Robert Krüger
I have the exact same problem as the guy here: http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201105.mbox/%3C3A2B3E42FCAA4BF496AE625426C5C6E4@Wurstsemmel%3E AFAICS he did not get an answer. Is this a known issue? What can I do other than doing what copyField should do in my application

Re: uniqueKey not enforced

2012-10-24 Thread Robert Krüger
On Wed, Oct 24, 2012 at 2:03 PM, Erick Erickson wrote: > Robert: > > But you do have an index somewhere, so the alternative for > looking at it low-level would be > 1> get a copy of Luke and point it at your index. Very useful tool I will do that, next time I have that condition. Unfortunately I

Re: uniqueKey not enforced

2012-10-24 Thread Robert Krüger
On Tue, Oct 23, 2012 at 2:37 PM, Erick Erickson wrote: > From left field: > > Try looking at your admin/schema browser page for the ID in question. > That actually > gets stuff out of your index (the actual indexed terms). See if you > have two values I'm running embedded, so I don't have that. Ho

Re: uniqueKey not enforced

2012-10-22 Thread Robert Krüger
On Mon, Oct 22, 2012 at 6:01 PM, Jack Krupansky wrote: > And, are you using UUID's or providing specific key values? specific key values

Re: uniqueKey not enforced

2012-10-22 Thread Robert Krüger
On Mon, Oct 22, 2012 at 2:08 PM, Jack Krupansky wrote: > Which release of Solr? 3.6.1 > > Is this a single node Solr or distributed or cloud? single node, actually embedded in an application. > > Is is possible that you added documents with the "overwrite="false"" > attribute? That would suppres

uniqueKey not enforced

2012-10-22 Thread Robert Krüger
Hi, I noticed a duplicate entry in my index and I am wondering how that can be, because I have a uniqueKey defined. I have the following defined in my schema.xml: other field types omitted here ... other fields omitted here ... id name An

Re: Config parameters to tweak for update performance

2012-10-18 Thread Robert Krüger
On Tue, Oct 16, 2012 at 4:13 PM, Shawn Heisey wrote: > On 10/16/2012 5:38 AM, Robert Krüger wrote: >> >> I use solr embedded in a desktop app and due to the consistency >> requirements of the application I have to commit rather often. Are >> there some best practice

Config parameters to tweak for update performance

2012-10-16 Thread Robert Krüger
Hi, I use solr embedded in a desktop app and due to the consistency requirements of the application I have to commit rather often. Are there some best practices on how to optimize commit performance via the configuration? I could easily live with slower queries or more memory use as my index is ra

Re: Can I rely on correct handling of interrupted status of threads?

2012-10-12 Thread Robert Krüger
On Tue, Oct 2, 2012 at 11:48 AM, Robert Krüger wrote: > Hi, > > I'm using Solr 3.6.1 in an application embedded directly, i.e. via > EmbeddedSolrServer, not over an HTTP connection, which works > perfectly. Our application uses Thread.interrupt() for canceling > long-runn

Re: Can I rely on correct handling of interrupted status of threads?

2012-10-04 Thread Robert Krüger
On Tue, Oct 2, 2012 at 8:50 PM, Mikhail Khludnev wrote: > I remember a bug in EmbeddedSolrServer at 1.4.1 when exception bypasses > request closing that lead to searcher leak and OOM. It was fixed about two > years ago. > You mean InterruptedException?

Can I rely on correct handling of interrupted status of threads?

2012-10-02 Thread Robert Krüger
Hi, I'm using Solr 3.6.1 in an application embedded directly, i.e. via EmbeddedSolrServer, not over an HTTP connection, which works perfectly. Our application uses Thread.interrupt() for canceling long-running tasks (e.g. through Future.cancel). A while (and a few Solr versions) back a colleague o

Re: How to Index and query URLs as fields

2011-03-08 Thread Robert Krüger
My mistake. The error turned out to be somewhere else and the described approach seems to work. Sorry for the wasted bandwidth. On Mar 8, 2011, at 11:06 AM, Robert Krüger wrote: > Hi, > > I've run into problems trying to achieve a seemingly simple thing. I'm > ind

How to Index and query URLs as fields

2011-03-08 Thread Robert Krüger
Hi, I've run into problems trying to achieve a seemingly simple thing. I'm indexing a bunch of files (local ones and potentially some accessible via other protocols like http or ftp) and have an index field with the url to the file, e.g. "file:/home/foo/bar.pdf". Now I want to perform two simpl

Pragmatic more or less high availability option on 2 servers

2010-02-16 Thread Robert Krüger
Hi, I have to set up a SOLR cluster with some availability concept (is allowed to require manual interaction on fault, however, if there is a better way, I'd be interested in recommendations). I have two servers (A and B for the example) at my disposal. What I was thinking about was the follo

Re: Boosting by date when only some records have one

2008-12-17 Thread Robert Krüger
eld:[* TO *] > Gives the entries which have a value for that field. Documents with nothing > in 'field' will not return. To get the opposite set: > > *:* -field:[* TO *] > > Does this help? > Lance > > -----Original Message- > From: Robert Krüger [m

Re: Boosting by date when only some records have one

2008-12-16 Thread Robert Krüger
Chris Hostetter wrote: > : thanks a lot! Looks like what I need except that I cannot use dismax > : because I need to be able to do prefix queries. I'm new to Solr, so I > > there's nothing dismax related in that syntax, i just suggested using it > in a "bq" param becuase i assumed that's what yo

Is making removal of wildcards configurable planned for DisMaxRequestHandler

2008-12-16 Thread Robert Krüger
Hi, I'm rather new to Solr and for my current projects came to the conclusion that DisMaxRequestHandler is exactly the tool I need, except that it doesn't allow prefix queries. I found a thread in the archive were someone mentioned the idea of making this behaviour configurable (which characters

Re: Boosting by date when only some records have one

2008-12-16 Thread Robert Krüger
Hi, thanks a lot! Looks like what I need except that I cannot use dismax because I need to be able to do prefix queries. I'm new to Solr, so I don't know if there's a way to formulate this in a standard query. If not, I could extend DismaxRequestHandler so it doesn't escape the "*"s, right? Robe

Boosting by date when only some records have one

2008-12-13 Thread Robert Krüger
Hi, I'm looking for a way to boost queries by date but not all documents have a date associated with them. My goal is to have something like a default boost for documents (e.g. 1.0) with a function for documents with dates that distribute the boosts between 1.0 - x to 1.0 + x based on a valid dat