Re: Long ParNew GC pauses - even when young generation is small

On 1/18/2013 8:37 PM, Mark Miller wrote: On Jan 6, 2013, at 5:41 PM, Shawn Heisey wrote: Clarification of my question and my goals: What I *want* is for all GC pauses to be half a second or less. I'd try working with the concurrent, low pause collector. Any of the stop the world collector

Re: Long ParNew GC pauses - even when young generation is small

On Jan 6, 2013, at 5:41 PM, Shawn Heisey wrote: > Clarification of my question and my goals: > > What I *want* is for all GC pauses to be half a second or less. I'd try working with the concurrent, low pause collector. Any of the stop the world collectors mixed with a large heap will likely m

Re: Long ParNew GC pauses - even when young generation is small

On 1/18/2013 12:40 PM, giltene wrote: << product bragging alert >> We've got people running Solr on the Zing JVM at various places for exactly this reason. A key side effect of running on Zing is the complete elimination of GC effects, with no code changes or tuning needed. So instead of wantin

Re: SolrCloud Performance for High Query Volume

Hi Otis, Thanks for the response.  The primary difference in the schema and solrconfig are the settings that are needed/required for 4.0 compatibility; so things like version field, schema version number, auto commit settings etc.  A quick note on our SolrCloud topology: we have 2 Shards with

Re: Solr 4.0 doesn't send qt parameter to shards

Yeah, shards.qt is the way to go. I think this basically done because of a limitation around early distrib search. If you want to do a distrib search against a bunch of shards and you put the shards to search into the request handler, you then don't want to hit that same request handler on the

Re: Question on Solr Velocity Example

- Messaggio originale - Da: Erik Hatcher A: solr-user@lucene.apache.org; O. Olson Cc: Inviato: Venerdì 18 Gennaio 2013 15:20 Oggetto: Re: Question on Solr Velocity Example Great question.  $response is as described here

Re: Question on Solr Velocity Example

On Jan 18, 2013, at 14:47 , O. Olson wrote: > I am new to > Solr (and Velocity), and have downloaded Solr 4.0 from > http://lucene.apache.org/solr/downloads.html. > I started the example solr, and indexed the XML files in the /exampledocs > directory. Next, I pointed the browser to: h

Re: Velocity in Multicore

Paul - In case you haven't already sussed this one out already, the likely issue is that each core is separately configured and only the single core example collection1 core comes with the VelocityResponseWriter wired in fully. You need these lines (paths likely need adjusting!) in your solrco

Re: Auto completion

In the default /browse suggest, it's wired together with the 'name' field in a couple of places: head.vm: 'terms.fl': 'name', suggest.vm: #foreach($t in $response.response.terms.name) I'll aim to make this more dynamic in the future, but for now if you're adapting from what's there now to

Distributed edismax query - which handler should be in the shards parameter?

I have a handler on my broker core which has defType=edismax and a shards parameter in solrconfig.xml. Currently the handler referenced on each shard in the shards parameter is a handler that does NOT have defType defined. The defType parameter is not in the URL that the client sends. It ju

Re: n values in one fieldType

It depends on what kind of behavior you're looking for. if for your queries the order of the 6 integer values doesn't matter you could do: then you could query with ORed or ANDed integer values over that field. If the order matters but you always query on the "set" of 6 values, then you turn y

Re: Solr 4.0 doesn't send qt parameter to shards

On 1/18/2013 1:20 PM, Mike Schultz wrote: Can someone explain the logic of not sending the qt parameter down to the shards? I see from here that qt is handled as a special case for ResultGrouping: http://lucidworks.lucidimagination.com/display/solr/Result+Grouping where there is a special shard.

RE: SolrCloud :: Distributed query processing

Thanks Yonik, that issue is exactly the same as what I observed. Glad it's fixed in 4.1 -Original Message- From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf Of Yonik Seeley Sent: Friday, January 18, 2013 3:10 PM To: solr-user@lucene.apache.org Subject: Re: SolrCloud :: Distrib

Solr 4.0 doesn't send qt parameter to shards

Can someone explain the logic of not sending the qt parameter down to the shards? I see from here that qt is handled as a special case for ResultGrouping: http://lucidworks.lucidimagination.com/display/solr/Result+Grouping where there is a special shard.qt parameter. in 3.x solrconfig.xml support

Re: SolrCloud :: Distributed query processing

Hopefully the explanation here will shed some light on this: https://issues.apache.org/jira/browse/SOLR-3912 -Yonik http://lucidworks.com On Fri, Jan 18, 2013 at 2:59 PM, Mishkin, Ernest wrote: > Hello, > > I'm trying to reconcile my understanding of how distributed queries are > handled by So

SolrCloud :: Distributed query processing

Hello, I'm trying to reconcile my understanding of how distributed queries are handled by SolrCloud with what I see in the server (tomcat running solr) logs. The setup: Solr 4.0 GA, single collection, one shard, two nodes (master and replica), standalone zookeeper ensemble. Client uses SolrJ C

Question on Solr Velocity Example

Hi,       I am new to Solr (and Velocity), and have downloaded Solr 4.0 from http://lucene.apache.org/solr/downloads.html. I started the example solr, and indexed the XML files in the /exampledocs directory. Next, I pointed the browser to: http://localhost:8983/solr/browse and I get the r

Re: Long ParNew GC pauses - even when young generation is small

<< product bragging alert >> We've got people running Solr on the Zing JVM at various places for exactly this reason. A key side effect of running on Zing is the complete elimination of GC effects, with no code changes or tuning needed. So instead of wanting pauses of half a second or less, an

Re: Need 'stupid beginner' help with SolrCloud

On Jan 18, 2013, at 1:40 PM, Shawn Heisey wrote: > I have a cloud up and running with one config and collection, and I think I > understand how to create more of both. > > Is the following the recommended way of choosing a collection with SolrJ's > CloudSolrServer, or should I be doing someth

Re: Using Solr Spatial in conjunction with HBASE/Hadoop

Thanks guys! David, In general and in your opinion would Lucene Spatial be the way to go to index hundreds of terabytes of spatial data that continually grows. Mostly point data, mostly structured, however, could be polygons. The searches would be within or contains in a polygon. Do you have a

Re: Need 'stupid beginner' help with SolrCloud

On 1/17/2013 9:24 PM, Mark Miller wrote: There are a couple ways you can proceed. You can preconfigure some SolrCores in solr.xml. Even if you don't, you want a solr.xml, because that is where a lot of cloud properties are defined. Or you can use the collections API or the core admin API. I g

Re: Questions about boosting

On 1/18/2013 8:52 AM, Walter Underwood wrote: On Jan 17, 2013, at 10:53 PM, Shawn Heisey wrote: On 1/17/2013 11:41 PM, Walter Underwood wrote: As I understand it, the bq parameter is a full Lucene query, but only used for ranking, not for selection. This is the complement of fq. You can use

n values in one fieldType

Hi guys, I have some specific needs for an application. Each document (identified by docId) has several items from the same type (each one of these items contains 6 integer values). So each Solr doc has a docId and another multiValued attribute. My problem is that I don't know what f

Re: Questions about boosting

On Jan 17, 2013, at 10:53 PM, Shawn Heisey wrote: > On 1/17/2013 11:41 PM, Walter Underwood wrote: >> As I understand it, the bq parameter is a full Lucene query, but only used >> for ranking, not for selection. This is the complement of fq. >> >> You can use weighting: provider:fred^8 >> >>

Re: How to round solr score ?

On 18 January 2013 19:18, Gustav wrote: > Hey Gora, thanks for the fast answer! > > I Had tried the rint(score) function before(it would be perfect in my case) > but it didnt work out, i guess it only works with indexed fields, so i got > the "sort param could not be parsed as a query, and is not

SOLR-1604

Hello! Is there some activity on SOLR-1604? Can one of the contributors answer two simple questions? https://issues.apache.org/jira/browse/SOLR-1604?focusedCommentId=13557053&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13557053 Regards, Dmitry

Re: Questions about boosting

On 1/18/2013 12:32 AM, Mikhail Khludnev wrote: Colleagues, fwiw bq is a DisMax parser feature. Shawn, to approach the boosting syntax with the standard parser you need something like q=foo:bar ip:sc^1000. Specifying ^1000 in bq makes no sense ever. If you show query params and debugQuery output,

Re: SOLR 4.x: multiterm phrase inside proximity searches possible?

Yep, that's my issue: we still use solr 3.4. On Fri, Jan 18, 2013 at 4:57 PM, Jack Krupansky wrote: > LUCENE-2754 is already in Lucene 4.0 - SpanMultiTermQueryWrapper. > > > -- Jack Krupansky > > -Original Message- From: Dmitry Kan > Sent: Friday, January 18, 2013 9:50 AM > > To: solr-use

Re: SOLR 4.x: multiterm phrase inside proximity searches possible?

LUCENE-2754 is already in Lucene 4.0 - SpanMultiTermQueryWrapper. -- Jack Krupansky -Original Message- From: Dmitry Kan Sent: Friday, January 18, 2013 9:50 AM To: solr-user@lucene.apache.org Subject: Re: SOLR 4.x: multiterm phrase inside proximity searches possible? That is good to kn

Re: SOLR 4.x: multiterm phrase inside proximity searches possible?

That is good to know, thanks! Taking the alternative (LUCENE-2754): somehow applying the most recent patch attached to the jira wasn't successful, not sure why. I'd guess, since it patches Lucene, one would still need to wire this to Solr or am I missing something? Dmitry On Fri, Jan 18, 2013 at

Re: SOLR 4.x: multiterm phrase inside proximity searches possible?

Unfortuntaely, yes. -- Jack Krupansky -Original Message- From: Dmitry Kan Sent: Friday, January 18, 2013 9:42 AM To: solr-user@lucene.apache.org Subject: Re: SOLR 4.x: multiterm phrase inside proximity searches possible? Thanks, Jack. I have been looking at SurroundQueryParser and ca

Re: SOLR 4.x: multiterm phrase inside proximity searches possible?

Thanks, Jack. I have been looking at SurroundQueryParser and came across an old thread [1], mentioning two drawbacks: term analysis is left out and no default search operator. Do you know, if this is still true? [1] http://search-lucene.com/m/94ONm1KRuAv1/ On Fri, Jan 18, 2013 at 4:38 PM, Jack K

Re: SOLR 4.x: multiterm phrase inside proximity searches possible?

There is no regular expression support across terms in queries, just within a single term, which is what LUCENE-2754 does (SpanMultiTermQueryWrapper). You can use the "surround" query parser to do span queries: http://wiki.apache.org/solr/SurroundQueryParser But, surround does not support regex

Re: Solr cache considerations

No, the fieldValueCache is not used for resolving queries. Only for multi-token faceting and apparently for the stats component too. The document cache maintains in memory the stored content of the fields you are retrieving or highlighting on. It'll hit if the same document matches the query multip

SOLR 4.x: multiterm phrase inside proximity searches possible?

Hello! Does SOLR 4.x support / is going to support the multi-term phrase search inside proximity searches? To illustrate, we would like the following to work: "\a b\" c"~10 which would return hits with "a b" 10 tokens away from c in no particular order. It looks like https://issues.apache.org/

Re: How to round solr score ?

Hey Gora, thanks for the fast answer! I Had tried the rint(score) function before(it would be perfect in my case) but it didnt work out, i guess it only works with indexed fields, so i got the "sort param could not be parsed as a query, and is not a field that exists in the index: rint(score)" er

Re: access matched token ids in the FacetComponent?

Mikhail, Do you say, that it is not possible to access the matched terms positions in the FacetComponent? If that would be possible (somewhere in the StandardFacetsAccumulator class, where docids are available), then by knowing the matched term positions I can do some school simple math to calcula

Re: Logging wrong exception

On 18 January 2013 18:34, Muhzin R wrote: > Hi all, I'm trying to set the value of a field in my schema to null.The > solr throws the following exception . > > [...] This is the relevant part of the error: > INFO - 2013-01-18 18:13:35.409; > org.

Re: How to round solr score ?

On 18 January 2013 18:26, Gustav wrote: > I have to bump this... is it possible to do it (round solr's score) with any > integrated query function?? Do not have a Solr index handy at the moment to check, but it should be possible to do this with function queries. Please see the rint() and query()

Re: access matched token ids in the FacetComponent?

Dmitry, It definitely seems like postptocessing highlighter's output. The also approach is: - limit number of occurrences of a word in a sentence to 1 - play with facet by function patch https://issues.apache.org/jira/browse/SOLR-1581 accomplished by tf() function. It doesn't seem like much help.

Solr load balancer

Hi, I would like to experiment with some custom load balancers to help with query latency in the face of long gc pauses and the odd time-consuming query that we need to be able to support. At the moment setting the socket timeout via the HttpShardHandlerFactory does help, but of course it can o

Re: ConcurrentModificationException in Solr 3.6.1

Hi There, I think Andre has already guided you in your earlier mail.. This should be fixed in 3.6.2 which is available since Dec 25. >From the r

ConcurrentModificationException in Solr 3.6.1

Hi all, I am using Solr 3.6.1 version. I am giving a set of requests to solr simultaneously. When I check the log file, I noticed the below exception stack trace SEVERE: java.util.ConcurrentModificationException at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:761) at ja

Indexed File Size is doubled in Solr 3.6.1 Slave after Replication

Hi all, I am using Solr 3.6.1 version and have both master and slave instance. I noticed that whenever I make some configuration changes and then restart the server(both master and slave instance) to replicate the changed index(after indexing in master) to slave. When I perform the replication,

indexed file size in doubled in Solr 3.6.1 slave after Replication

Hi all, I am using Solr 3.6.1 version and have both master and slave instance. I noticed that whenever I make some configuration changes and then restart the server(both master and slave instance) to replicate the changed index(after indexing in master) to slave. When I perform the replication,

Re: Large data importing getting rollback with solr

Hi Gora, I will have a Archive Data as some format like relational, Provided by client. Which may have some relation but I will not know. I have to make index that data without restoring to my sql db. That means I have to read the data from archive file directly and this will be full automated. W

RE: Field Collapsing - Anything in the works for multi-valued fields?

If I understand the reading, you've suggested that I index the vendor names as their own document (currently this is a multi-valued field of each document). Each such "vendor document" would just have a single valued 'name' field. Each normal product document would contain a multi-valued field th

Re: Large data importing getting rollback with solr

On 18 January 2013 15:04, ashimbose wrote: > Hi Gora, > > Thank you for your reply again, > > Joining is not possible in my case. coz there is no relation between all > tables. is there joining is possible without any relation in this solr case? No, one needs some kind of a relationship to join.

AW: ConcurrentModificationException in Solr 3.6.1

This should be fixed in 3.6.2 which is available since Dec 25. >From the release notes: "Fixed ConcurrentModificationException during highlighting, if all fields were requested." André Von: mechravi25 [mechrav...@yahoo.co.in] Gesendet: Freitag, 18. Janu

ConcurrentModificationException in solr 3.6.1

Hi all, I am using Solr 3.6.1 version. I am giving a set of requests to solr simultaneously. When I check the log file, I noticed the below exception stack trace SEVERE: java.util.ConcurrentModificationException at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:761) at ja

ConcurrentModificationException in Solr 3.6.1

Hi all, I am using Solr 3.6.1 version. I am giving a set of requests to solr simultaneously. When I check the log file, I noticed the below exception stack trace SEVERE: java.util.ConcurrentModificationException at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:761

ConcurrentModificationException in Solr 3.6.1

Hi all, I am using Solr 3.6.1 version. I am giving a set of requests to solr simultaneously. When I check the log file, I noticed the below exception stack trace SEVERE: java.util.ConcurrentModificationException at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:761

Re: Large data importing getting rollback with solr

On 18 January 2013 13:16, ashimbose wrote: > Hi Gora , > > Thank you for your quick reply. > > I have only one data source, But have more than 300 tables. Each tables I > have put in individual in data-confic.xml > > But when I am trying to do full import, Its showing Thant much as > 169 > > Thi

Re: Solr getting scores of multiple core queries?

K since I found out it didn't work I have merged my two cores back to 1. But now the scores still don't work on the join? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-getting-scores-of-multiple-core-queries-tp4034088p4034481.html Sent from the Solr - User mailing lis

Re: build CMIS compatible Solr

A colleague of mine when I was working for Sourcesense made a CMIS plugin for Solr. It was one way, and we used it to index stuff out of Alfresco into Solr. I can't search for it now, let me know if you can't find it. Upayavira On Fri, Jan 18, 2013, at 05:35 AM, Nicholas Li wrote: > I want to mak

Re: using PositionIncrementAttribute to increment certain term positions to large values

Hi, For the sake of story completeness, I was able to fix the highlighter to work with the token matches that go beyond the length of the text field. The solution was to mod on matched token positions, if they exceed the length of the text. Dmitry On Thu, Dec 27, 2012 at 10:13 AM, Dmitry Kan wr

Re: access matched token ids in the FacetComponent?

Hello Mikhail, > I have some relevant experience and ready to help... Thanks a lot! > ...but I can not get the core problem. Could you please expand the description and/or provide a > sample? Sure. Among other fields not relevant to this discussion, we have two fields: a text field (Contents; se

Re: how to get abortOnConfigurationError=false working

If you look at the version info I posted it seems that it is a pretty old version embedded in Coldfusion, 1.4 by the looks of it. Regards Russ Michaels www.michaels.me.uk www.cfmldeveloper.com - Free CFML hosting for developers www.cfsearch.com - CF search engine On Jan 17, 2013 9:33 PM, "Alexandr