Re: SolrCloud: only partial results returned

2012-12-21 Thread Lili
I am using the follow command with commit: curl 'http://:/solr/update/json?commit=true' --data-binary @books.json -H 'Content-type:application/json' So I assume this is hard commit? Thanks, Lili -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-only-partial-res

Re: Solr 3.6.1

2012-12-21 Thread xpow
thanks for the respond, i will try it and report back ... -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-3-6-1-tp4028502p4028675.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: AND OR query

2012-12-21 Thread Jack Krupansky
Put parentheses around the original query and your new contraint and separate them with "AND": (...) AND (...) Either of those sub-queries could have any complexity of AND and OR. Or, Put the constraint query into a filter query: &fq=... , which will limit the query results as specified.

AND OR query

2012-12-21 Thread hank williams
If I do a free text search for a keyword over all my fields using the query winston churchill town:*winston churchill* OR label:*winston churchill* OR name:*winston churchill* OR office:*winston churchill* I get plenty of results. But If I want to filter the searches down to towns. So Winston Ch

Re: Solr 3.5: java.lang.NegativeArraySizeException caused by negative start value

2012-12-21 Thread Shawn Heisey
On 12/21/2012 3:31 PM, Chris Hostetter wrote: : My Solr 4.1 dev server doesn't seem to have a problem handling this. I see a : substantially similar exception when I send a similar request. : : I have a clarification, at least for 4.1: That specific exception is when it's : a large negative numb

Re: Solr 3.5: java.lang.NegativeArraySizeException caused by negative start value

2012-12-21 Thread Chris Hostetter
: My Solr 4.1 dev server doesn't seem to have a problem handling this. I see a : substantially similar exception when I send a similar request. : : I have a clarification, at least for 4.1: That specific exception is when it's : a large negative number - larger than the numFound of the query. W

Re: Internal statistics in Solr index?

2012-12-21 Thread Joe Zhang
Thank you very much! This is a good starting point! On Fri, Dec 21, 2012 at 6:15 AM, Erick Erickson wrote: > Have you seen the functions here: > http://wiki.apache.org/solr/FunctionQuery#Relevance_Functions > > Best > Erick > > > On Thu, Dec 20, 2012 at 1:18 PM, Joe Zhang wrote: > > > Dear list,

RE: occasional GC crashes

2012-12-21 Thread Petersen, Robert
Thanks Otis, will do. -Original Message- From: Otis Gospodnetic [mailto:otis.gospodne...@gmail.com] Sent: Thursday, December 20, 2012 7:01 PM To: solr-user@lucene.apache.org Subject: RE: occasional GC crashes Hi Robi, Oh that's the thing of the past, go for the latest Java 7 if they let

Re: Finding the last committed record in SOLR 4

2012-12-21 Thread Lance Norskog
The only sure way to get the last searchable document is to use a timestamp or sequence number in the document. I do not think that using a timestamp with default=NOW will give a unique timestamp, so you need your own sequence number. On 12/19/2012 10:17 PM, Joe wrote: I'm using SOLR 4 for an

Re: Solrcloud not reachable and after restart just a "no servers hosting shard"

2012-12-21 Thread Mark Miller
At least it looks like your hitting that - based on it mentioning no frame of reference to use to sync with - more importantly though, your also hitting another issue - see my email to the user list: http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201212.mbox/%3cd0994a2d-04b0-4a80-af07

Re: Solrcloud not reachable and after restart just a "no servers hosting shard"

2012-12-21 Thread Mark Miller
Your hitting https://issues.apache.org/jira/browse/SOLR-3939 The luck of hashing must have left the guy trying to become the leader without any docs. Due to SOLR-3939, a node with an empty index cannot become the leader. - Mark On Dec 21, 2012, at 1:41 PM, gumatias wrote: > I'm getting the sa

Re: Solrcloud not reachable and after restart just a "no servers hosting shard"

2012-12-21 Thread gumatias
I'm getting the same error. I followed the SolrCloud examples and it didn't work.. here's basically what I've done: EXPERIMENT 1: start shards and index documents, search for documents in all replicas # Starting Shards - Shard1 Leader (with zookeeper) java -Dbootstrap_confdir=./solr/colle

How to I let the FVH highlight individual terms instead of the complete phrase?

2012-12-21 Thread Burgmans, Tom
Hi group, I'm trying to highlight my complete(!) XML document, which is indexed for that purpose in a special field called "wkxmlsource". I configured the "wkxmlsource" field like And the text_xml fieldtype is almost equal to the text_en field, but with the as the first class in the index

Dynamic collections in SolrCloud for log indexing

2012-12-21 Thread Upayavira
I'm working on a system for indexing logs. We're probably looking at filling one core every month. We'll maintain a short term index containing the last 7 days - that one is easy to handle. For the longer term stuff, we'd like to maintain a collection that will query across all the historic data,

Re: Ensuring SpellChecker returns corrections which satisfy fq params for default OR query

2012-12-21 Thread Nalini Kartha
Thanks for the advice. Unfortunately what we really need is for the corrections to satisfy fq params. Was wondering how bad the perf would be if we're using the same DocSet (or should it be an OpenBitSet? sorry, I'm still trying to figure all that code out) for each 'correction query'? Seems like

Re: Data from deleted from Solr (Solr cloud)

2012-12-21 Thread Mark Miller
Hmm…have not seen a report of this before. For the future, FWIW, if you are in a bad state, the best thing to do is stop all the replicas in the shard and then start it again. That way everyone will work together to trade data and determine the best leader. When you restarted instance 2, instan

Re: Store and retrieve an xml sequence without losing the markup

2012-12-21 Thread Upayavira
How about you 'xml encode' your content, instead of using CDATA: testing I don't entirely get what's going on for you. I just did a test, posting this: UV1 testing And query

RE: Can DataImportHandler ignore Missing Tags in XML?

2012-12-21 Thread Dyer, James
It looks from your stack trace that your XML document has a value for "ChemicalNameOfSubstance" yet you do not have such a column defined in schema.xml. Is this your problem? The easiest way to get Solr to ignore extra fields that you do not wish to index or store is to add a "catch-all" dynam

Re: Store and retrieve an xml sequence without losing the markup

2012-12-21 Thread Modou DIA
I am working with an xml format named EAD (Encoded Archival Description). That format need to be precompiled before it can be digested by solr. So I just need to store in my index the original XML file. Maybe I need to work with DIH ? 2012/12/20 Upayavira : > Solr does not support nested structu

Re: Beginner's view

2012-12-21 Thread Upayavira
Let me see how easy it is to patch this. Upayavira On Fri, Dec 21, 2012, at 12:56 PM, Erick Erickson wrote: > Nuke 'em or something. This is one of the most annoying "errors" I see. > I'm > not a new user, but every time that flashes by I have to look to see what > happened and think "Oh, it's t

RE: facet query

2012-12-21 Thread hank williams
Great, thank you. > Date: Fri, 21 Dec 2012 14:42:13 +0100 > From: r@solr.pl > To: solr-user@lucene.apache.org > Subject: Re: facet query > > Hello! > > Try facet.mincount=1, that should help. > > -- > Regards, > Rafał Kuć > Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - Elas

Re: facet query

2012-12-21 Thread Rafał Kuć
Hello! Try facet.mincount=1, that should help. -- Regards, Rafał Kuć Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch - ElasticSearch > Hi, is there a way with facets to say, return facets that are not > 0? I have &facet=true&facet.field=office&facet.field=name as my > facet paramete

facet query

2012-12-21 Thread hank williams
Hi, is there a way with facets to say, return facets that are not 0? I have &facet=true&facet.field=office&facet.field=name as my facet parameters, and with some of my queries it brings back people that have a value of 0. Thanks

Re: SolrCloud: only partial results returned

2012-12-21 Thread Erick Erickson
I've been bitten by caching before too, server-level, browser level, whatever-level.. FWIW, Erick On Fri, Dec 21, 2012 at 7:06 AM, Per Steffensen wrote: > Are you using (soft) auto-commit or do you perform a manual commit after > the documents have been indexed? You can index documents, but th

Re: Store and retrieve an xml sequence without losing the markup

2012-12-21 Thread Modou DIA
The index is stored normally but, when i ask the index, all xml markup is deleted in the response. For exemple, when i store this field: I obtain this kind of response when i ask index: 2012/12/20 Alexandre Rafalovitch : > What happens if you just supply it as CDATA into a string field? S

Re: Solr atomic update of multi-valued field

2012-12-21 Thread Erick Erickson
Just saw this: https://issues.apache.org/jira/browse/SOLR-4134 so I don't think you can do what you want currently without the patch. Erick On Fri, Dec 21, 2012 at 7:58 AM, Erick Erickson wrote: > Hmmm, looks like it might be a bug, but I don't know that code at all. > Wonder what Yonik would

Re: Internal statistics in Solr index?

2012-12-21 Thread Erick Erickson
Have you seen the functions here: http://wiki.apache.org/solr/FunctionQuery#Relevance_Functions Best Erick On Thu, Dec 20, 2012 at 1:18 PM, Joe Zhang wrote: > Dear list, > > Is there any way to access things such as word frequency, doc frequency in > solr index? > > Thanks! >

Re: Data from deleted from Solr (Solr cloud)

2012-12-21 Thread Erick Erickson
Note that you don't have to re-compile, the latest successful build is always available, you can find the from here: http://wiki.apache.org/solr/NightlyBuilds FWIW, Erick On Thu, Dec 20, 2012 at 3:36 AM, shreejay wrote: > Thanks John. > > > > -- > View this message in context: > http://lucene.

Re: Using SolrJ to update index with array fields

2012-12-21 Thread Erick Erickson
Solr doesn't natively handle array types, you probably have to do something like for (long l : arryOfLong) { doc.set(... l ); } Although I'm not all that familiar with the update set syntax... FWIW, Erick On Wed, Dec 19, 2012 at 6:26 PM, leonildo wrote: > Hello, > > I´m using solr 1.4 > > Ho

Re: Struggling with solr 4.0 and zookeeper - multiple solr collection and configs

2012-12-21 Thread Erick Erickson
On the solr cloud page, admittedly down the page a ways, is the line below. Does that apply? Best Erick # try bootstrapping all the conf dirs in solr.xml java -classpath example/solr-webapp/WEB-INF/lib/* org.apache.solr.cloud.ZkCLI -cmd bootstrap -zkhost 127.0.0.1:9983 -solrhome example/solr On

Re: Solr atomic update of multi-valued field

2012-12-21 Thread Erick Erickson
Hmmm, looks like it might be a bug, but I don't know that code at all. Wonder what Yonik would have to say On Wed, Dec 19, 2012 at 9:52 AM, Dikchant Sahi wrote: > Hi Erick, > > The name field is stored. I experience problem only when I update > multiValued field with multiple values like, >

Re: Beginner's view

2012-12-21 Thread Erick Erickson
Nuke 'em or something. This is one of the most annoying "errors" I see. I'm not a new user, but every time that flashes by I have to look to see what happened and think "Oh, it's that thing again". I added a comment to the JIRA that amounts to "nuke 'em 'til they glow and shoot 'em in the dark". I

Can DataImportHandler ignore Missing Tags in XML?

2012-12-21 Thread Konrad Lötzsch
Hi, we are trying to import medline into a solr core. everthing works fine except the problem, that in the xml files from medline, sometimes certain tags are missing. If we define them in the data-config.xml file for our core, the dataimporthandler throws an exception for every tag, that is m

Re: SolrCloud: only partial results returned

2012-12-21 Thread Per Steffensen
Are you using (soft) auto-commit or do you perform a manual commit after the documents have been indexed? You can index documents, but they wont be searchable before a (soft) commit has been performed. Even if you are running with (soft) auto-commit there is not guarantee that the documents are

Re: Will SolrCloud always slice by ID hash?

2012-12-21 Thread Per Steffensen
Custom routing is a nice improvement for 4.1, but if I understand you correctly it is probably not what you want to use. If I understand you correctly you want to make a collection with a number of slices - one slice for each day (or other period) - and then make kinda "slicing window" where y

Re: Solr Cloud 4.0 Production Ready?

2012-12-21 Thread Per Steffensen
I would start using Solr Cloud now (keep experimenting), so that you will have a chance to work on setting it up, creating and managing collection, using it from your clients etc. Solr Cloud is very different from simple standalone 3.5 Solr, so you have a lot to learn about how it works before

Re: Pause and resume indexing on SolR 4 for backups

2012-12-21 Thread Andy D'Arcy Jewell
On 20/12/12 20:19, alx...@aim.com wrote: Depending on your architecture, why not index the same data into two machines? One will be your prod another your backup? Because we're trying to keep costs and complexity low whilst in the development stage ;-) But more seriously, this will obviously

Re: Solr 3.6.1

2012-12-21 Thread Upayavira
The default operator is OR. And the default field is 'text'. So when So what you did this query: q=exactText:"how+about" AND content:tomorrow+morning what you did was: Find all documents that: have the terms 'how' and 'about' next to each other in the exactText field AND have the term

Solr 3.6.1

2012-12-21 Thread xpow
Hi, I have a case where i need to find the results of a query that search for a exact phrase + other words, for example, if i have a keyword like: "how about" tomorrow morning the results that should be fetched should match these criteria: - containing exact phrase how about <= exactly how about

Re: Solr 3.5: java.lang.NegativeArraySizeException caused by negative start value

2012-12-21 Thread Shawn Heisey
On 12/21/2012 12:53 AM, Shawn Heisey wrote: This is on Solr 3.5.0. We are getting a java.lang.NegativeArraySizeException when our webapp sends a query where the start parameter is set to a negative value. This seems to set off a denial of service problem within Solr. I don't yet know whether it

Re: Why is luceneMatchVersion a compulsory field in solrconfig.xml?

2012-12-21 Thread Alexandre Rafalovitch
Fair enough. The explicit warning on LUCENE_CURRENT means that the implementers probably thought this through better than I did. Thanks, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of nature that keeps event

Re: Why is luceneMatchVersion a compulsory field in solrconfig.xml?

2012-12-21 Thread Shawn Heisey
On 12/20/2012 10:37 PM, Alexandre Rafalovitch wrote: The question is, why do I need luceneMatchVersion? Removing it seems to throw an exception. But it's presence seems so esoteric that absolute majority of users will never change it. Shouldn't it be by default a LUCENE_LATEST as deemed by Solr