Re: Sub field indexing

Thanks Toke, Seems to be exactly what I try to do. Regards Eric Le 08/04/2013 20:02, Toke Eskildsen a écrit : It-forum [it-fo...@meseo.fr]: In exemple I have a product A this product is compatible with a Product B version 1, 5, 6. How can I index values like : compatible_engine : [productB,P

Re: solr 4.2.1 still has problems with index version and index generation

Hi Hoss, we don't use autoCommit and autoSoftCommit. We don't use openSearcher. We don't use transaction log. I can see it in the AdminGUI and with http://master_host:port/solr/replication?command=indexversion All files are replicated from master to slave, nothing lost. It is just that the gen/v

spell suggestions help

hi all one thing I wanted to clear is for every other query I have got correct suggestions but these 2 cases I am not getting what suppose to be the suggestions: 1) I have kettle(doc frequency =5) and cable(doc frequecy=1) word indexed in direct solr spell cheker..but when I query for cattle I ge

Re: Field exist in schema.xml but returns

You have misspelt the tag name in the field definition... you have "fiald" instead of "field". On Tue, Apr 9, 2013 at 7:43 AM, deniz wrote: > hi all, I am using solrcloud and running some simple test queries... > though i > am getting a undefined field error for a field that I have in my schema

Field exist in schema.xml but returns

hi all, I am using solrcloud and running some simple test queries... though i am getting a undefined field error for a field that I have in my schema.xml so the query is myField:* and response is: 400 3 xml myField:* undefined field myField 400

conditional queries?

Hi, Is it possible to do a conditional query if another query has no results?  For example, say I want to search against a given field for: - Search for "car".  If there are results, return them.   - Else, search for "car*" .  If there are results, return them.   - Else, search for "car~" .  If

Re: Solr 4.2.1 Branch

There is also this path for the SVN guys out there: https://svn.apache.org/repos/asf/lucene/dev/tags/lucene_solr_4_2_1 Cheers, Tim On 05/04/13 05:53 PM, Jagdish Nomula wrote: That works out. Thanks for shooting the link. On Fri, Apr 5, 2013 at 5:51 PM, Jack Krupanskywrote: You want the "ta

Re: Number of segments

: How do I determine how many tiers it has? You may find this blog post from mccandless helpful... http://blog.mikemccandless.com/2011/02/visualizing-lucenes-segment-merges.html (don't ignore the videos! watching them really helpful to understand what he is talking about) Once you've obsorbed

Re: Sub field indexing

: Subject: Sub field indexing : References: <1365426517091-4054473.p...@n3.nabble.com> : In-Reply-To: <1365426517091-4054473.p...@n3.nabble.com> https://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When starting a new discussion on a mailing list, please do not repl

Re: Number of segments

On Mon, Apr 8, 2013, at 02:51 PM, Michael Long wrote: > > On 04/08/2013 09:41 AM, Upayavira wrote: > > How many documents do you have? How big are the files on disk? > 2,795,601 and the index dir is 50G > > > > Note it says "segments per tier", you may have multiple tiers at play > > meaning you

Solr Admin Page Master Size

When I check my Solr Admin Page: Replication (Master) Version Gen Size Master: 1365458125729 5 18.24 MB It is a one shard one computer. What is that 18.24 MB. Does it contains just indexes or indexes, highlights etc. etc.? My solr home folder was 512.7 KB and it has become 22860 KB that is why

Best practice for rebuild index in SolrCloud

We are using SolrCloud for replication and dynamic scaling but not distribution so we are only using a single shard. From time to time we make changes to the index schema that requires rebuilding of the index. Should I treat the rebuilding as just any other index operation? It seems to me it wou

RE: Solr language-dependent sort

Hi, Thanks very much for quick help! In our case we mainly need to sort a field based on language defined at run time, but I understood that the principle is the same. Thanks and best regards, Lisheng -Original Message- From: Sujit Pal [mailto:sujitatgt...@gmail.com]On Behalf Of SUJIT

Re: Solr language-dependent sort

Hi Lisheng, We did something similar in Solr using a custom handler (but I think you could just build a custom QeryParser to do this), but you could do this in your application as well, ie, get the language and then rewrite your query to use the language specific fields. Come to think of it, th

Re: Solr metrics in Codahale metrics and Graphite?

That approach sounds great. --wunder On Apr 7, 2013, at 9:40 AM, Alan Woodward wrote: > I've been thinking about how to improve this reporting, especially now that > metrics-3 (which removes all of the funky thread issues we ran into last time > I tried to add it to Solr) is close to release.

Re: Score after boost & before

: I am using edismax and boosting certain fields using bq during query time. : : I would like to compare effect of boost side by side with original score : without boost. Is there anyway i can get original score without boosting? using functions and DocTransformers, it's possible to get the nume

Solr language-dependent sort

Hi, I found that in solr we need to define a special fieldType for each language (http://wiki.apache.org/solr/UnicodeCollation), then point a field to this type. But in our application one field (like 'title') can be used by various users for their languages (user1 used for English, user2 used i

Re: Slow qTime for distributed search

On 4/8/2013 12:19 PM, Manuel Le Normand wrote: It seems that sharding my collection to many shards slowed down unreasonably, and I'm trying to investigate why. First, I created "collection1" - 4 shards*replicationFactor=1 collection on 2 servers. Second I created "collection2" - 48 shards*replic

Re: Slow qTime for distributed search

After taking a look on what I'd wrote earlier, I will try to rephrase in a clear manner. It seems that sharding my collection to many shards slowed down unreasonably, and I'm trying to investigate why. First, I created "collection1" - 4 shards*replicationFactor=1 collection on 2 servers. Second I

Re: solr 4.2.1 still has problems with index version and index generation

: I know there was some effort to fix this but I must report : that solr 4.2.1 has still problems with index version and : index generation numbering in master/slave mode with replication. ... : RESULT: slave has different (higher) version number and is with generation 1 ahead :-( Can you

Re: Empty Solr 4.2.1 can not create Collection

The scenario above needs to have collection1 removed from the solr.xml to work. This, I believe, is the "Empty Solr" scenario that you are talking about. If you don't remove collection1 from solr.xml on all the solr instances, they will get tripped up on collection1 during these steps. If you star

RE: Sub field indexing

It-forum [it-fo...@meseo.fr]: > In exemple I have a product A this product is compatible with a Product > B version 1, 5, 6. > How can I index values like : > compatible_engine : [productB,ProductZ] >version_compatible : [1,5,6],[45,85,96] Index them as compatible_engine: productB/1 compati

stupid collection tricks

Hi, I've been shuffling things around in our Solr Cloud for the past few weeks, and now some cruft has accrued, probably from not having done things in the proper way. Now I have two (obsolete) collections I want to delete, but none of the hosts that are marked as having hosted it are around anym

Re: Moving from SOLR3.6 to SOLR4.0 - Last remaining warnings

On Apr 8, 2013, at 19:09 , "Jack Krupansky" wrote: > "replace with UpdateRequestHandler" > > Just compare your solrconfig to the new one and consider updating yours and > using the newer Solr update API that automatically uses the content type to > internally dispatch to the proper update handl

Re: Sub field indexing

Solr does not support querying nested data structures. If at query time you know the product you want to check compatibility for, you can use dynamic fields. Thus, if you want to find products compatible with productB, you could index: id: productA compatible_productB: 1, 5, 6 compatible_produc

Re: Empty Solr 4.2.1 can not create Collection

The steps that I use to setup the collection are slightly different: 1) Start zk and upconfig the config set. Your approach is same. 2) Start appservers with Solr zkHost set to the zk started in step 1. 3) Use a core admin command to spin up a new core and collection. http://app01/solr/admin/co

Re: Moving from SOLR3.6 to SOLR4.0 - Last remaining warnings

"replace with UpdateRequestHandler" Just compare your solrconfig to the new one and consider updating yours and using the newer Solr update API that automatically uses the content type to internally dispatch to the proper update handler. But, it's just a warning, for now. -- Jack Krupansky

Re: Moving from SOLR3.6 to SOLR4.0 - Last remaining warnings

Here's my guess. On 4/8/13 4:04 AM, Spadez wrote: 11:56:41 WARNING IndexSchema uniqueKey is not stored - distributed search and MoreLikeThis will not work I think the warning is saying the field you specify in does not specify stored="true". Check your schema.xml. 11:56:41 WARNING SolrCo

Re: Indexed data not searchable

On 8 April 2013 21:35, It-forum wrote: > hi > > I use dataimporter [...] Please do not hijack threads. Instead, start a new one for your questions, or follow up in a thread that you had started. Here is why this is bad practice: http://people.apache.org/~hossman/#threadhijack Regards, Gora

Re: solr 4.2.1 still has problems with index version and index generation

This is the jira issue that addresses this: https://issues.apache.org/jira/browse/SOLR-4661 I'll try to find some time today and test out the patch and see how things look. On Mon, Apr 8, 2013 at 7:18 AM, Tom Gullo wrote: > I'm on 4.1 and I have a similar problem. Except for the version numb

Re: Indexed data not searchable

hi I use dataimporter the actual entity contain this : sourceColName="description_short" /> data sample : Piéce détachée pour Skimmer COFIES Modèle:Premium-Design-Omega, Zipper5 Piéce détachée pour Régulateur de niveau modèle 3150 Modèle:3150 depuis 2003 Ideal result : "name" => Couv

RE: FileBasedSpellchecker with Frequency comaprator

I do not believe that FileBasedSpellchecker takes frequency into account at all. That would be a nice enhancement though. To get what you wanted, you could index one or more documents containing the words in your file then create a spellchecker using IndexBasedSpellChecker or DirectSolrSpellCh

Re: Indexed data not searchable

On 8 April 2013 19:26, Max Bo wrote: > Thanks for your help: > > The URL I'am positng to is: http://localhost:8983/solr/update?commit=true > > > The XML-Filess I've added contains fields like "author" so I thought they > have to serachable since it it declared as "indexed" in the example schema.

Re: Indexed data not searchable

Are you sure your XML is formatted according to the SolrXML rules? See: http://wiki.apache.org/solr/UpdateXmlMessages I have to ask, because sometimes people send raw XML to Solr, not realizing that Solr accepts a particular format of XML. -- Jack Krupansky -Original Message- From:

Sub field indexing

Hello All, I'd like to be able to index documents containing criteria and values. In exemple I have a product A this product is compatible with a Product B version 1, 5, 6. My actual schema is like this : Name Price reference features text How can I index values like : compatible_engine : [

Re: Indexed data not searchable

Thanks for your help: The URL I'am positng to is: http://localhost:8983/solr/update?commit=true The XML-Filess I've added contains fields like "author" so I thought they have to serachable since it it declared as "indexed" in the example schema. -- View this message in context: http://lucen

Re: Number of segments

On 04/08/2013 09:41 AM, Upayavira wrote: How many documents do you have? How big are the files on disk? 2,795,601 and the index dir is 50G Note it says "segments per tier", you may have multiple tiers at play meaning you can have more than ten segments. How do I determine how many tiers it h

Re: Indexed data not searchable

On 8 April 2013 18:38, Max Bo wrote: > Hello, > > I'm very new to Solr and I come to an unexplainable point by myself so I > need your help. > > I have indexed a huge amount of xml-Files by a shell script. [...] For posting XML files to Solr directly with curl the XML files need to be in a partic

Re: Indexed data not searchable

That is the structure of your content? Is it formatted in the same XML structure as the example data is? What URL are you posting to? Upayavira On Mon, Apr 8, 2013, at 02:08 PM, Max Bo wrote: > Hello, > > I'm very new to Solr and I come to an unexplainable point by myself so I > need your help.

Re: Number of segments

On Mon, Apr 8, 2013, at 02:35 PM, Michael Long wrote: > I'm running solr 4.0. I'm noticing my segments are staying in the 30+ > range, even though I have these settings: > > > > 10 > 10 > 10 > > false > > Can anyone give me some advice on what I should change or check? How man

Indexed data not searchable

Hello, I'm very new to Solr and I come to an unexplainable point by myself so I need your help. I have indexed a huge amount of xml-Files by a shell script. "function solringest_rec { for SRCFILE in $(find $1 -type f); do #DESTFILE=$URL${SRCFILE/$1/} echo

Number of segments

I'm running solr 4.0. I'm noticing my segments are staying in the 30+ range, even though I have these settings: 10 10 10 false Can anyone give me some advice on what I should change or check?

FileBasedSpellchecker with Frequency comaprator

Hi I want to configure file based spellchecker for my application. I am taking the words frol spellcheck.txt file and building the spellcheckerFile directory index. It works fine. But it is not using the frequency of the words into consideration while giving the spell suggestion. I have duplicat

Re: Numeric fields and payload

Sounds like another new field-mutating update processor is needed - "add payload". -- Jack Krupansky -Original Message- From: Holger Rieß Sent: Monday, April 08, 2013 8:27 AM To: solr-user@lucene.apache.org Subject: Numeric fields and payload Hi, is it possible to store (text) paylo

Numeric fields and payload

Hi, is it possible to store (text) payload to numeric fields (class solr.TrieDoubleField)? My goal is to store measure units to numeric features - e.g. '1.5 cm' - and to use faceted search with these fields. But the field type doesn't allow analyzers to add the payload data. I want to avoid d

Re: solr 4.2.1 still has problems with index version and index generation

I'm on 4.1 and I have a similar problem. Except for the version number everything else seems to be fine. Is that what other people are seeing? -- View this message in context: http://lucene.472066.n3.nabble.com/solr-4-2-1-still-has-problems-with-index-version-and-index-generation-tp405p40

Re: Prediction About Index Sizes of Solr

Interesting bit, thanks* *Rafał! On Mon, Apr 8, 2013 at 12:54 PM, Rafał Kuć wrote: > Hello! > > Let me answer the first part of your question. Please have a look at > > https://svn.apache.org/repos/asf/lucene/dev/trunk/dev-tools/size-estimator-lucene-solr.xls > It should help you make an estim

Moving from SOLR3.6 to SOLR4.0 - Last remaining warnings

Hi. I have recently made the move from SOLR3.6 to SOLR4.0 and so far everything seems super apart frmo the fact that I had a lot of warnings in my "logging" section on the solr admin panel. I have tried to work through as many as possible but I have a few that I am not able to correct. This is the

Re: help needed for applying patch to solr I am using

hi all I think I have to pass the query in inverted commas then its returning correct results as i needed. thanks regards Rohan On Mon, Apr 8, 2013 at 1:50 PM, Rohan Thakur wrote: > hi all > > just checked out this issue was already incorporated in solr4.0 alpha and > I am using solr4.1.0 so

Re: Prediction About Index Sizes of Solr

Hello! Let me answer the first part of your question. Please have a look at https://svn.apache.org/repos/asf/lucene/dev/trunk/dev-tools/size-estimator-lucene-solr.xls It should help you make an estimation about your index size. -- Regards, Rafał Kuć Sematext :: http://sematext.com/ :: Solr -

Prediction About Index Sizes of Solr

This may not be a well detailed question but I will try to make it clear. I am crawling web pages and will index them at SolrCloud 4.2. What I want to predict is the index size. I will have approximately 2 billion web pages and I consider each of them will be 100 Kb. I know that it depends on sto

Re: Understanding the Solr Admin page

Dotan On Monday, April 8, 2013 at 8:21 AM, Dotan Cohen wrote: > I notice that some of the Args presented are in black text, and others > in grey. Why are they presented differently? Where would I have found > this information in the fine manual? > > iirc there is one ticket open which is relat

SOLR-4581

Hello, I created https://issues.apache.org/jira/browse/SOLR-4581 on 14.03.2013. Can anyone help me out with this? Thank You. Alexander Buhr Software Engineer ePages GmbH Pilatuspool 2 20355 Hamburg Germany +49-40-350 188-266 phone +49-40-350 188-222 fax a.b...@epages.com

Re: help needed for applying patch to solr I am using

hi all just checked out this issue was already incorporated in solr4.0 alpha and I am using solr4.1.0 so this must have been in this as wellbut still why am I not getting suggestions for word like microvave oven its stating it to be correct and returning results based of oven wordwhy is t

solr 4.2.1 still has problems with index version and index generation

I know there was some effort to fix this but I must report that solr 4.2.1 has still problems with index version and index generation numbering in master/slave mode with replication. Test was: 1. installed solr 4.2.1 on master and build index from scratch 2. installed solr 4.2.1 on slave with empt

Re: solr spell suggestions help

hi all I have resolved all issues(its was relating to the distance measures I was using was by default lavanstine which is very basic and is not good now I am using jarowinkler distance measures which is better and now giving exact results that I was looking for) except the 4th one which I think i

edismax returns very less matches than regular

I have a simple system. I put the title of webpages into the "name" field and content of the web pages into the "Description" field. I want to search both fields and give the name a little more boost. A search on name field or description field returns records cloase to hundreds. http://localhost:

help needed for applying patch to solr I am using

hi all I am new to solr and wanted to apply this patch to my solr how can I do this searched on net but did not got any thing useful the patch is: https://issues.apache.org/jira/browse/SOLR-2585 I am using solr 4.1.0 on tomcat6 in redhat centos. thanks regards rohan

Re: Filtered search term suggestions via Facet Prefixing or NGrams

Hi, can somebody help, please? Maybe you can at least answer parts of my question? I'd expect that somebody at least knows the limitations of faceting with UninvertedField? Thank you, Andreas Andreas Hubold wrote on 04.04.2013 13:30: Hi, we've successfully implemented suggestion of sea

Re: maxWarmingSearchers in Solr 4.

On Thu, Apr 4, 2013 at 10:54 PM, Shawn Heisey wrote: > You'll want to ensure that your autowarmCount value on Solr's caches is low > enough that each commit happens quickly. If it takes 5000 milliseconds to > warm the caches when you commit, then you want to be sure that you are > committing less

Re: Out of memory on some faceting queries

On Wed, Apr 3, 2013 at 8:47 PM, Shawn Heisey wrote: > On 4/2/2013 3:09 AM, Dotan Cohen wrote: >> I notice that this only occurs on queries that run facets. I start >> Solr with the following command: >> sudo nohup java -XX:NewRatio=1 -XX:+UseParNewGC >> -XX:+UseConcMarkSweepGC -XX:+CMSParallelRema

solr 4.2.1 and docValues

Hi list, I want to try docValues for my facets and sorting with solr 4.2.1 and have already seen many papers, examples and source code about and around docValues, but there are still some questions. The example schema.xml has fields: and it has a comment for docValues: For popularity with do