Re: how to make sure all the index docs flushed to the index files

2013-09-16 Thread YouPeng Yang
Hi Another werid problem. When we setup the autocommit properties, we suppose that the index fille will created every commited.So that the size of the index files will be large enough. We do not want to keep too many small files as [1]. How to control the size of the index files. [1]---

Problem with SynonymFilter and StopFilterFactory

2013-09-16 Thread david . davila
Hi, I have encoutered a problem applying StopFilterFactory and SynonimFilterFactory. The problem is that SynonymFilter removes the gaps that were previously put by the StopFilterFactory. I'm applying filters in query time, because users need to change synonym lists frequently. This is my sche

Re: how to make sure all the index docs flushed to the index files

2013-09-16 Thread YouPeng Yang
Hi Shawn Thank your very much for your reponse. I lauch the full-import task on the web page of solr/admin . And I do check the commit option. The new docs would be committed after the operation. The commit option is defferent with the autocommit,right? If the import datasets are too lar

Re: how to make sure all the index docs flushed to the index files

2013-09-16 Thread Shawn Heisey
On 9/16/2013 8:26 PM, YouPeng Yang wrote: >I'm using the DIH to import data from oracle database with Solr4.4 >Finally I get 2.7GB index data and 4.1GB tlog data.And the number of > docs was 1090. > > At first, I move the 2.7GB index data to another new Solr Server in > tomcat7. A

2 question about solr and lucene

2013-09-16 Thread Robin Wei
Hi, guys: I met two questions about solr and lucene, wish people to help out. use payload query but can NOT with numerical field type. for example: I implemented my own requesthandler, refer to http://hnagtech.wordpress.com/2013/04/19/using-payloads-with-solr-4-x/

how to make sure all the index docs flushed to the index files

2013-09-16 Thread YouPeng Yang
Hi I'm using the DIH to import data from oracle database with Solr4.4 Finally I get 2.7GB index data and 4.1GB tlog data.And the number of docs was 1090. At first, I move the 2.7GB index data to another new Solr Server in tomcat7. After I start the tomcat ,I find the total number o

SPLITSHARD failure right before publishing the new sub-shards

2013-09-16 Thread HaiXin Tie
Hi Solr experts, I am using Solr 4.4 with ZK 3.4.5, trying to split "shard1" of a collection named "body". There is only one core on one machine for this collection. When I call SPLITSHARD to split this collection, Solr is able to create two sub-shards, but failed with a NPE in SolrCore.java whil

Updated: CREATEALIAS does not work with more than one collection (Error 503: no servers hosting shard)

2013-09-16 Thread HaiXin Tie
Sorry but I've fixed some typos, updated text: Hello Solr experts, For some strange reason, collection alias does not work in my Solr instance when more than one collection is used. I would appreciate your help. # Here is my setup, which is quite simple: Zookeeper: 3.4.5 (used to upconfig/linkc

CREATEALIAS does not work with more than one collection (Error 503: no servers hosting shard)

2013-09-16 Thread HaiXin Tie
Hello Solr experts, For some strange reason, collection alias does not work in my Solr instance when more than one collection is used. I would appreciate your help. # Here is my setup, which is quite simple: Zookeeper: 3.4.5 (used to upconfig/linkconfig collections and configs for c1 and c2) Sol

TokenizerFactory from 4.2.0 to 4.3.0

2013-09-16 Thread Benson Margulies
TokenizerFactory changed, incompatibly with subclasses, from 4.2.0 to 4.3.0. Subclasses must now implement a different overload of create, and may not implement the old one. Has anyone got any devious strategies other than multiple copies of code to deal with this when supporting multiple versions

Re: requested url solr/update/extract not available on this server

2013-09-16 Thread Chris Hostetter
: Is /solr/update working? more importantly: does "/solr/" work in your browser and return anything useful? (nothing you've told us yet gives us anyway of knowning if solr is even up and running) if 'http://localhost:8080/solr/' shows you the solr admin UI, and you are using the stock Solr 4

Re: Re-Ranking results based on DocValues with custom function.

2013-09-16 Thread Chris Hostetter
: dissimilarity functions). What I want to do is to search using common : text search and then (optionally) re-rank using some custom function : like : : http://localhost:8983/solr/select?q=*:*&sort=myCustomFunction(var1) asc can you describe what you want your custom function to look like? it ma

Atomic commit across shards?

2013-09-16 Thread Damien Dykman
Is a commit (hard or soft) atomic across shards? In other words, can I guaranty that any given search on a multi-shard collection will hit the same index generation of each shard? Thanks, Damien

RE: Best configuration for 2 servers

2013-09-16 Thread Branham, Jeremy [HR]
I may be interpreting this incorrectly, but shouldn't the cloud still serve requests if ZK crashes? http://wiki.apache.org/solr/SolrCloud#Example_C:_Two_shard_cluster_with_shard_replicas_and_zookeeper_ensemble " The problem with example B is that while there are enough Solr servers to survive a

Re: Best configuration for 2 servers

2013-09-16 Thread Otis Gospodnetic
At the moment I can't think of any reason why queries could not be served w/o ZK up and running. Otis -- Solr & ElasticSearch Support -- http://sematext.com/ Solr Performance Monitoring -- http://sematext.com/spm On Mon, Sep 16, 2013 at 4:58 PM, Branham, Jeremy [HR] wrote: > I may be interpret

Re: SOLR 4.2, slaves replicating reporting higher version number than master

2013-09-16 Thread Neal Ensor
Looks much like what I'm encountering. Guessing that will go away once I update solr, just wanted to make sure it wasn't a real bug. Entirely possible we are getting some "empty commits" given the nature of the index maintenance. Thanks for the pointer! On Mon, Sep 16, 2013 at 2:00 PM, Chris H

dih delete doc per $deleteDocById

2013-09-16 Thread andreas owen
i am using dih and want to delete indexed documents by xml-file with ids. i have seen $deleteDocById used in data-config.xml: xml-file: 2345

Dynamic row sizing for documents via UpdateCSV

2013-09-16 Thread Utkarsh Sengar
Hello, I am using UpdateCSV to load data in solr. Currently I load this schema with a static set of values: userid,name,age,location john8322,John,32,CA tom22,Tom,30,NY But now I have this usecase where john8322 might have a state specific dynamic field for example: userid,name,age,location, ca

Re: Slow query at first time

2013-09-16 Thread Shawn Heisey
On 9/16/2013 7:15 AM, Sergio Stateri wrote: > I´m trying to make a search with Solr 4.4, but in the first time the search > is too slow. I have studied about pre-warm queries, but the query response > is the same after putting it. Can anyone help me? Here´s a piece of > solrconfig.xml: > > You'

Re: Slow query at first time

2013-09-16 Thread Furkan KAMACI
What is query time of your search? I mean as like that: QueryResponse solrResponse = query(solrParams); solrResponse.getQTime(); 2013/9/16 Sergio Stateri > Hi, > > I´m trying to make a search with Solr 4.4, but in the first time the search > is too slow. I have studied about pre-warm queries,

Re: how soft-commit works

2013-09-16 Thread Shawn Heisey
On 9/16/2013 7:01 AM, Matteo Grolla wrote: > Can anyone explain me the following things about soft-commit? > -For searches o access new documents I think a new searcher is opened after a > soft commit. > How does the near realtime requirement for soft commit match with the > potentially lon

Re: SOLR 4.2, slaves replicating reporting higher version number than master

2013-09-16 Thread Chris Hostetter
Sounds like perhaps you are getting confused by this... https://issues.apache.org/jira/browse/SOLR-4661 ...if that is the situation then it's not a bug you need to worry about, just a confusion in how the ReplicaitonHandler reports it's stats -- the newer UI makes it more clear what numbers yo

SOLR 4.2, slaves replicating reporting higher version number than master

2013-09-16 Thread Neal Ensor
Having a strange intermittent issue with my 1 master, 3 slave solr 4.2 setup. On occasion, after indexing the master and replicating across the three slaves, each slave will start reporting they are one generation ahead (525 vs. 524 on the master) and thus out of sync. Replication runs appear to

Re: sorting using org.apache.solr.client.solrj.SolrQuery not working

2013-09-16 Thread Chris Hostetter
: In the log i see the sorting column as "LAST_NAM". : Is there a difference between "LAST_NAM asc" and "LAST_NAM+asc"...I see only : this diff? the log message you are looking at is showing you the request params recieved by the handler fro mthe client, with URL escaping -- so the "+" you see

Re: Solr PingQuery

2013-09-16 Thread Furkan KAMACI
I want to add one more thing for Shawn about Zookeeper. In order to have quorum, you need to have half the servers plus one available. Because of that let's assume you have 4 machine of Zookeeper and two of them communicating within them and other two of them communicating within them. Assume that

Re: sorting using org.apache.solr.client.solrj.SolrQuery not working

2013-09-16 Thread suren
Shawn, I am doing exactly same. Data output is not sorting on "LAST_NAME" column , but it is always sorting on different column "CLAIM_NUM", and I am not adding this sorting condition( sort on CLAIM_NUM). solrQuery.setQuery("*:*"); solrQuery.setSort("LAST_NAM",SolrQuery.ORDER.asc); solrQ

Re: Spellcheck compounded words

2013-09-16 Thread Raheel Hasan
I am building it on Commit.. true Please see my other thread for all Logs and Schema + Solrconfig settings. On Mon, Sep 16, 2013 at 7:03 PM, Dyer, James wrote: > I would investigate Hoss's suggestion and look at warming queries. In > some cases I've seen "maxCollationTries" in warming queries

RE: Spellcheck compounded words

2013-09-16 Thread Dyer, James
I would investigate Hoss's suggestion and look at warming queries. In some cases I've seen "maxCollationTries" in warming queries to cause a hang. Unless you're trying to build your spellcheck dictionary during warming, you can safely turn spellcheck off for all warming queries. James Dyer In

Re: Solr Java Client

2013-09-16 Thread Baskar Sikkayan
Hi Gora, Thanks a lot for your reply. "As people have already advised you, the best way to decide how to organise your data in the Solr index depends on the searches that you want to make. This is not entirely clear from your description above. The flattening sample that you show above would b

Re: Spellcheck compounded words

2013-09-16 Thread Raheel Hasan
Hi, I m running 4.3.. I have posted all the details in another threat... do you want me to copy it here? or could you see that? The subject is "*spellcheck causing Core Reload to hang*". On Mon, Sep 16, 2013 at 5:50 PM, Dyer, James wrote: > Which version of Solr are you running? (the post yo

Re: Solr Java Client

2013-09-16 Thread Gora Mohanty
On 16 September 2013 02:47, Baskar Sikkayan wrote: [...] > Have a question now. > > I know in solr its flat file system and the data will be in denormalized > form. > > My question : > > Have 3 tables, > > 1) user (userid, firstname, lastname, ...) > 2) master (masterid, skills, ...) > 3) child (

Re: 2 question about solr and lucene

2013-09-16 Thread Erick Erickson
Are you saying you're trying to put payloads on the numeric data? If that's the case I don't know how that works. But a couple of things: sinaTag:operate and followersCount:[752 TO 752] is incorrect, you must capitalize the and as sinaTag:operate AND followersCount:[752 TO 752] Your syntax _sho

Slow query at first time

2013-09-16 Thread Sergio Stateri
Hi, I´m trying to make a search with Solr 4.4, but in the first time the search is too slow. I have studied about pre-warm queries, but the query response is the same after putting it. Can anyone help me? Here´s a piece of solrconfig.xml: codigoRoteiro:95240816 0 20 in the schem

Re: How to make Solr complex Join Query patch in java

2013-09-16 Thread Erick Erickson
I'd start by taking a very hard look at my data model and seeing if I can make redefine the model (as translated from the DB you may be coming from). Solr does not excel at what RDBMSs are designed to do. Really. I predict that if you just try to make Solr into a RDMBS, you'll expend a lot of effor

how soft-commit works

2013-09-16 Thread Matteo Grolla
Can anyone explain me the following things about soft-commit? -For searches o access new documents I think a new searcher is opened after a soft commit. How does the near realtime requirement for soft commit match with the potentially long time taken to warm up caches for the new searcher

Re: Frequent softCommits leading to high faceting times?

2013-09-16 Thread Erick Erickson
Soft commits are not free, they invalidate certain caches which then have to be reloaded. I suspect you're hitting this big time. The question is always "do you really, really _need_ 1 second latency?". Set the soft commit interval to be as long as your application can stand IMO. And it may have n

RE: Spellcheck compounded words

2013-09-16 Thread Dyer, James
Which version of Solr are you running? (the post you replied to was about Solr 3.3, but the latest version now is 4.4.) Please provide configuration details and the query you are running that causes the problem. Also explain exactly what the problem is (query never returns?). Also explain why

Re-Ranking results based on DocValues with custom function.

2013-09-16 Thread Mathias Lux
Hi! I'm having quite an index with a lot of text and some binary data in the documents (numeric vectors of arbitrary size with associated dissimilarity functions). What I want to do is to search using common text search and then (optionally) re-rank using some custom function like http://localhos

2 question about solr and lucene

2013-09-16 Thread Robin Wei
Hi, guys: I met two questions about solr and lucene, wish people to help out. use payload query but can NOT with numerical field type. for example: I implemented my own requesthandler, refer to http://hnagtech.wordpress.com/2013/04/19/using-payloads-with-solr-4-x/

Re: Spellcheck compounded words

2013-09-16 Thread Rah1x
Hi guyz, Did anyone solve this issue? I am having it also, it took me 3 days to exactly figure it out that its coming from "spellcheck.maxCollationTries"... Even with 1 it hangs forewver. The only way to restart is to stop solr, delete "data" folder and then start solr again (i.e. index lost !).

How to make Solr complex Join Query patch in java

2013-09-16 Thread ashimbose
Hi, Can anyone have any idea how to write a patch in java which will support for complex join query in solr. I have the solr source code. If you have any sample code for the same, please share with me. Thanks Ashim -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-mak

Stop zookeeper from batch

2013-09-16 Thread Prasi S
Hi, We have setup solrcloud with zookeeper and 2 tomcats . we are using a batch file to start the zookeeper, uplink config files and start tomcats. Now, i need to stop zookeeper from the batch file. How is this possible. Im using Windows server. Zookeeper 3.4.5 version. Pls help. Thanks, Prasi

Re: Storing/indexing speed drops quickly

2013-09-16 Thread Toke Eskildsen
On Fri, 2013-09-13 at 17:32 +0200, Shawn Heisey wrote: > Put your OS and Solr itself on regular disks in RAID1 and your Solr data > on the SSD. Due to the eventual decay caused by writes, SSD will > eventually die, so be ready for SSD failures to take out shard replicas. One of the very useful

Re: solr/document/select not available

2013-09-16 Thread Upayavira
If you have two cores, then the core name should be in your URL. Http://host:8983/solr//select?q=blah Or you can set a default core in solr.xml. Upayavira On Sun, Sep 15, 2013, at 12:16 PM, Nutan wrote: > I get this error : solr/select not available.I am using two cores > document > and contract

Re: spellcheck causing Core Reload to hang

2013-09-16 Thread Raheel Hasan
Please see the log (after solr restart) in the other msg I posted on this forum with the subject: "*Unable to connect" to "http://localhost:8983/solr/ *" Thanks. On Mon, Sep 16, 2013 at 12:25 PM, Raheel Hasan wrote: > Yes I have tried Spellcheck=false and with that everything works just > fine

Re: what does "UnInvertedField; UnInverted multi-valued field" means and how to fix it

2013-09-16 Thread Raheel Hasan
Hay, thanks for the reply. So after a full day spent only on trying to figure this out, I have found the cause (spellcheck component)... but not the solution. Se my other post with the subject "*spellcheck causing Core Reload to hang*". I have explained it there. Thanks a lot. On Sun, Sep 15,

Re: spellcheck causing Core Reload to hang

2013-09-16 Thread Raheel Hasan
Yes I have tried Spellcheck=false and with that everything works just fine. But I do need Spell check component so I cant just leave it off. On Mon, Sep 16, 2013 at 12:24 PM, Raheel Hasan wrote: > Hi, > > Basically, it hangs only on "core Reload" and not during queries. > Furthermore, there is n

Re: spellcheck causing Core Reload to hang

2013-09-16 Thread Raheel Hasan
Hi, Basically, it hangs only on "core Reload" and not during queries. Furthermore, there is never any error reported in the logs, in fact the log only records until Core-Reload call. If I shut down and restart Solr, the next time it wont start, and still no errors in the log. On Sat, Sep 14, 2