Re: SolrCloud performance issues regarding hardware configuration

2014-07-20 Thread search engn dev
Thanks Erick, /"So your choices are either to increase memory (a lot) or not do this. It's a valid question whether this is useful information to present to a user (or are you doing some kind of analytics here?). "/ Yes, You are right my facet queries are for text analytic purpose. Users will

RE: SolrCloud performance issues regarding hardware configuration

2014-07-18 Thread search engn dev
out of 700 million documents 95-97% values are unique approx. My facet query is : http://localhost:8983/solr/select?q=*:*&rows=0&facet=true&facet.limit=1&facet.field=user_digest Above query throws OOM exception as soon as fire it to solr. -- View this message in context: http://lucene.

Re: Understanding query behaviour in LBHttpSolrServer

2014-07-17 Thread search engn dev
Thanks Shawn, I am also not sure about query flow , >From my understanding solr and solrj works as below, 1. LBHttpSolrServer keeps pinging above list of servers and maintains list of live servers. 2. Every time query arives it picks one server from the list (round-robin fashion) 3. Sends que

SolrCloud performance issues regarding hardware configuration

2014-07-17 Thread search engn dev
I need help regarding hardware configuration of my SolrCloud setup. most of the queries to our SolrCloud are boolean queries involving 6-7 fields and spatial and facet queries. currently for facet queries solr throws OOM errors. below are my solrcloud stats, solr version 4.6.1 1 collection : 4 sha

Understanding query behaviour in LBHttpSolrServer

2014-07-17 Thread search engn dev
I just want to understand query flow and how load balancing works in case of LBHttpSolrServer. We have setup SolrCloud with one collection, and that collection has 4 shards and each shard has two nodes i.e one master and one replica. I have configured LBHttpSolrServer as below. SolrServer lbHttpS

Re: Need of hadoop

2014-07-07 Thread search engn dev
It is written here -- View this message in context: http://lucene.472066.n3.nabble.com/Need-of-hadoop-tp4145846p4146033.html Sent from the Solr - User mailing list archive at Nabble.com.

Need of hadoop

2014-07-07 Thread search engn dev
Currently i am exploring hadoop with solr, Somewhere it is written as "This does not use Hadoop Map-Reduce to process Solr data, rather it only uses the HDFS filesystem for index and transaction log file storage. " , then what is the advantage of using using hadoop over local file system? will use

How to stop backup once initiated

2014-03-21 Thread search engn dev
My index size 20 GB and I have issues solr backup command , now this backup is going on its taking too much time , so how can i stop backup command? -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-stop-backup-once-initiated-tp4126020.html Sent from the Solr - User mai

Re: What is mean by Index Searcher?

2014-03-07 Thread search engn dev
Thanks Alex, But what is mean by "...lifetime of that searcher." Is is lifetime of any particular query or what.? Sorry but i am not able to understand this. :( -- View this message in context: http://lucene.472066.n3.nabble.com/What-is-mean-by-Index-Searcher-tp4121898p4121912.html Sent from

What is mean by Index Searcher?

2014-03-06 Thread search engn dev
I am reading apache solr reference guide and it has lines as below ". Solr caches are associated with a specific instance of an Index Searcher, a specific view of an index that doesn't change during the lifetime of that searcher. As long as that Index Searcher is being used, any items in its c

Re: Solr is NoSQL database or not?

2014-03-01 Thread search engn dev
Thank you all for such nice thoughts. Got some more information from here -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-is-NoSQL-database-or-n

Re: Solrmeter with solr 4.6.1

2014-02-27 Thread search engn dev
Thanks Shawn, thanks for the pointer. I will try to checkout latest trunk from solrmeter and will see if i can patch it myself. -- View this message in context: http://lucene.472066.n3.nabble.com/Solrmeter-with-solr-4-6-1-tp4120082p4120092.html Sent from the Solr - User mailing list archive

Solrmeter with solr 4.6.1

2014-02-27 Thread search engn dev
Has anybody used latest solrmeter with solr 4.6.1? because I am getting following error whenever i try to connect to solr. [Thread-384]|ERROR|[com.plugtree.solrmeter.model.statistic.CacheHistoryStatistic]|15:02:52,509 | Could not update statistic com.plugtree.solrmeter.model.exception.StatisticCo

Re: Knowing shard value of result

2014-02-26 Thread search engn dev
Thanks iorixxx, SolrQuery parameters = new SolrQuery(); parameters.set("q","*:*"); parameters.set("fl","Id,STATE_NAME,[shard]"); parameters.set("distrib","true"); QueryResponse response = server.query(parameters); It's working fine now. -- View this message in context: http://lucene.472066.n3

Knowing shard value of result

2014-02-26 Thread search engn dev
I have setup solr cloud of two shards and two replicas. I am using solrj for communicating with solr. We are using CloudSolrServer for searching in solr cloud. below is my code String zkHost = "host1:2181,host1:2182,host1:2183,host1:2184,host1:2185"; CloudSolrSe

Re: how many shards required to search data

2014-02-21 Thread search engn dev
As you suggestedI have indexed 12million sample records in solr on hardware of 8gb ram. Size of index is 3gb. can i extrapolate this to predict actual size of index.? -- View this message in context: http://lucene.472066.n3.nabble.com/how-many-shards-required-to-search-data-tp4118715p4118753.ht

Re: how many shards required to search data

2014-02-20 Thread search engn dev
Shard1 config : Config: 32GB RAM, 4 core Shard2 config : Config: 32GB RAM, 4 core -- View this message in context: http://lucene.472066.n3.nabble.com/how-many-shards-required-to-search-data-tp4118715p4118717.html Sent from the Solr - User mailing list archive at Nabble.com.

how many shards required to search data

2014-02-20 Thread search engn dev
Data size is 250 GB of small records. each record is of around 0.3kb size. It consists around 1 billion records. my index has 20 different fields. . Majorly queries will be very simple or spacial queries mainly on on 2-3 fields. all 20 fields will be stored. Any suggestions on how many shards will

How to retrive all terms with their frequency in that website.

2013-02-21 Thread search engn dev
I have indexed data of 10 websites in solr. Now i want to dump data of each website with following format : [Terms,Frequency of terms in that website ,IDF] Can i do this with solr admin, or i need to write any script for that? -- View this message in context: http://lucene.472066.n3.nabble.co

Hunspell stemmer solr 3.4

2012-05-14 Thread search engn dev
I am currently using solr 3.4 in my application, Currently i cant upgrade solr to 3.5 due to some problem. I want to use hunspell stemmer in solr 3.4 , for doing this which all changes i need to make. -- View this message in context: http://lucene.472066.n3.nabble.com/Hunspell-stemmer-solr-3-4-tp

Re: Difference between two solr indexes

2012-04-17 Thread search engn dev
Thanks Pawel Rog for much needed reply, i'll give try and let u know. -- View this message in context: http://lucene.472066.n3.nabble.com/Difference-between-two-solr-indexes-tp3916328p3918996.html Sent from the Solr - User mailing list archive at Nabble.com.