firstSearcher and newSearcher loading external files

2015-10-28 Thread Summer Shire
Hi All, I use value source parser to load external file that contains popularity values. The way I use it is by passing a "signals" param in the query now I want to warm up this external cache in solr before the actual traffic starts coming in. What is happening is that the cache does not get

Re: Tlog replay

2015-07-08 Thread Summer Shire
with the update log. used when applying reordered DBQ updates when doing an add. So the flag =2 is actually saying that the update command is from replaying a log ( which is what you would expect) Cheers 2015-07-08 3:01 GMT+01:00 Summer Shire shiresum...@gmail.com: Hi, When I restart my

Re: Too many Soft commits and opening searchers realtime

2015-07-08 Thread Summer Shire
along with the hard commit. -Yonik On Tue, Jul 7, 2015 at 5:29 PM, Summer Shire shiresum...@gmail.com wrote: HI All, Can someone help me understand the following behavior. I have the following maxTimes on hard and soft commits yet I see a lot of Opening Searchers in the log

Too many Soft commits and opening searchers realtime

2015-07-07 Thread Summer Shire
HI All, Can someone help me understand the following behavior. I have the following maxTimes on hard and soft commits yet I see a lot of Opening Searchers in the log org.apache.solr.search.SolrIndexSearcher- Opening Searcher@1656a258[main] realtime also I see a soft commit happening almost

Re: Too many Soft commits and opening searchers realtime

2015-07-07 Thread Summer Shire
No the client lets solr handle it. On Jul 7, 2015, at 2:38 PM, Mike Drob mad...@cloudera.com wrote: Are the clients that are posting updates requesting commits? On Tue, Jul 7, 2015 at 4:29 PM, Summer Shire shiresum...@gmail.com wrote: HI All, Can someone help me understand

Tlog replay

2015-07-07 Thread Summer Shire
Hi, When I restart my solr core the log replay starts and just before it finishes I see the following commit start commit{flags=2,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} what does the “flags=2” param do ? when I try to

Re: optimize status

2015-07-02 Thread Summer Shire
. What version of Solr are you using? Can you confirm that your config is using the TieredMergePolicy? Upayavira Oe, Jun 30, 2015, at 04:48 AM, Summer Shire wrote: Hi Upayavira and Erick, There are two things we are talking about here. First: Why am I optimizing? If I don’t our SEARCH

Re: optimize status

2015-06-29 Thread Summer Shire
On Sun, Jun 28, 2015, at 09:37 PM, Summer Shire wrote: Hi All, I have two indexers (Independent processes ) writing to a common solr core. If One indexer process issued an optimize on the core I want the second indexer to wait adding docs until the optimize has finished

Re: optimize status

2015-06-29 Thread Summer Shire
existed. This is, of course, assuming you are using something like Solr 3.5+. Upayavira On Mon, Jun 29, 2015, at 08:08 AM, Summer Shire wrote: Have to cause of performance issues. Just want to know if there is a way to tap into the status. On Jun 28, 2015, at 11:37 PM, Upayavira u

optimize status

2015-06-28 Thread Summer Shire
Hi All, I have two indexers (Independent processes ) writing to a common solr core. If One indexer process issued an optimize on the core I want the second indexer to wait adding docs until the optimize has finished. Are there ways I can do this programmatically? pinging the core when the

optimize status

2015-06-28 Thread Summer Shire
Hi All, I have two indexers (Independent processes ) writing to a common solr core. If One indexer process issued an optimize on the core I want the second indexer to wait adding docs until the optimize has finished. Are there ways I can do this programmatically? pinging the core when the

Re: invalid index version and generation

2015-06-15 Thread Summer Shire
Anyone have any suggestions on things I could try ? Does it seem like a solr bug ? On Jun 14, 2015, at 9:40 PM, Summer Shire shiresum...@gmail.com wrote: Hi all, Every time I optimize my index with maxSegment=2 after some time the replication fails to get filelist for a given generation

invalid index version and generation

2015-06-14 Thread Summer Shire
Hi all, Every time I optimize my index with maxSegment=2 after some time the replication fails to get filelist for a given generation. Looks like the index version and generation count gets messed up. (If the maxSegment=1 this never happens. I am able to successfully reproduce this by

Re: Java 7/8 OOM exception when adding documents to httpSolrServer

2015-04-11 Thread Summer Shire
...@elyograg.org wrote: On 4/9/2015 9:51 PM, Summer Shire wrote: I was adding 1000 docs at a time but later I changed it to 10 and I am still getting the exception. The reason I added the integer.max_value code was because I googled for what could be causing the OOM and clearly the size of an array

Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-13 Thread Summer Shire
Hi All, Did anyone get a chance to look at my config and the InfoStream File ? I am very curious to see what you think thanks, Summer On Mar 6, 2015, at 5:20 PM, Summer Shire shiresum...@gmail.com wrote: Hi All, Here’s more update on where I am at with this. I enabled infoStream

Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-06 Thread Summer Shire
Hi All, Here’s more update on where I am at with this. I enabled infoStream logging and quickly figured that I need to get rid of maxBufferedDocs. So Erick you were absolutely right on that. I increased my ramBufferSize to 100MB and reduced maxMergeAtOnce to 3 and segmentsPerTier to 3 as well.

solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-04 Thread Summer Shire
Hi All, I am using solr 4.7.2 is there a bug wrt merging the segments down ? I recently added the following to my solrConfig.xml indexConfig useCompoundFilefalse/useCompoundFile ramBufferSizeMB100/ramBufferSizeMB maxBufferedDocs1000/maxBufferedDocs mergeFactor5/mergeFactor

Re: solr 4.7.2 mergeFactor/ Merge policy issue

2015-03-04 Thread Summer Shire
_think_, but don't know for sure, that the merging stuff doesn't get triggered until you commit, it doesn't just happen. Shot in the dark... Erick On Wed, Mar 4, 2015 at 1:15 PM, Summer Shire shiresum...@gmail.com wrote: Hi All, I am using solr 4.7.2 is there a bug wrt merging the segments

Solr 4.7.2 mergeFactor

2015-03-03 Thread Summer Shire
Hi All, I am using solr 4.7.2 is there a bug wrt merging the segments down ? I recently added the following to my solrConfig.xml indexConfig useCompoundFilefalse/useCompoundFile ramBufferSizeMB100/ramBufferSizeMB maxBufferedDocs1000/maxBufferedDocs mergeFactor5/mergeFactor

Weird Solr Replication Slave out of sync

2015-02-16 Thread Summer Shire
Hi All, My master and slave index version and generation is the same yet the index is not in sync because when I execute the same query on both master and slave I see old docs on slave which should not be there. I also tried to fetch a specific indexversion on slave using

FirstSearcher and NewSearcher only on slaves

2015-02-01 Thread Summer Shire
HI Guys, Is there way to specify the newSearchers and firstSearchers different for master vs slave ? listener event=newSearcher class=solr.QuerySenderListener” listener event=firstSearcher class=solr.QuerySenderListener” I do not have separate solrConfig.xml for slave vs master. I simply have

Solr admin Url issues

2015-01-26 Thread Summer Shire
Hi All, Running solr (4.7.2) locally and hitting the admin page like this works just fine http://localhost:8983/solr/ http://localhost:8983/solr/## http://localhost:8983/solr/# But on my deployment server my path is http://example.org/jetty/MyApp/1/solr/#

Re: Solr admin Url issues

2015-01-26 Thread Summer Shire
proxy in front? On Mon, Jan 26, 2015 at 11:02 PM, Summer Shire shiresum...@gmail.com wrote: Hi All, Running solr (4.7.2) locally and hitting the admin page like this works just fine http://localhost:8983/solr/ http://localhost:8983/solr/## http://localhost:8983/solr/# But on my

Re: Any way to view lucene files

2014-06-07 Thread Summer Shire
Did u try luke 47 On Jun 6, 2014, at 11:59 PM, Aman Tandon amantandon...@gmail.com wrote: I also tried with solr 4.2 and with luke version Luke 4.0.0-ALPHA but got this error: java.lang.IllegalArgumentException: A SPI class of type org.apache.lucene.codecs.Codec with name 'Lucene42'

Re: Solr 4.7.2 ValueSourceParser classCast exception

2014-06-03 Thread Summer Shire
jars so that the class signature (extends, implements, and constructors) matches the Solr 4.7.2 jars? I mean, Java is simply complaining that your class is not a valid value source class of the specified type. -- Jack Krupansky -Original Message- From: Summer Shire Sent: Friday, May 23

Solr 4.7.2 ValueSourceParser classCast exception

2014-05-23 Thread Summer Shire
Hi All, I have my own popularity value source class and I let solr know about it via solrconfig.xml valueSourceParser name=popularity class=mysolr.sources.PopValueSourceParser / But then I get the following class cast exception I have tried to make sure there are no old Solr jar files in

ValueSourceParser classCast exception solr 4.7.2

2014-05-22 Thread Summer Shire
Hi All, I have my own popularity value source class and I let solr know about it via solrconfig.xml valueSourceParser name=popularity class=mysolr.sources.PopValueSourceParser / But then I get the following class cast exception I have tried to make sure there are no old Solr jar files in the

solr scoring

2014-01-28 Thread Summer Shire
Hi All, I have a scenario where for example my document titles are 1. battle of the zords 2. joes battle 3. who was in that crazy battle. and if the search term is [battle] I want to penalize the second and third document score because battle was matched further down than in the first

Overriding DefaultSimilarity Cast Exception 4.5.1

2014-01-27 Thread Summer Shire
Hi all, I am using Solr and Lucene 4.5.1 and I have a Payload Similarity that extends DefaultSimilarity my schema.xml specifies the default Similarity tag similarity class=mypackage.PayloadSimilarity/ /** my similarity class**/ public class PayloadSimilarity extends DefaultSimilarity {

Re: Overriding DefaultSimilarity Cast Exception 4.5.1

2014-01-27 Thread Summer Shire
Thanks Chris for a quick response. But I verified that I only have the following jars lucene-analyzers-common-4.5.1 lucene-core-4.5.1 lucene-queries-4.5.1 lucene-spatial-4.5.1 solr-solrj-4.5.1 they are all the same version. Also how can I verify the classpath ? Since I do not have other

Re: Overriding DefaultSimilarity Cast Exception 4.5.1

2014-01-27 Thread Summer Shire
Hi Shawn and Chris, your inputs Helped I figured it out from all these links and also what Chris mentioned. Thanks, Summer On Jan 27, 2014, at 5:54 PM, Shawn Heisey s...@elyograg.org wrote: On 1/27/2014 5:41 PM, Summer Shire wrote: Caused by: java.lang.ClassCastException