RE: Display of highlighted search result should start with the beginning of the sentence that contains the search string.

2012-02-07 Thread Shyam Bhaskaran
Hi Koji, Thanks for the response when I use hl.bs.chars=".!?" and hl.bs.maxScan=200 I see improvements, below is the highlighted value "The synthesis tool only supports the resolution functions for std_logic and std_logic_vector." But in other cases I also see that some of the words break in

RE: Display of highlighted search result should start with the beginning of the sentence that contains the search string.

2012-02-07 Thread Shyam Bhaskaran
Hi Koji, I have tried using hl.bs.type=SENTENCE and still no improvement. We are storing PDF extracted content in the field which has termVectors enabled. Example the field contains the following data extracted from PDF "User-defined resolution functions. The synthesis tool only supports the r

Display of highlighted search result should start with the beginning of the sentence that contains the search string.

2012-02-07 Thread Shyam Bhaskaran
Hi, We are using Solr 4.0 along with FVH and there is an issue we are facing while highlighting. For our requirement we want the highlighted search result should start with the beginning of the sentence and needed help to get this done. As of now this is not happening and the highlighted output

RE: removing write.lock file in solr after indexing

2012-01-31 Thread Shyam Bhaskaran
Hi Erick, I was able to resolve the issue with 'write.lock' files. Using container.remove("core1") or using container.shutdown() is helping to remove the 'write.lock' files. -Shyam

RE: removing write.lock file in solr after indexing

2012-01-31 Thread Shyam Bhaskaran
re details on how you do your indexing? Best Erick On Tue, Jan 31, 2012 at 8:59 AM, Erick Erickson wrote: > On Mon, Jan 30, 2012 at 2:42 AM, Shyam Bhaskaran > wrote: >> Hi, >> >> We are using Solr 4.0 and after indexing every time it is observed that the >> write

removing write.lock file in solr after indexing

2012-01-29 Thread Shyam Bhaskaran
Hi, We are using Solr 4.0 and after indexing every time it is observed that the write.lock remains without getting cleared and for the next indexing we have to delete the file to get the indexing process running. We use SolrServer for our indexing and I do not see any methods to close or clea

RE: Question on Reverse Indexing

2012-01-20 Thread Shyam Bhaskaran
occurrences of setAllowLeadingWildcard() method, in which places does it set allowLeadingWildcard to true? On Thu, Jan 19, 2012 at 3:00 PM, Shyam Bhaskaran < shyam.bhaska...@synopsys.com> wrote: > Dimitry, > > Our custom tokenizer is similar to standard tokenizer, just for testing I >

RE: Question on Reverse Indexing

2012-01-19 Thread Shyam Bhaskaran
tain billions (depending on data variation). Also, since you said you use 4.0, did also build it from source code your self or used some pre-built package? On Thu, Jan 19, 2012 at 1:06 PM, Shyam Bhaskaran < shyam.bhaska...@synopsys.com> wrote: > Dimitry, > > Yes my app and th

RE: Question on Reverse Indexing

2012-01-19 Thread Shyam Bhaskaran
from schema and searchers from solrconfig. Do you have any custom query parser implementations or any other custom components? On Thu, Jan 19, 2012 at 9:26 AM, Shyam Bhaskaran < shyam.bhaska...@synopsys.com> wrote: > Dimitry, > > I have used lukeall-3.5.0.jar and when trying to ope

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
C:\lukeall-3.5.0.jar org.getopt.luke.Luke -index C:\solr\home\data\docs_index\index\ We are using Solr 4.0 -Shyam -Original Message- From: Shyam Bhaskaran [mailto:shyam.bhaska...@synopsys.com] Sent: Thursday, January 19, 2012 11:49 AM To: solr-user@lucene.apache.org Subject: RE: Question on Rever

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
Dimitry, I downloaded Luke but it was not working for me against solr indexes. But using the solr analysis page I did not find any reversed sequences on the field. -Shyam -Original Message- From: Shyam Bhaskaran [mailto:shyam.bhaska...@synopsys.com] Sent: Thursday, January 19, 2012

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
field, and see if it still contains reversed sequences. On Wed, Jan 18, 2012 at 1:09 PM, Shyam Bhaskaran < shyam.bhaska...@synopsys.com> wrote: > Dimitry, > > We are using Solr 4.0. To confirm server caching issues I have restarted > our tomcat webserver after perform

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
n 18, 2012 at 12:35 PM, Shyam Bhaskaran < shyam.bhaska...@synopsys.com> wrote: > Dimitry, > > Using http://localhost:7070/solr/docs/admin/analysis.jsp passed the query > *lock and did not find ReversedWildcardFilterFactory to the indexer or any > other filters that cou

RE: Question on Reverse Indexing

2012-01-18 Thread Shyam Bhaskaran
dictionary (more or less), maybe the drop in performance that you are > seeing is a result of that? > > François > > On Jan 17, 2012, at 9:01 PM, Shyam Bhaskaran wrote: > > > Hi, > > > > For reverse indexing we are using the ReversedWild

RE: Question on Reverse Indexing

2012-01-17 Thread Shyam Bhaskaran
To: solr-user@lucene.apache.org Subject: Re: Question on Reverse Indexing Using ReversedWildcardFilterFactory will double the size of your dictionary (more or less), maybe the drop in performance that you are seeing is a result of that? François On Jan 17, 2012, at 9:01 PM, Shyam Bhaskaran

Question on Reverse Indexing

2012-01-17 Thread Shyam Bhaskaran
Hi, For reverse indexing we are using the ReversedWildcardFilterFactory on Solr 4.0 ReversedWildcardFilterFactory was helping us to perform leading wild card searches like *lock. But it was observed that the performance of the searches was not good after introducing ReversedWildcardFilterF

RE: Profiling Solr

2011-12-22 Thread Shyam Bhaskaran
this highlighting overhead and wanted to find more details using Solr Profiling. Let me know for any suggestions. -Shyam -Original Message- From: shyam bhaskaran [mailto:shyam.bhaska...@gmail.com] Sent: Friday, December 23, 2011 6:26 AM To: solr-user@lucene.apache.org Subject: Re

Re: Profiling Solr

2011-12-22 Thread shyam bhaskaran
Hi Jean, I am also looking into Profiling Solr and wanted to check with you whether you were able to use YourKit successfully for Solr Profiling and were you able to find out the bottleneck with your situation. Can you share how you were able to find out the performance bottleneck and fix the iss

RE: Highlighter highlighting terms which are not part of the search

2011-12-15 Thread Shyam Bhaskaran
e.org/solr/UsingMailingLists Best Erick On Mon, Dec 12, 2011 at 12:04 AM, Shyam Bhaskaran wrote: > Hi > > We recently upgraded our Solr to the latest 4.0 trunk and we are seeing a > weird behavior with highlighting which was not seen earlier. > > When a search query for example "ge

Highlighter highlighting terms which are not part of the search

2011-12-11 Thread Shyam Bhaskaran
Hi We recently upgraded our Solr to the latest 4.0 trunk and we are seeing a weird behavior with highlighting which was not seen earlier. When a search query for example "generate test pattern" is passed in the results et obtained the first few results shows the highlighting properly but in th

RE: highlighting performance poor with *.tar, *.gz files

2011-11-25 Thread Shyam Bhaskaran
trieve%29%7C%28contents%29 But highlighting compressed files seems like an odd use-case, what is the business reason you need to do this? Best Erick On Thu, Nov 24, 2011 at 10:28 AM, Shyam Bhaskaran wrote: > Hi, > > It is observed that highlighting of search results is taking too much t

highlighting performance poor with *.tar, *.gz files

2011-11-24 Thread Shyam Bhaskaran
Hi, It is observed that highlighting of search results is taking too much time especially for highlighting terms for archived files like *.gz, *.tar, *.zip. What could be the reason behind it ? Is it because these files are unzipped and then highlighted from the index during display time ? Or is

Different maxAnalyzedChars value in solrconfig.xml

2011-11-15 Thread Shyam Bhaskaran
Hi, Wanted to know whether we can set different maxAnalyzedChars values in the solrconfig.xml based on different fields. Can someone point if this is possible at all, my requirement needs me to set different values for maxAnalyzedChars parameter based on two different field values. For exampl

Highlighting is not working for wildcard searches when TermVectors (hl.useFastVectorHighlighter) is enabled

2011-11-11 Thread Shyam Bhaskaran
Hi, Highlighting is not working for wildcard searches when TermVectors (hl.useFastVectorHighlighter) is enabled. I wanted to use FastVectorHighlighter to improve the performance of search results but when hl.useFastVectorHighlighter is enabled highlighting does not work in case of wildcard sea