Thanks for your response Binoy. Yes.I am looking for any alternative to this. With long number of fileds, url will become long and might lead to "url too long exception" when using http request.
On 16 February 2016 at 11:01, Binoy Dalal <binoydala...@gmail.com> wrote: > Filling in the fl parameter with all the required fields is what we do at > my project as well, and I don't think there is any alternative to this. > > Maybe somebody else can advise on this? > > On Tue, 16 Feb 2016, 10:30 Anil <anilk...@gmail.com> wrote: > > > Any help on this ? Thanks. > > > > On 15 February 2016 at 19:06, Anil <anilk...@gmail.com> wrote: > > > > > Yes. But i have long list of fields. > > > > > > i feel adding all the fileds in fl is not good practice unless one > > > interested in few fields. In my case, i am interested in all fields > > except > > > the one . > > > > > > is there any alternative approach ? Thanks in advance. > > > > > > > > > > > > On 15 February 2016 at 17:27, Binoy Dalal <binoydala...@gmail.com> > > wrote: > > > > > >> If I understand correctly, you have already highlighted the field and > > only > > >> want to return the highlights and not the field itself. > > >> Well in that case, simply remove the field name from your fl list. > > >> > > >> On Mon, 15 Feb 2016, 17:04 Anil <anilk...@gmail.com> wrote: > > >> > > >> > HOw can highlighted field excluded in the main result ? as it is > > >> available > > >> > in the highlight section. > > >> > > > >> > In my scenario, One filed (lets say commands) of the each solr > > document > > >> > would be around 10 mg. I dont want to fetch that filed in response > > when > > >> its > > >> > highlight snippets available in the response. > > >> > > > >> > Please advice. > > >> > > > >> > > > >> > > > >> > On 15 February 2016 at 15:36, Evert R. <evert.ra...@gmail.com> > wrote: > > >> > > > >> > > Hello Mark, > > >> > > > > >> > > Thanks for you reply. > > >> > > > > >> > > All text is indexed (1 pdf file). It works now. > > >> > > > > >> > > Best regard, > > >> > > > > >> > > > > >> > > *--Evert* > > >> > > > > >> > > 2016-02-14 23:47 GMT-02:00 Mark Ehle <marke...@gmail.com>: > > >> > > > > >> > > > is all the text being indexed? Check to make sure that there's > > >> actually > > >> > > the > > >> > > > data you are looking for in the index. Is there a setting in > tika > > >> that > > >> > > > limits how much is indexed? I seem to remember confronting this > > >> problem > > >> > > > myself once, and the data that I wanted just wasn't in the index > > >> > because > > >> > > it > > >> > > > was never put there in the first place.Something about > > >> > setMaxStringLength > > >> > > > orsomething. > > >> > > > > > >> > > > On Sun, Feb 14, 2016 at 8:28 PM, Binoy Dalal < > > >> binoydala...@gmail.com> > > >> > > > wrote: > > >> > > > > > >> > > > > What you've done so far will highlight every instance of > > "nietava" > > >> > > found > > >> > > > in > > >> > > > > the field, and return it, i.e., your entire field will return > > with > > >> > all > > >> > > > the > > >> > > > > "nietava"s in <em> tags. > > >> > > > > If you do not want the entire field, only portions of your > field > > >> > > > containing > > >> > > > > the matched terms, then use hl.snippets parameter = the number > > of > > >> > > > snippets > > >> > > > > you want, in this particular case 3, along with the > hl.fragsize > > >> > > parameter > > >> > > > > set to the same number as your hl.mazAnalyzedChars (or a > really > > >> large > > >> > > > > number). > > >> > > > > > > >> > > > > I suggest you go through the wiki documentation for > highlighting > > >> > once ( > > >> > > > > https://wiki.apache.org/solr/HighlightingParameters). It > should > > >> > answer > > >> > > > all > > >> > > > > of your questions regarding the use of the standard > highlighter > > >> that > > >> > > you > > >> > > > > might have. > > >> > > > > > > >> > > > > As an additional note, I also suggest that you look into the > > >> > > > > PostingsHighlighter ( > > >> > > > > > > >> > > https://cwiki.apache.org/confluence/display/solr/Postings+Highlighter > > >> > > ), > > >> > > > > since you seem to be running highlighting on pretty big fields > > and > > >> > > > postings > > >> > > > > is much more efficient at highlighting huge fields as compared > > to > > >> the > > >> > > > > standard highlighter. > > >> > > > > > > >> > > > > On Mon, Feb 15, 2016 at 4:15 AM Evert R. < > evert.ra...@gmail.com > > > > > >> > > wrote: > > >> > > > > > > >> > > > > > Binoy, > > >> > > > > > > > >> > > > > > You are the man! =) > > >> > > > > > > > >> > > > > > Thank you very much! > > >> > > > > > > > >> > > > > > Would you by chance know how could I get the second > highlight > > of > > >> > the > > >> > > > same > > >> > > > > > word in the same file? > > >> > > > > > > > >> > > > > > Like: file_1.pdf (has three words "nietava") so..., how can > I > > >> bring > > >> > > the > > >> > > > > > highlighs for the three occurrences? > > >> > > > > > > > >> > > > > > I am pretty new around, should I send (open) another > subject? > > >> > > > > > > > >> > > > > > Thanks again! > > >> > > > > > > > >> > > > > > > > >> > > > > > *--Evert* > > >> > > > > > > > >> > > > > > 2016-02-14 16:40 GMT-02:00 Binoy Dalal < > > binoydala...@gmail.com > > >> >: > > >> > > > > > > > >> > > > > > > Are you sure you've typed in the parameters correctly? > > >> > > > > > > In your response it says flagsize instead of fragsize and > > >> > > > > > maxanalzyedchars > > >> > > > > > > instead of maxanalyzedchars. > > >> > > > > > > > > >> > > > > > > Ohh wait, I see that I made the analyzed typo. Awfully > sorry > > >> for > > >> > > > that, > > >> > > > > > I'm > > >> > > > > > > using my phone to send the mail out. > > >> > > > > > > > > >> > > > > > > On Sun, 14 Feb 2016, 23:53 Evert R. < > evert.ra...@gmail.com> > > >> > wrote: > > >> > > > > > > > > >> > > > > > > > Hi Binoy, > > >> > > > > > > > > > >> > > > > > > > thanks! > > >> > > > > > > > > > >> > > > > > > > Still not working, check the output: > > >> > > > > > > > > > >> > > > > > > > { > > >> > > > > > > > "responseHeader":{ > > >> > > > > > > > "status":0, > > >> > > > > > > > "QTime":58, > > >> > > > > > > > "params":{ > > >> > > > > > > > "q":"nietava", > > >> > > > > > > > "hl":"true", > > >> > > > > > > > "hl.simple.post":"</em>", > > >> > > > > > > > "indent":"true", > > >> > > > > > > > "fl":"id", > > >> > > > > > > > "hl.flagsize":"0", > > >> > > > > > > > "hl.fl":"content", > > >> > > > > > > > "hl.maxAnalzyedChars":"208400", > > >> > > > > > > > "wt":"json", > > >> > > > > > > > "hl.simple.pre":"<em>"}}, > > >> > > > > > > > "response":{"numFound":1,"start":0,"docs":[ > > >> > > > > > > > { > > >> > > > > > > > "id":"/home/solr/dados/teste/Emmanuel.pdf"}] > > >> > > > > > > > }, > > >> > > > > > > > "highlighting":{ > > >> > > > > > > > "/home/solr/dados/teste/Emmanuel.pdf":{}}} > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > *--Evert* > > >> > > > > > > > > > >> > > > > > > > 2016-02-14 14:31 GMT-02:00 Binoy Dalal < > > >> binoydala...@gmail.com > > >> > >: > > >> > > > > > > > > > >> > > > > > > > > Don't add this parameter to the searchComponent > > >> definition, > > >> > > > because > > >> > > > > > the > > >> > > > > > > > > components where you've added it, GapFragmenter and > > >> > > > > RegexFragmenter, > > >> > > > > > > > simply > > >> > > > > > > > > don't use it. > > >> > > > > > > > > Instead, add it to your request handler (/select etc.) > > if > > >> > > you've > > >> > > > > > > > configured > > >> > > > > > > > > highlighting in the handler or append it to your > query: > > >> > > > > > > > > *&hl.maxAnalzyedChars=<some_really_big_number>*. > > >> > > > > > > > > Additionally also set the *hl.fragsize parameter to > 0*, > > if > > >> > your > > >> > > > > text > > >> > > > > > is > > >> > > > > > > > > larger than 51200 chars which it mostly is, in a > similar > > >> > > fashion. > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > On Sun, Feb 14, 2016 at 9:02 PM Evert R. < > > >> > > evert.ra...@gmail.com> > > >> > > > > > > wrote: > > >> > > > > > > > > > > >> > > > > > > > > > Hi Binoy, > > >> > > > > > > > > > > > >> > > > > > > > > > I could not find this option in my solrconfig.xml > > file. > > >> ] > > >> > > > > > > > > > > > >> > > > > > > > > > I tryied to add this setting and nothing changed... > > >> > > > > > > > > > > > >> > > > > > > > > > Here is the code, I might miss placed: > > >> > > > > > > > > > > > >> > > > > > > > > > <code> > > >> > > > > > > > > > <searchComponent class="solr.HighlightComponent" > > >> > > > > name="highlight"> > > >> > > > > > > > > > <highlighting> > > >> > > > > > > > > > <!-- Configure the standard fragmenter --> > > >> > > > > > > > > > <!-- This could most likely be commented out > in > > >> the > > >> > > > > "default" > > >> > > > > > > > case > > >> > > > > > > > > > --> > > >> > > > > > > > > > <fragmenter name="gap" > > >> > > > > > > > > > default="true" > > >> > > > > > > > > > > > class="solr.highlight.GapFragmenter"> > > >> > > > > > > > > > <lst name="defaults"> > > >> > > > > > > > > > <int name="hl.fragsize">400</int> > > >> > > > > > > > > > <int > name="hl.maxAnalyzedChars">409600</int> > > >> > > > > > > > > > </lst> > > >> > > > > > > > > > </fragmenter> > > >> > > > > > > > > > > > >> > > > > > > > > > <!-- A regular-expression-based fragmenter > > >> > > > > > > > > > (for sentence extraction) > > >> > > > > > > > > > --> > > >> > > > > > > > > > <fragmenter name="regex" > > >> > > > > > > > > > > > >> class="solr.highlight.RegexFragmenter"> > > >> > > > > > > > > > <lst name="defaults"> > > >> > > > > > > > > > <!-- slightly smaller fragsizes work > better > > >> > because > > >> > > > of > > >> > > > > > slop > > >> > > > > > > > --> > > >> > > > > > > > > > <int name="hl.fragsize">200</int> > > >> > > > > > > > > > <int > name="hl.maxAnalyzedChars">409600</int> > > >> > > > > > > > > > <!-- allow 50% slop on fragment sizes --> > > >> > > > > > > > > > <float name="hl.regex.slop">0.5</float> > > >> > > > > > > > > > <!-- a basic sentence pattern --> > > >> > > > > > > > > > <str name="hl.regex.pattern">[-\w > > >> > > > > > > > > > ,/\n\"']{20,200}</str> > > >> > > > > > > > > > </lst> > > >> > > > > > > > > > </fragmenter> > > >> > > > > > > > > > > > >> > > > > > > > > > </code> > > >> > > > > > > > > > > > >> > > > > > > > > > thanks! > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > *--Evert* > > >> > > > > > > > > > > > >> > > > > > > > > > 2016-02-14 12:14 GMT-02:00 Binoy Dalal < > > >> > > binoydala...@gmail.com > > >> > > > >: > > >> > > > > > > > > > > > >> > > > > > > > > > > From the solr wiki: > > >> > > > > > > > > > > hl.maxAnalyzedChars > > >> > > > > > > > > > > > > >> > > > > > > > > > > How many characters into a document to look for > > >> suitable > > >> > > > > > > > > > > snippets  Solr1.3. This parameter makes sense for > > the > > >> > > > original > > >> > > > > > > > > > Highlighter > > >> > > > > > > > > > > only. > > >> > > > > > > > > > > > > >> > > > > > > > > > > The default value is "51200". > > >> > > > > > > > > > > > > >> > > > > > > > > > > You can assign a large value to this parameter and > > use > > >> > > > > > > hl.fragsize=0 > > >> > > > > > > > to > > >> > > > > > > > > > > return highlighting in large fields that have size > > >> > greater > > >> > > > than > > >> > > > > > > 51200 > > >> > > > > > > > > > > characters. > > >> > > > > > > > > > > > > >> > > > > > > > > > > I think this might be your hiccup. > > >> > > > > > > > > > > > > >> > > > > > > > > > > On Sun, 14 Feb 2016, 17:11 Evert R. < > > >> > evert.ra...@gmail.com > > >> > > > > > >> > > > > > wrote: > > >> > > > > > > > > > > > > >> > > > > > > > > > > > Hi Paul, > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > Sorry my late reply. > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > All the content is inside de docs. It brings the > > >> docs > > >> > and > > >> > > > the > > >> > > > > > pdf > > >> > > > > > > > > file > > >> > > > > > > > > > > that > > >> > > > > > > > > > > > has the search word in it. But the highlight is > > not > > >> > > showing > > >> > > > > if > > >> > > > > > > the > > >> > > > > > > > > > search > > >> > > > > > > > > > > > word is after a few pages. > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > Evert > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > *--Evert* > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > 2016-02-14 8:36 GMT-02:00 Paul Libbrecht < > > >> > > > p...@hoplahup.net > > >> > > > > >: > > >> > > > > > > > > > > > > > >> > > > > > > > > > > > > This looks like the stored content is > shortened. > > >> Can > > >> > it > > >> > > > be? > > >> > > > > > > > > > > > > Can you see that inside the docs? > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > paul > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > Evert R. <mailto:evert.ra...@gmail.com> > > >> > > > > > > > > > > > > > 14 February 2016 at 11:26 > > >> > > > > > > > > > > > > > Hi There, > > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > I have a situation where started a > > techproducts, > > >> > > > without > > >> > > > > > any > > >> > > > > > > > > > > > > modification, > > >> > > > > > > > > > > > > > post a pdf file. When searching as: > > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > q=text:search_word > > >> > > > > > > > > > > > > > hl=true > > >> > > > > > > > > > > > > > hl.fl=content > > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > It show the highlight accordingly! =) > > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > BUT... *if the "search_word" is after the > > first > > >> > > pages* > > >> > > > in > > >> > > > > > my > > >> > > > > > > > pdf > > >> > > > > > > > > > > file, > > >> > > > > > > > > > > > > > such > > >> > > > > > > > > > > > > > as page 15... > > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > It simply *does not show* *the HIGHLIGHT*... > > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > Does anyone has faced this situation before? > > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > Thanks! > > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > *--Evert* > > >> > > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> > > > > > > > > > > -- > > >> > > > > > > > > > > Regards, > > >> > > > > > > > > > > Binoy Dalal > > >> > > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > -- > > >> > > > > > > > > Regards, > > >> > > > > > > > > Binoy Dalal > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > -- > > >> > > > > > > Regards, > > >> > > > > > > Binoy Dalal > > >> > > > > > > > > >> > > > > > > > >> > > > > -- > > >> > > > > Regards, > > >> > > > > Binoy Dalal > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> -- > > >> Regards, > > >> Binoy Dalal > > >> > > > > > > > > > -- > Regards, > Binoy Dalal >
