Re: Difference in q.op param behavior between Solr 6.3 and Solr 8.5.2

2020-09-23 Thread Erik Hatcher
In 6.3 it did that? It shouldn't have. q and fq shouldn't share parameters. fq's themselves shouldn't, IMO, have global defaults. fq's need to be stable and often uniquely specified kinds of constraining query parsers ({!terms/term/field,etc}) or rely on basic Lucene query parser syntax

Re: Best field definition which is only use for filter query.

2020-07-22 Thread Erik Hatcher
> On Jul 22, 2020, at 08:52, raj.yadav wrote: > > Erik Hatcher-4 wrote >> Wouldn’t a “string” field be as good, if not better, for this use case? > > What is the rationale behind this type change to 'string'. How will it speed > up search/filtering? Will it not

Re: Best field definition which is only use for filter query.

2020-07-22 Thread Erik Hatcher
Wouldn’t a “string” field be as good, if not better, for this use case? > On Jul 22, 2020, at 08:02, Erick Erickson wrote: > > fq clauses are just like the q clause except for two things: > 1> no scoring is done > 2> the entire result set _can_ be stored in the filterCache. > > so if a value

Re: Solr heap Old generation grows and it is not recovered by G1GC

2020-07-14 Thread Erik Hatcher
What kind of statistics?Are these stats that you could perhaps get from faceting or the stats component instead of gathering docs and accumulating stats yourself? > On Jul 14, 2020, at 8:51 AM, Odysci wrote: > > Hi Erick, > > I agree. The 300K docs in one search is an anomaly. > But we

Re: 'velocity' does not exist . Do an 'create-queryresponsewriter' , if you want to create it

2020-05-19 Thread Erik Hatcher
Need to also make sure the velocity writer and dependencies are ’d in in solrconfig.xml > On May 19, 2020, at 02:30, Prakhar Kumar > wrote: > > Hello Team, > > I am using Solr 8.5.0 and here is the full log for the error which I am > getting: > > SolrConfigHandler Error checking plugin :

Re: solr payloads performance

2020-05-11 Thread Erik Hatcher
Wei - Here's some details on the various payload capabilities and short-comings: https://lucidworks.com/post/solr-payloads/ SOLR-10541 is the main functional constraint (range faceting over functions). Erik > On May 8, 2020, at 7:26 PM, Wei wrote: > > Hi everyone, > > Have a

Re: 'velocity' does not exist . Do an 'create-queryresponsewriter' , if you want to create it

2020-04-28 Thread Erik Hatcher
Try add-queryresponsewriter instead of "update" - it's not currently defined so there's nothing to update. Add it first, but also make sure you've got the Velocity contrib and dependencies wired into your configset as well. Erik > On Apr 28, 2020, at 9:15 AM, Prakhar Kumar >

Re: ResourceManager : unable to find resource 'custom.vm' in any resource loader.

2020-04-22 Thread Erik Hatcher
What's the full request that is logged? You're using the Velocity response writer (wt=velocity) and a request is being made to render a custom.vm template (v.template=custom, or a template is #parse'ing("custom.vm")) that doesn't exist. Erik > On Apr 22, 2020, at 8:07 AM, Prakhar

Re: Query is taking a time in Solr 6.1.0

2020-03-13 Thread Erik Hatcher
Looks like you have two, maybe three, wildcard/prefix clauses in there. Consider tokenizing differently so you can optimize the queries to not need wildcards - thats my first observation and suggestion. Erik > On Mar 13, 2020, at 05:56, vishal patel wrote: > > Some query is taking

Re: Re: Anyone have experience with Query Auto-Suggestor?

2020-01-23 Thread Erik Hatcher
It's a great idea. And then index that file into a separate lean collection of just the suggestions, along with the weight as another field on those documents, to use for ranking them at query time with standard /select queries. (this separate suggest collection would also have appropriate

[CVE-2019-17558] Apache Solr RCE through VelocityResponseWriter

2019-12-30 Thread Erik Hatcher
[CVE-2019-17558] Apache Solr RCE through VelocityResponseWriter Severity: High Vendor: The Apache Software Foundation Versions Affected: 5.0.0 to 8.3.1 Description: The affected versions are vulnerable to a Remote Code Execution through the VelocityResponseWriter. A Velocity template can be

Re: How to tell which core was used based on Json or XML response from Solr

2019-11-24 Thread Erik Hatcher
add ==all and the parameter will be in the response header. Erik > On Nov 22, 2019, at 13:27, rhys J wrote: > > I'm implementing an autocomplete search box for Solr. > > I'm using JSON as my response style, and this is the jquery code. > > > var

Re: using fq means no results

2019-11-12 Thread Erik Hatcher
g/ (my blog) > >>> On Nov 12, 2019, at 9:08 AM, Erik Hatcher wrote: >>> >>> >>> >>>> On Nov 12, 2019, at 12:01 PM, rhys J wrote: >>> >>> On Tue, Nov 12, 2019 at 11:57 AM Erik Hatcher >>> wrote: >>> >

Re: using fq means no results

2019-11-12 Thread Erik Hatcher
> On Nov 12, 2019, at 12:01 PM, rhys J wrote: > > On Tue, Nov 12, 2019 at 11:57 AM Erik Hatcher > wrote: > >> fq is a filter query, and thus narrows the result set provided by the q >> down to what also matches all specified fq's. >> >> &

Re: using fq means no results

2019-11-12 Thread Erik Hatcher
fq is a filter query, and thus narrows the result set provided by the q down to what also matches all specified fq's. You gave it a query, "cat_ref_no", which literally looks for that string in your default field. Looking at your q parameter, cat_ref_no looks like a field name, and your fq

Re: Good Open Source Front End for Solr

2019-11-07 Thread Erik Hatcher
Blacklight: http://projectblacklight.org/ ;) > On Nov 6, 2019, at 11:16 PM, Java Developer wrote: > > Hi, > > What is the best open source front-end for Solr > > Thanks

Re: Security Vulnerability Consultation

2019-11-01 Thread Erik Hatcher
Hi - There are many "vulnerabilities" that can be enabled when one has administrative access to Solr, with this being one example. The setting mentioned defaults to false, and requires admin access to enable. The warning from the Solr Reference Guide is worth repeating here: >> No Solr API,

Re: Solr Paryload example

2019-10-21 Thread Erik Hatcher
Erik > On Oct 21, 2019, at 2:55 PM, Eric Pugh > wrote: > > Have you checked out > https://github.com/o19s/payload-component > > On Mon, Oct 21, 2019 at 2:47 PM Erik Hatcher wrote: > >> How about a single field, with terms like: >> >>store1_USD|125.

Re: Solr Paryload example

2019-10-21 Thread Erik Hatcher
How about a single field, with terms like: store1_USD|125.0 store2_EUR|220.0 store3_GBP|225.0 Would that do the trick? And yeah, payload decoding is currently limited to float and int with the built-in payload() function. We'd need a new way to pull out textual/bytes payloads - like

Re: solr.HTMLStripCharFilterFactory issue

2019-09-02 Thread Erik Hatcher
Analysis has no effect on the stored (what you get back from fl) value. The html stripping is happening behind the scenes on the indexed/searchable terms. Erik > On Sep 2, 2019, at 09:30, Big Gosh wrote: > > Hi, > > I've configured in solr 8.2.0 a field type as follows: > >

Re: modify query response plugin

2019-08-06 Thread Erik Hatcher
I think you’re looking for the Solr Tagger, described here: https://lucidworks.com/post/solr-tagger-improving-relevancy/ > On Aug 6, 2019, at 16:04, Maria Muslea wrote: > > Hi, > > I am trying to implement a plugin that will modify my query response. For > example, I would like to execute a

Re: Ranking

2019-07-27 Thread Erik Hatcher
The details of the scoring can be seen by setting =true Erik > On Jul 27, 2019, at 15:40, Steven White wrote: > > Hi everyone, > > I have 2 files like so: > > FA has the letter "i" only 2 times, and the file size is 54,246 bytes > FB has the letter "i" 362 times and the file size is

Re: Boosting using Range

2019-05-31 Thread Erik Hatcher
May 31, 2019, at 01:26, sachin gk wrote: > > Hi Erik, > > We have indexed it as a double and has individual value Eg Price_Range: 10. > >> On Thu, 30 May 2019 at 23:34, Erik Hatcher wrote: >> >> The simplest given your example, with edismax add =price:[10

Re: Boosting using Range

2019-05-30 Thread Erik Hatcher
The simplest given your example, with edismax add =price:[10 TO 25] Or you literally have a price_range field?=price_range:10_25 (assuming that's how you indexed it). What type of field is price_range? What did you index into it? Erik > On May 30, 2019, at 1:24 PM, sachin gk

Re: Retrieving docs in the same order as provided in the query

2019-05-09 Thread Erik Hatcher
n May 9, 2019, at 9:35 AM, Atita Arora wrote: > > Sure, > I can give this a shot! Hope it works out well for bigger resultsets too :) > > Big Thanks, Erik :) > > > > On Thu, May 9, 2019 at 3:20 PM Erik Hatcher wrote: > >> Atita - >> >>

Re: Retrieving docs in the same order as provided in the query

2019-05-09 Thread Erik Hatcher
Atita - You mean something like q=id:(X Y Z) to be able to order them arbitrarily? Yes, you can use the constant score query syntax to set the score, e.g.: q=id:Z^=3 OR id:Y^=2 OR id:X^=1 Hope that helps. Erik > On May 9, 2019, at 8:55 AM, Atita Arora wrote: > > Hi, > > Is

Re: Custom post filter with support for 'OR' queries

2019-05-05 Thread Erik Hatcher
Can you detail you actual querying need here?You’re down into some trenches with PostFilter, which is designed purely as an AND-like filtering mechanism, and contrary to ORing with it, generally speaking. Let’s see the real data and need to see what’s the best way to tackle it. Also,

Re: Term Freq Vector with SOLR cell?

2019-05-01 Thread Erik Hatcher
q=doc_content?Try q=id:"" Solr Cell and DIH are comparable (in that they are about getting content into Solr) but "unrelated" to TVRH. TVRH is about inspecting indexed content, regardless of how it got in. Erik > On May 1, 2019, at 3:14 PM, Geoffrey Willis > wrote: > > I am

Re: bin/post command not working when run from crontab

2019-04-18 Thread Erik Hatcher
Jason - thanks for replying and I concur, it makes sense to open a JIRA for this.I'm glad there is an acceptable workaround, at least. I recall doing a fair bit of trial and error, asking 'nix folk and stackoverflow how to handle this stdin situation and honing in on what's there

Re: Understanding Performance of Function Query

2019-04-09 Thread Erik Hatcher
maybe something like q= ({!edismax v=$q1} OR {!edismax v=$q2} OR {!edismax ... v=$q3}) and setting q1, q2, q3 as needed (or all to the same maybe with different qf’s and such) Erik > On Apr 9, 2019, at 09:12, sidharth228 wrote: > > I did infact use "bf" parameter for

Re: Understanding Performance of Function Query

2019-04-09 Thread Erik Hatcher
Function queries in ‘q’ score EVERY DOCUMENT. Use ‘bf’ or ‘boost’ for the function part, so its only computed on main query matching docs. Erik > On Apr 9, 2019, at 03:29, Sidharth Negi wrote: > > Hi, > > I'm working with "edismax" and "function-query" parsers in Solr and have >

Re: Behavior of Function Query

2019-03-19 Thread Erik Hatcher
Try adding fl=* into the request. There’s an oddity with fl, iirc, where it can skip functions if * isn’t there (or maybe a concrete non-score field?) Erik > On Mar 18, 2019, at 10:19, Ashish Bisht wrote: > > Please see the below requests and response > >

Re: Different behavior when using function queries

2019-03-18 Thread Erik Hatcher
If you have no documents in the results, there’s nothing to attach the function result to.`fl` is field list of fields to show in matched documents. You have no matches documents. Erik > On Mar 18, 2019, at 07:55, Ashish Bisht wrote: > > Can someone please explain the below

Re: Is it possible to force solr show all facet values for the field with an enum type?

2019-01-06 Thread Erik Hatcher
How about =-field:[* TO *] as a way to see a count of docs that don’t have field? Erik > On Jan 5, 2019, at 04:45, Arvydas Silanskas > wrote: > > Hello, > I have an enum solr fieldtype. When I do a facet search, I want that all > the enum values appear in the facet -- and setting

Re: boost query

2018-12-07 Thread Erik Hatcher
l_:%22payload(vals_dpf,noika)%22=edismax* > *wil this query work for me ?.* > > > > > >> On Fri, Dec 7, 2018 at 12:12 PM Erik Hatcher wrote: >> >> This blog I wrote will help. Let us know how it goes. >> >> https://lucidworks.com/2017/09

Re: boost query

2018-12-06 Thread Erik Hatcher
This blog I wrote will help. Let us know how it goes. https://lucidworks.com/2017/09/14/solr-payloads/ Erik > On Dec 7, 2018, at 01:31, Midas A wrote: > > I have a field at my schema named *val_dpf* . I want that *val_dpf* should > have payloaded values. i.e. > > noika|0.46

Re: Date Query Using Local Params

2018-09-10 Thread Erik Hatcher
When using the {!...} syntax, and combining it with other clauses, the expression parsed needs to come from a local-param `v` parameter (otherwise, without `v`, the parser eats the rest of the string after the closing curly bracket). So you could do something like this: q={!field

Re: How long does a query?q=field1:2312 should cost? exactly hit one document.

2018-09-03 Thread Erik Hatcher
Add debug=true and see where the time goes, in which components? Highlighting is my culprit guess. Or faceting? > On Sep 3, 2018, at 07:45, zhenyuan wei wrote: > > Hi , > I am curious “How long does a query q=field1:2312 cost , which > exactly match only one document? ”, Of course we

Re: Can I use RegEx function?

2018-07-23 Thread Erik Hatcher
this is best done at index-time. (it seems like you're trying to avoid doing that though) > On Jul 23, 2018, at 5:36 AM, Peter Sh wrote: > > I want to be able to parse "KEY:VALUE" pairs from my text and have a facet > representing distribution of VALUES > > On Mon, Jul 23, 2018 at 12:25

Re: How to avoid join queries

2018-06-13 Thread Erik Hatcher
> On Jun 13, 2018, at 4:24 PM, root23 wrote: ... > But i > know use of join is discouraged in solr and i do not want to use it. … Why do you say that? I, for one, find great power and joy using `{!join}`. Erik

Re: How to find out which search terms have matches in a search

2018-06-12 Thread Erik Hatcher
/lucenerevolution/hatcher-erik-rapid-prototyping-with-solr/12 <https://www.slideshare.net/lucenerevolution/hatcher-erik-rapid-prototyping-with-solr/12> 4.10.4? woah Erik Hatcher Senior Solutions Architect, Lucidworks.com > On Jun 11, 2018, at 11:16 PM, Derek Poh wrote: > >

Re: indexer used in solr

2018-06-11 Thread Erik Hatcher
Vivek - Can you provide us specific examples of what you’re sending in (and how you are doing so) and how you are querying and what you expect? Erik > On Jun 11, 2018, at 7:34 AM, Vivek Singh wrote: > > HI Team , > I am new to solr ,wanted to know which indexer is used in apache

Re: sharding guidelines

2018-06-04 Thread Erik Hatcher
I’d say that 100M/shard is in the smallest doc use case possible, such as straight up log items with only a timestamp, id, and short message kind of thing. In other contexts, big full text docs, 10M/shard is kind of a max. How many documents do you have in your collection? Erik

Re: Three Indexing Questions

2018-03-29 Thread Erik Hatcher
Terry - You’re speaking of bin/post, looks like. bin/post is _just_ a simple tool to provide some basic utility. The fact that it can recurse a directory structure at all is an extra bonus that really isn’t about “Solr” per se, but about posting content into it. Frankly, (even as the

Re: query regarding Solr partial search

2018-03-27 Thread Erik Hatcher
This is as much about your schema as it is about your query parser usage. What’s parsed_query say in your debug=true output? What query parser are you using? If edismax, check qf/pf/mm settings, etc. Erik > On Mar 27, 2018, at 9:56 AM, Paul, Lulu wrote: > > Hi

Re: Solr Expression Slow

2018-02-12 Thread Erik Hatcher
I suggest applying that logic at index time and build yourself a SORT_CRITERIA field and use that rather than that sophisticated function that looks like it could collapse down to a single index-time field. Erik > On Feb 12, 2018, at 10:32 AM, ~$alpha` wrote:

Re: Post-processing of Solr responses in Velocity templates by calling external Java methods

2018-01-25 Thread Erik Hatcher
Ravindra - So you have documents that represent *lines*, but for each line document you want to render the 3 lines (documents) before and after. Hmmm - tricky! Velocity itself isn’t going to help you here. You’ll need to do additional searches to get the “context documents”. Given

Re: trivia question: why q=*:* doesn't return same result as q.alt=*:*

2018-01-07 Thread Erik Hatcher
I think what Erick meant to say ;) was defType=dismax does NOT do anything special with *:* other than treat it as plain text and does dismaxy things with it. That’s exactly why there is q.alt for the dismax parser - so you can have your dismax and still match all docs by not having a

Re: Solr - how does faceting returned unstored values?

2018-01-05 Thread Erik Hatcher
Facets return the *indexed* value. This is an important, ahem, facet to facets. Field analysis matters, so tokenized fields will have tokenized facets. Erik > On Jan 5, 2018, at 10:17 AM, ruby wrote: > > The Solr document states that the purpose of the

Re: Solr - custom ordering

2018-01-05 Thread Erik Hatcher
Vineet - Solr’s QueryElevationComponent can do this. Or you could use a query like: q=id:C^=300 id:B^=200 id:A^=100 The ^= is a constant score syntax, so you can assign a “score” to a clause (in this case a single document with a unique id). Erik > On Jan 4, 2018, at 11:47

Re: Deliver static html content via solr

2018-01-05 Thread Erik Hatcher
from /var/www/html. Warning: the > Velocity learning curve is steep and you still need a separate front-end web > app for security because Velocity is a templating output filter. Eric, please > correct me! > > cheers -- Rick > > > On 01/04/2018 11:45 AM, Erik Hatcher

Re: Personalized search parameters

2018-01-05 Thread Erik Hatcher
IMO you’re making this more complicated than it needs to be. Forget for a moment where the user profile is stored. Say user A likes turtles. User B likes puppies. User A queries, and this gets sent to Solr: q=something=turtles User B queries: q=something=puppies I’d fetch the user

Re: trivia question: why q=*:* doesn't return same result as q.alt=*:*

2018-01-04 Thread Erik Hatcher
defType=??? Probably dismax. It doesn’t do *:* like edismax or lucene. > On Jan 4, 2018, at 20:39, Nawab Zada Asad Iqbal wrote: > > Thanks Erik > Here is the output, > > http://localhost:8983/solr/filesearch/select?fq=id:1193=*:*=true > > > - parsedquery:

Re: Deliver static html content via solr

2018-01-04 Thread Erik Hatcher
All judgements aside on whether this is a preferred way to go, have a look at /browse and the VelocityResponseWriter (wt=velocity). It can serve static resources. I’ve built several prototypes this way that have been effective and business generating. Erik > On Jan 4, 2018, at 11:19,

Re: DIH XPathEntityProcessor XPath subset?

2018-01-03 Thread Erik Hatcher
Stefan - If you pre-transform the XML, I’d personally recommend either transforming it into straight up Solr XML (docs/fields/values) or some other format or posting directly to Solr. Avoid this DIH thing when things get complicated. Erik > On Jan 3, 2018, at 11:40 AM, Stefan Moises

Re: does the payload_check query parser have support for simple query parser operators?

2017-11-30 Thread Erik Hatcher
No it doesn’t. The payload parsers currently just simple tokenize with no special syntax supported. Erik > On Nov 30, 2017, at 02:41, John Anonymous wrote: > > I would like to use wildcards and fuzzy search with the payload_check query > parser. Are these supported? >

Re: Analyse Fieldname API

2017-11-15 Thread Erik Hatcher
Turn on your browsers developer mode and check out the HTTP requests behind the scenes of that page. Yes! ;) > On Nov 15, 2017, at 07:19, kumar gaurav wrote: > > Hi > > Solr has panel to Analyse Fieldname i.e. > > http://localhost:8983/solr/#/corename/analysis > > I

Re: tf function query

2017-10-05 Thread Erik Hatcher
How about the query() function? Just be clever about the query you specify ;) > On Oct 5, 2017, at 06:14, Dmitry Kan wrote: > > Hi, > > According to > https://lucene.apache.org/solr/guide/6_6/function-queries.html#FunctionQueries-AvailableFunctions > > tf(field, term)

Re: Solr fields for Microsoft files, image files, PDF, text files

2017-09-25 Thread Erik Hatcher
Phillip - You may be interested to start with the example/files that ships with Solr. It is specifically designed as a configuration (and UI!) that deals with indexing rich files with a bit more than other examples - it pulls out acronyms, e-mail addresses, and URLs from text, as well as what

Re: Boost by Integer value on top of query

2017-07-20 Thread Erik Hatcher
If you’re using edismax, adding a boost parameter `boost=num_employees=num_locations` should incorporate those integers into the scores. Just try one at a time at first - you’ll likely want to wrap it into a single function, along the lines of something like

Re: Multiple Field Search on Solr

2017-07-10 Thread Erik Hatcher
I recommend first understanding the Solr API, and the parameters you need to add the capabilities with just the /select API. Once you are familiar with that, you can then learn what’s needed and apply that to the HTML and JavaScript. While the /browse UI is fairly straightforward, there’s a

Re: Slowly running OOM due to Query instances?!

2017-07-07 Thread Erik Hatcher
With generated Query’s, one has to be really careful with .equals and .hashCode implementations. That may not be applicable here, but something that has bitten me with caching. Note that there were fixes made in Solr 6.6 with PayloadScoreQuery in this regard. See LUCENE-7808 and

Re: Boosting Documents using the field Value

2017-06-24 Thread Erik Hatcher
With dismax use bf=domain_ct. you can also use boost=domain_ct with edismax. > On Jun 23, 2017, at 23:01, govind nitk wrote: > > Hi Solr, > > My Index Data: > > id name category domain domain_ct > 1 Banana Fruits Home > Fruits > Banana 2 > 2 Orange Fruits Home > Fruits

Re: Indexing PDF files with Solr 6.6 while allowing highlighting matched text with context

2017-06-19 Thread Erik Hatcher
Ziyuan - You may be interested in the example/files that ships with Solr too. It’s got schema and config and even UI for file indexing and searching. Check it out README.txt under example/files in your Solr install. Erik > On Jun 19, 2017, at 6:52 AM, ZiYuan

Re: CSV output

2017-06-15 Thread Erik Hatcher
Is it the proxy affecting the output?What do you get going directly to Solr's endpoint? Erik > On Jun 14, 2017, at 22:13, Phil Scadden wrote: > > If I try > /getsolr? > fl=id,title,datasource,score=true=9000=unified=Wainui-1=AND=csv > > The response I get

Re: Odd Boolean Query behavior in SOLR 3.6

2017-06-13 Thread Erik Hatcher
Inner purely negative queries match nothing. A query is about matching, and skipping over things that don’t match. The fix is when using (-something) to do (*:* -something) to match everything and skip the negative clause items. In your example, try fq=((*:* -documentTypeId:3) AND

Re: Phrase Query only forward direction

2017-06-12 Thread Erik Hatcher
em is that I want phrase which have > same sequence and they can be present with in some distance > E.g. > If I have document masitha xyz 12345 > I want that to be boosted since the sequence is in order .That's why I have > use ps=5 > Thanks, > Aman Deep Singh > >

Re: Phrase Query only forward direction

2017-06-12 Thread Erik Hatcher
Using ps=5 causes the phrase matching to be unordered matching. You’ll have to set ps=0, if using edismax, to get exact order phrase matches. Erik > On Jun 12, 2017, at 1:09 AM, Aman Deep Singh > wrote: > > Hi, > I'm using a phrase query ,but it was

Re: Proximity Search using edismax parser.

2017-06-12 Thread Erik Hatcher
Adding =true to your search requests will give you the parsing details, so you can see how edismax interprets the query string and parameters to turn it into the underlying dismax and phrase queries. Erik > On Jun 12, 2017, at 3:22 AM, abhi Abhishek wrote: > > Hi

Re: I want "john smi" to find "john smith" in my custom "fullname_s" field

2017-06-06 Thread Erik Hatcher
Nick - try escaping the space, so that your query is q=fullname_s:john\ smi* However, whitespace and escaping is problematic. There is a handy prefix query parser, so this would work on a string field with spaces: q={!prefix f=fullname_s}john smi note no trailing asterisk on that one.

Re: Velocity UI with Analyzing Infix Suggester?

2017-06-06 Thread Erik Hatcher
Walter - I’ve done several one-off demos that have incorporated as-you-type Ajax actions into /browse. The first one I did was “instant search” (not suggest) and left that sitting over at my “instant_search” branch - of svn(!). See the top two commits listed here:

Re: Long string in fq value parameter, more than 2000000 chars

2017-05-27 Thread Erik Hatcher
Another technique to consider is {!join}. Index the cross ref id "sets" to another core and use a short and sweet join, if there are stable sets of id's. Erik > On May 27, 2017, at 11:39, Alexandre Rafalovitch wrote: > > On top of Shawn's analysis, I am also wondering

Re: knowing which fields were successfully hit

2017-05-16 Thread Erik Hatcher
Is this the equivalent of facet.query’s? or maybe rather, group.query? Erik > On May 16, 2017, at 1:16 PM, Dorian Hoxha wrote: > > Something like elasticsearch named-queries, right >

Re: Solr Features 6.5.1 v/s 6.1

2017-05-12 Thread Erik Hatcher
Sweta - There’s been an enormous number of changes between 6.1 and 6.5.1. See CHANGES: https://github.com/apache/lucene-solr/blob/master/solr/CHANGES.txt#L439-L1796 wow, huh? And yes, there have been

Re: Dynamic facets during runtime

2017-05-12 Thread Erik Hatcher
Use "appends" instead of "defaults". > On May 11, 2017, at 23:23, Jeyaprakash Singarayar > wrote: > > Hi, > > Our application has a facet select admin screen UI that would allow the > users to add/update/delete the facets that has to be returned from Solr. > > Right

Re: Automatic conversion to Range Query

2017-05-07 Thread Erik Hatcher
; > Hi Erik, > We can't use dismax as we are using the other functionality of edismax > parser > > On 07-May-2017 12:13 AM, "Erik Hatcher" <erik.hatc...@gmail.com> wrote: > > What about dismax instead of edismax?It might do the righter thing here > with

Re: Automatic conversion to Range Query

2017-05-06 Thread Erik Hatcher
What about dismax instead of edismax?It might do the righter thing here without escaping. > On May 6, 2017, at 12:57, Shawn Heisey wrote: > >> On 5/6/2017 7:09 AM, Aman Deep Singh wrote: >> After escaping the square bracket the query is working fine, Is their >> any

Re: Import Handler using shell scripts

2017-04-28 Thread Erik Hatcher
Yes, via the HTTP API (via curl or other tool). See the commands and URL examples here: https://cwiki.apache.org/confluence/display/solr/Uploading+Structured+Data+Store+Data+with+the+Data+Import+Handler#UploadingStructuredDataStoreDatawiththeDataImportHandler-DataImportHandlerCommands

Re: Modify solr score

2017-04-22 Thread Erik Hatcher
This may be suggesting a solution that is too experimental or using the wrong hammer for the job, but to me it sounds like you could use “payloads” for this type of ranking of terms relationship to a document. See SOLR-1485 for the recent work I’ve been doing (and aim to get committed

Re: Filter if Field Exists

2017-04-17 Thread Erik Hatcher
If you need to do an inner purely negative clause, it must be OR’d with *:* - queries about matching not excluding. There’s a shortcut in Solr to allow a top-level purely negative clause as convenience but when it gets nested it needs pairing explicitly. Those queries below don’t quite do

Re: Filter if Field Exists

2017-04-17 Thread Erik Hatcher
Too many ‘+’’s in there, I think. I think the query you want is this, and let’s be precise about the query parser here too in case that’s getting in the way and split this stuff up into separate reusable clauses: ?qq=test _no_type=({!field f=name v=$qq} -type:*)

Re: Solr/ Velocity dont show full field value

2017-04-11 Thread Erik Hatcher
#field() is defined in _macros.vm as this monstrosity: # TODO: make this parameterized fully, no context sensitivity #macro(field $f) #if($response.response.highlighting.get($docId).get($f).get(0)) #set($pad = "") #foreach($v in $response.response.highlighting.get($docId).get($f))

Re: Pagination bug? when sorting by a field (not unique field)

2017-03-29 Thread Erik Hatcher
Certainly not intended behavior. Can you show us a way to replicate the issue? > On Mar 29, 2017, at 8:35 AM, Pablo Anzorena wrote: > > Hey, > > I was paginating the results of a query and noticed that some documents > were repeated across pagination buckets of 100

Re: I want to contribute custom made NLP based solr filters but dont know how.

2017-03-07 Thread Erik Hatcher
Nice use of the VelocityResponseWriter :) (and looks like, at quick glance, several other goodies under there too) Erik > On Mar 5, 2017, at 7:40 AM, Avtar Singh Mehra wrote: > > Hello everyone, > I have developed project called WiseOwl which is basically a fact

Re: Using parameter values in a sort

2017-03-01 Thread Erik Hatcher
FYI - I recalled, and located, a solr-user thread from 2015 with subject “Parameter Substitution” with this same issue. Tricky issue - overloaded `${` usage and interpretation time. Erik > On Mar 1, 2017, at 1:41 PM, Erik Hatcher <erik.hatc...@gmail.com> wrote: > &g

Re: Using parameter values in a sort

2017-03-01 Thread Erik Hatcher
017, at 1:14 PM, Erik Hatcher <erik.hatc...@gmail.com> wrote: > > Walter - > > Apologies for not trying this sooner first-hand. I’m used to passing in all > the params (even the dynamic ${…} ones) in the request these days, not so > much putting them into request handler

Re: Using parameter values in a sort

2017-03-01 Thread Erik Hatcher
alter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > >> On Feb 27, 2017, at 6:44 PM, Erik Hatcher <erik.hatc...@gmail.com> wrote: >> >> `scores` (plural), you’ve got this below: >> >> Remove that, and li

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
rwood.org > http://observer.wunderwood.org/ (my blog) > > >> On Feb 27, 2017, at 6:44 PM, Erik Hatcher <erik.hatc...@gmail.com> wrote: >> >> `scores` (plural), you’ve got this below: >> >> Remove that, and like my previous e-mail, and use `scores` (p

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
> On Feb 27, 2017, at 9:42 PM, Walter Underwood wrote: > Pretty ready to give up. The documentation around function queries and params > is not working for me, though I’ve been using Solr for ten years. I have > figured out a lot of systems. This is impenetrable. Here’s

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
> wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > >> On Feb 27, 2017, at 6:35 PM, Erik Hatcher <erik.hatc...@gmail.com> wrote: >> >> You have an empty “scores” parameter in there. You’re not showing your f

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
scores}) desc > On Feb 27, 2017, at 9:35 PM, Erik Hatcher <erik.hatc...@gmail.com> wrote: > > You have an empty “scores” parameter in there. You’re not showing your full > search request, but did you provide that in the request? Have you perhaps > turned off parameter sub

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
esUtil.java:65) > at org.apache.solr.util.DOMUtil.substituteProperties(DOMUtil.java:298) > > wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > >> On Feb 27, 2017, at 6:17 PM, Erik Hatcher <erik.hatc...@gmail.com>

Re: Using parameter values in a sort

2017-02-27 Thread Erik Hatcher
Walter - How about this, for the latter part of your request: /handler?features=a,b,c with =sum(${features}) desc That ought to do the trick. At first I thought the #foreach nature of the list of features was prohibitive, but since you’re literally plugging in the exact string

Re: Issues with uniqueKey != id?

2017-02-06 Thread Erik Hatcher
Personally I'd leave it as "id" - and adjust your other domain specific field name to something else. Why? Keep Solr and other potential tools from having issues. I don't know exactly what may break, but I'd rather keep things straightforward. Erik > On Feb 6, 2017, at 02:33, Matthias

Re: Search for ISBN-like identifiers

2017-01-05 Thread Erik Hatcher
Sebastian - There’s some precedent out there for ISBN’s. Bill Dueber and the UMICH/code4lib folks have done amazing work, check it out here - https://github.com/mlibrary/umich_solr_library_filters - Erik > On Jan 5, 2017,

Re: Solr ACL Plugin Windows

2017-01-04 Thread Erik Hatcher
Thanks, Mike, for emphasizing that point. I put that point in the blog post as well - the recommended approach if it's sufficient for sure. Erik > On Jan 4, 2017, at 07:36, Mike Thomsen wrote: > > I didn't see a real Java project there, but the directions to

Re: How to solve?

2016-12-28 Thread Erik Hatcher
I'll have to not be mobile and thumbing a reply to give a concrete example but you'll need to use the nested query parsing facility to make a boolean AND query of two geofilts or bboxes, each with local params. Erik > On Dec 28, 2016, at 02:12, William Bell wrote: >

Re: Easy way to preserve Solr Admin form input

2016-12-27 Thread Erik Hatcher
How's /browse fare for you? What params are you adjusting regularly? > On Dec 27, 2016, at 06:09, Sebastian Riemer wrote: > > Hi, > > is there an easy way to preserve the query data I input in SolrAdmin? > > E.g. when debugging a query, I often have the desire to reopen

Re: prefix query help

2016-12-08 Thread Erik Hatcher
"2016-07-06" > ] > > doc 6 > " metatag.date ": [ > "2014-04-15T14:51:06Z" , > "2014-04-15T14:51:06Z" > ] > > q=2016-06 should return doc 2 and 1 > q=2016-06 OR 2014-04 should return doc

Re: prefix query help

2016-12-08 Thread Erik Hatcher
Kris - To chain multiple prefix queries together: q=({!prefix f=field1 v=‘prefix1'} {!prefix f=field2 v=‘prefix2’}) The leading paren is needed to ensure it’s being parsed with the lucene qparser (be sure not to have defType set, or a variant would be needed) and that allows multiple {!…}

  1   2   3   4   5   6   7   8   9   10   >