Re: SolrCloud upgrade concern

2020-05-22 Thread gnandre
Thanks for this reply, Jason. I am mostly worried about CDCR feature. I am relying heavily on it. Although, I am planning to use Solr 8.3. It has been long time since CDCR was first introduced. I wonder what is the state of CDCR is 8.3. Is it stable now? On Wed, Jan 22, 2020, 8:01 AM Jason

Re: Alternate Fields for Unified Highlighter

2020-05-22 Thread Furkan KAMACI
Hi David, Thanks for the response! I use Unified Highlighter combined with maxAnalyzedChars to accomplish my needs. I'll file an issue and PR for it! Kind Regards, Furkan KAMACI On Fri, May 22, 2020 at 11:25 PM David Smiley wrote: > Feel free to file an issue; I know it's not supported. I

Trouble starting Solr on Windows/Ubuntu

2020-05-22 Thread Stavros Macrakis
I'm trying to follow the Solr Tutorial ( https://lucene.apache.org/solr/guide/8_5/solr-tutorial.html#solr-tutorial). Yesterday, "bin/solr start" worked fine -- I could see the status page on http://localhost:8993 . I even created a test config server/solr/test1 through the Web interface. Today,

Re: Creating custom PassageFormatter

2020-05-22 Thread David Smiley
You've probably gotten you answer now but "no". Basically, you'd need to specify your own subclass of UnifiedSolrHighlighter in solrconfig.xml like this: Error loading class 'solr.highlight.CustomPassageFormatter'". > > Example from solrconfig.xml: >

Re: hl.preserveMulti in Unified highlighter?

2020-05-22 Thread David Smiley
Hi Walter, No, the UnifiedHighlighter does not behave as if this setting were true. The docs say: `hl.preserveMulti`:: If `true`, multi-valued fields will return all values in the order they were saved in the index. If `false`, the default, only values that match the highlight request will be

Re: Alternate Fields for Unified Highlighter

2020-05-22 Thread David Smiley
Feel free to file an issue; I know it's not supported. I also don't think it's a big deal because you can just ask Solr to return the "alternateField", thus letting the client side choose when to use that. I suppose it might be large, so I can imagine a concern there. It'd be nice if Solr had a

Re: unified highlighter methods works unexpected

2020-05-22 Thread David Smiley
Hi Roland, I was not able to reproduce this. I modified the tech_products same config to change the name field to use a new field type that had a trivial edgengram config. Then I composed this query based. alittle on some of your parameters, and it did find highlights:

Re: Unified highlighter with storeOffsetsWithPositions and termVectors giving an exception

2020-05-22 Thread David Smiley
FWIW I tried this on the techproducts schema with a modification to the name field, but did not see the issue. I suspect you did not re-index after making these schema changes. If you did, then also check that the collection (or core) truly started fresh (never had any previous schema) because

[explain style=html] and group=true

2020-05-22 Thread Vincenzo D'Amore
Hi all, I noticed that the field [explain style=html] has been removed from my results when I started to group. Do you know if there is a way to have back the explain even if I'm grouping? Best regards, Vincenzo -- Vincenzo D'Amore

Re: Indexing huge data onto solr

2020-05-22 Thread matthew sporleder
I can index (without nested entities ofc ;) ) 100M records in about 6-8 hours on a pretty low-powered machine using vanilla DIH -> mysql so it is probably worth looking at why it is going slow before writing your own indexer (which we are finally having to do) On Fri, May 22, 2020 at 1:22 PM

Re: Indexing huge data onto solr

2020-05-22 Thread Erick Erickson
You have a lot more control over the speed and form of importing data if you just do the initial load in SolrJ. Here’s an example, taking the Tika parts out is easy: https://lucidworks.com/post/indexing-with-solrj/ It’s especially instructive to comment out just the call to

Re: Highlighting Solr 8

2020-05-22 Thread David Smiley
What did you end up doing, Eric? Did you migrate to the Unified Highlighter? ~ David On Wed, Oct 16, 2019 at 4:36 PM Eric Allen wrote: > Thanks for the reply. > > Currently we are migrating from solr4 to solr8 under solr 4 we wrote our > own highlighter because the provided one was too slow

Indexing huge data onto solr

2020-05-22 Thread Srinivas Kashyap
Hi All, We are runnnig solr 8.4.1. We have a database table which has more than 100 million of records. Till now we were using DIH to do full-import on the tables. But for this table, when we do full-import via DIH it is taking more than 3-4 days to complete and also it consumes fair bit of

Re: Unbalanced shard requests

2020-05-22 Thread Wei
Hi Michael, I also verified the patch in SOLR-14471 with 8.4.1 and it fixed the issue with shards.preference=replica.location:local,replica.type:TLOG in my setting. Thanks! Wei On Thu, May 21, 2020 at 12:09 PM Phill Campbell wrote: > Yes, JVM heap settings. > > > On May 19, 2020, at 10:59

Re: Need help on handling large size of index.

2020-05-22 Thread Phill Campbell
Maybe your problems are in AWS land. > On May 22, 2020, at 3:45 AM, Modassar Ather wrote: > > Thanks Erick and Phill. > > We index data weekly once and that is why we do the optimisation and it has > helped in faster query result. I will experiment with a fewer segments with > the current

Re: What is the logical order of applying sorts in SOLR?

2020-05-22 Thread Stephen Lewis Bianamara
> If you use sort, you are basically ignoring relevancy That's correct -- this is for querying with a stable sort, not for natural language. One place this comes up for example is with cursors -- cursors require the unique key

Re: Unified highlighter- unable to get results - can get results with original and termvector highlighters

2020-05-22 Thread David Smiley
Hello, Did you get it to work eventually? Try setting hl.weightMatches=false and see if that helps. Wether this helps or not, I'd like to have a deeper understanding of the internal structure of the Query (not the original query string). What query parser are you using?. If you pass

Re: +(-...) vs +(*:* -...) vs -(+...)

2020-05-22 Thread Bram Van Dam
Additional reading: https://lucidworks.com/post/why-not-and-or-and-not/ Assuming implicit AND, we perform the following rewrite on strictly negative queries: -f:a -> -f:a *:* Isn't search fun? :-) - Bram On 21/05/2020 20:51, Houston Putman wrote: > Jochen, > > For the standard query

Terms faceting and EnumField

2020-05-22 Thread Poornima Ponnuswamy
Hello, We have solr 6.6 version. Below is the field and field type that is defined in solr schema. Below is the configuration for the enum servicerequestcorrective servicerequestplanned

Re: Need help on handling large size of index.

2020-05-22 Thread Modassar Ather
Thanks Erick and Phill. We index data weekly once and that is why we do the optimisation and it has helped in faster query result. I will experiment with a fewer segments with the current hardware. The thing I am not clear about is although there is no constant high usage of extra IOPs other

Re: Solr Atomic update change value and field name

2020-05-22 Thread Hup Chen
> Try adding -format solr to your bin/post command. By default the post command > will treat input as arbitrary json, not solr-format json. Yes, it works! Thanks a lot! From: Jan Høydahl Sent: Friday, May 22, 2020 4:46 AM To: solr-user@lucene.apache.org

Re: Use Subquery Parameters to filter main query

2020-05-22 Thread Mikhail Khludnev
Hello, Rodrigo. I don'd fully understand your question but the only thing you can do is group.q=members:6, nothing like using something from subquery in main one is not possible. Please clarify your question. On Fri, May 22, 2020 at 12:21 AM rantonana wrote: > Hello, I need to do the following: