Re: maxBooleanClauses change in solr.xml not reflecting in solr 8.4.1

2021-01-05 Thread Shawn Heisey
On 1/5/2021 8:26 AM, dinesh naik wrote: Hi all, I want to update the maxBooleanClauses to 2048 (from default value 1024). Below are the steps tried: 1. updated solrconfig.xml : ${solr.max.booleanClauses:2048} You need to update EVERY solrconfig.xml that the JVM is loading for this to actually

Re: maxBooleanClauses change in solr.xml not reflecting in solr 8.4.1

2021-01-05 Thread ANNAMANENI RAVEENDRA
I experienced the same thing in solr-8.7 , it worked for me using system property. Set system property in solr.in.sh file On Tue, Jan 5, 2021 at 8:58 PM dinesh naik wrote: > Hi all, > I want to update the maxBooleanClauses to 2048 (from default value 1024). > Below are the steps tried: > 1.

Re: Identifying open segments.

2021-01-05 Thread Ilan Ginzburg
Are you trying to copy the index by an external process not running in the Solr JVM? I believe this is risky if the Solr JVM is running at the same time. For example segments can be deleted by Solr. There might also be closed segments that you do not need but that are still on the disk (no longer

Re: how to check num found

2021-01-04 Thread Dmitri Maziuk
On 1/4/2021 11:25 AM, Chris Hostetter wrote: Can't you just configure nagios to do a "negative match" against numFound=0 ? ... ie: "if response matches 'numFound=0' fail the check." (IIRC there's an '--invert-regex' option for this) Nothing's ever simple: apparently the standard plugin does

Re: how to check num found

2021-01-04 Thread Chris Hostetter
Can't you just configure nagios to do a "negative match" against numFound=0 ? ... ie: "if response matches 'numFound=0' fail the check." (IIRC there's an '--invert-regex' option for this) : Date: Mon, 28 Dec 2020 14:36:30 -0600 : From: Dmitri Maziuk : Reply-To: solr-user@lucene.apache.org :

Re: SolrDeletionPolicy & Core Reload

2021-01-04 Thread Steve Lacerda
Hi, Yes, reloading the core should reload the solrconfig.xml file, which should update those values. Regarding how to check, just look at the active config in the UI under config Files. Thanks On Sat, Jan 2, 2021 at 5:13 PM John Davis wrote: > Hi, > > Does Core Reload pick up changes to

Re: Why do I get different results for the same query with two Solr versions?

2021-01-04 Thread nettadalet
Tulsi wrote > Can you post the managed schema and solrconfig content here ? Schema for the 4.6 index (I omitted all non-relevant data):

Re: Can we have multiple Spellcheck Components under /select handler

2021-01-01 Thread Rajesh Hazari
Hi, You can have more than one spellcheck components after you have the spellcheck components in select request handler, you have still which spellcheck you want to use you could mention in your query params for ex: http:// :8983/solr//select/?q=text=default=wordbreak=true or define as defualts

Re: Monitoring Solr for currently running queries

2020-12-29 Thread Markus Jelsma
Hello Ufuk, You can log slow queries [1]. If you would want to see currently running queries you would have to extend SearchHandler and build the custom logic yourself. Watch out for SolrCloud because the main query as well as the per-shard queries can pass through that same SearchHandler. You

Re: Why do I get different results for the same query with two Solr versions?

2020-12-29 Thread Tulsi Das
Can you post the managed schema and solrconfig content here ? Do try the solr admin analysis screen once as well to see the behaviour for this field. https://lucene.apache.org/solr/guide/7_6/index.html On Sun, 27 Dec, 2020, 6:54 pm nettadalet, wrote: > Thank you, that was helpful! > > For

Re: Re:Re: Why do I get different results for the same query with two Solr versions?

2020-12-29 Thread nettadalet
Hi, thank for the comment, but I tried to use both "sow=false" and "saw=true" and I still get the same result. For query (TITLE_ItemCode_t:KI_7) I still see: Solr 4.6: "parsedquery": "PhraseQuery(TITLE_ItemCode_t:\"ki 7\")" Solr 7.5: "parsedquery":"+(+(TITLE_ItemCode_t:ki7 (+TITLE_ItemCode_t:ki

Re: impressive improvement in documentation

2020-12-28 Thread S G
One good way to achieve this is to use an alias 'current' So the 'current' replaces the latest version string like 7.1 and 8.6 in the URL. And Google will most likely show the current version on top always as it will see it as changing frequently, so will think that it is something more important

Re: Re:Re: Why do I get different results for the same query with two Solr versions?

2020-12-27 Thread Tulsi Das
Hi , Yes this look like related to sow (split on whitespace) param default behaviour change in solr 7. The sow parameter (short for "Split on Whitespace") now defaults to false, which allows support for multi-word synonyms out of the box. This parameter is used with the eDismax and

Re: Re:Re: Why do I get different results for the same query with two Solr versions?

2020-12-27 Thread nettadalet
I added "defType=lucene" to both searches to make sure I use the same query parser, but it didn't change the results. -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Re:Re: Why do I get different results for the same query with two Solr versions?

2020-12-27 Thread nettadalet
I'm not sure how to check the implementation of the query parser, or how to change the query parser that I use. I think I'm using the standard query parser. I use Solr Admin to run the queries. If I look at the URL, I see Solr 4.6: select?q=TITLE_ItemCode_t:KI_7=TITLE_ItemCode_t Solr 7.5:

Re: Why do I get different results for the same query with two Solr versions?

2020-12-27 Thread nettadalet
Thank you, that was helpful! For Solr 4.6 I get "parsedquery": "PhraseQuery(TITLE_ItemCode_t:\"ki 7\")" For Solr 7.5 I get "parsedquery":"+(+(TITLE_ItemCode_t:ki7 (+TITLE_ItemCode_t:ki +TITLE_ItemCode_t:7)))" So this is the cause of the difference in the search result, but I still don't know

Re: Solrcloud load balancing / failover

2020-12-26 Thread Dominique Bejean
Hi, Thank you for your response. Dominique Le mar. 15 déc. 2020 à 08:06, Shalin Shekhar Mangar a écrit : > No, the load balancing is based on random selection of replicas and > CPU is not consulted. There are limited ways to influence the replica > selection, see >

Re: solrcloud with EKS kubernetes

2020-12-26 Thread Jonathan Tan
Hi Abhishek, Merry Christmas to you too! I think it's really a question regarding your indexing speed NFRs. Have you had a chance to take a look at your IOPS & write bytes/second graphs for that host & PVC? I'd suggest that's the first thing to go look at, so that you can find out whether

Re: Range faceting on timestamp field

2020-12-24 Thread Erick Erickson
Then you need to form your start at relative to your timezone. What I’d actually recommend is that if you need to bucket by day, you index the day in a separate field. Of course, if you have to bucket by day in arbitrary timezones that won’t work….. Best, Erick > On Dec 24, 2020, at 4:42 PM,

Re: Why do I get different results for the same query with two Solr versions?

2020-12-24 Thread Tulsi Das
Hi, Try adding debug=true or debug=query in the url and see the formed query at the end . You will get to know why the results are different. On Thu, 24 Dec, 2020, 8:05 pm nettadalet, wrote: > Hello, > > I have the the same field type defined in Solr 4.6 and Solr 7.5. When I > search with both

Re: increasing number of threads for faceting in JSON format

2020-12-24 Thread Arturas Mazeika
tps://youtu.be/qItRilJLj5o > > From: solr-user@lucene.apache.org At: 12/10/20 21:42:19To: > solr-user@lucene.apache.org > Subject: Re: increasing number of threads for faceting in JSON format > > Hi Christine Munendra et al, > > Wow, you dag into the code and checked weath

Re: increasing number of threads for faceting in JSON format

2020-12-24 Thread Christine Poerschke (BLOOMBERG/ LONDON)
solr-user@lucene.apache.org At: 12/10/20 21:42:19To: solr-user@lucene.apache.org Subject: Re: increasing number of threads for faceting in JSON format Hi Christine Munendra et al, Wow, you dag into the code and checked weather threads are being blown in range and term queries! I wish one day to be

Re: solrcloud with EKS kubernetes

2020-12-23 Thread Abhishek Mishra
Hi Jonathan, Merry Christmas. Thanks for the suggestion. To manage IOPS can we do something on rate-limiting behalf? Regards, Abhishek On Thu, Dec 17, 2020 at 5:07 AM Jonathan Tan wrote: > Hi Abhishek, > > We're running Solr Cloud 8.6 on GKE. > 3 node cluster, running 4 cpus (configured) and

Re: Indexing performance 7.3 vs 8.7

2020-12-23 Thread Bram Van Dam
On 23/12/2020 16:00, Ron Buchanan wrote: > - both run Java 1.8, but 7.3 is running HotSpot and 8.7 is running > OpenJDK (and a bit newer) If you're using G1GC, you probably want to give Java 11 a go. It's an easy thing to test, and it's had a positive impact for us. Your mileage may

Re: Data Import Handler (DIH) - Installing and running

2020-12-23 Thread Erick Erickson
Have you done what the message says and looked at your Solr log? If so, what information is there? > On Dec 23, 2020, at 5:13 AM, DINSD | SPAutores > wrote: > > Hi, > > I'm trying to install the package "data-import-handler", since it was > discontinued from core SolR distro. > >

Re: Solr cloud facet query returning incorrect results

2020-12-21 Thread Erick Erickson
This should work as you expect, so the first thing I’d do is add =query and see the parsed query in both cases. If that doesn’t show anything, please post the full debug response in both cases. Best, Erick > On Dec 21, 2020, at 4:31 AM, Alok Bhandari wrote: > > Hello All , > > we are using

Re: Data Import Blocker - Solr

2020-12-19 Thread Shawn Heisey
On 12/18/2020 12:03 AM, basel altameme wrote: While trying to Import & Index data from MySQL DB custom view i am facing the error below: Data Config problem: The value of attribute "query" associated with an element type "entity" must not contain the '<' character. Please note that in my SQL

Re: CPU and memory circuit breaker documentation issues

2020-12-19 Thread Dmitri Maziuk
On 12/18/2020 11:26 AM, Walter Underwood wrote: ... I’ll file a bug and submit a patch to use for larger batch of entries with data in the same format, . How do I fix the documentation? CPU load may be good if your process is CPU-bound. If you're stuck on iowait in your $data filesystem and

Re: SPLITSHARD - data loss of child documents

2020-12-19 Thread David Smiley
https://issues.apache.org/jira/browse/SOLR-11191 and I assigned it to myself just now. ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Thu, Dec 17, 2020 at 9:50 AM Mike Drob wrote: > I was under the impression that split shard doesn’t work with

Re: CPU and memory circuit breaker documentation issues

2020-12-18 Thread Walter Underwood
Thanks. I’m already familiar with adoc. https://issues.apache.org/jira/browse/SOLR-15056 Now I need to brush up on How To Contribute. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Dec 18, 2020,

Re: CPU and memory circuit breaker documentation issues

2020-12-18 Thread Anshum Gupta
Hi Walter, Thanks for taking this up. You can file a PR for the documentation change too as our docs are now a part of the repo. Here's where you can find the docs: https://github.com/apache/lucene-solr/tree/master/solr/solr-ref-guide On Fri, Dec 18, 2020 at 9:26 AM Walter Underwood wrote: >

Re: CPU and memory circuit breaker documentation issues

2020-12-18 Thread Walter Underwood
Looking at the code, the CPU circuit breaker is unusable. This actually does use Unix load average (operatingSystemMXBean.getSystemLoadAverage()). That is a terrible idea. Interpreting the load average requires knowing the number of CPUs on a system. If I have 16 CPUs, I would probably set the

Re: solrCloud client socketTimeout initiates retries

2020-12-18 Thread kshitij tyagi
Hi erick, Thanks. Yes we will be upgrading soon to 8.8 till we upgrade we are increasing socket timeout and it helps for time being to some extent. regards, kshitij On Fri, Dec 18, 2020 at 7:48 PM Erick Erickson wrote: > Right, there are several alternatives. Try going here: >

Re: solrCloud client socketTimeout initiates retries

2020-12-18 Thread Erick Erickson
Right, there are several alternatives. Try going here: http://jirasearch.mikemccandless.com/search.py?index=jira and search for “circuit breaker” and you’ll find a bunch of JIRAs. Unfortunately, some are in 8.8.. That said, some of the circuit breakers are in much earlier releases. Would it

Re: solrCloud client socketTimeout initiates retries

2020-12-18 Thread kshitij tyagi
Hi Erick, I agree but in a huge cluster the retries keeps on happening, cant we have this feature implemented in client. i was referring to this jira https://issues.apache.org/jira/browse/SOLR-10479 We have seen that some malicious queries come to system which takes significant time and these

Re: Data Import Blocker - Solr

2020-12-18 Thread Erick Erickson
Have you tried escaping that character? > On Dec 18, 2020, at 2:03 AM, basel altameme > wrote: > > Dear, > While trying to Import & Index data from MySQL DB custom view i am facing the > error below: > Data Config problem: The value of attribute "query" associated with an > element type

Re: solrCloud client socketTimeout initiates retries

2020-12-18 Thread Erick Erickson
Why do you want to do this? This sounds like an XY problem, you think you’re going to solve some problem X by doing Y. Y in this case is setting the numServersToTry, but you haven’t explained what X, the problem you’re trying to solve is. Offhand, this seems like a terrible idea. If you’re

Re: DIH and UUIDProcessorFactory

2020-12-17 Thread Dmitri Maziuk
On 12/17/2020 4:05 PM, Alexandre Rafalovitch wrote: Try with the explicit URP chain too. It may work as well. Actually in this case we're just making sure uniqueKey is in fact unique in all documents, so default is what we want. For this particular dataset I may at some future point look

Re: DIH and UUIDProcessorFactory

2020-12-17 Thread Alexandre Rafalovitch
Try with the explicit URP chain too. It may work as well. Regards, Alex. On Thu, 17 Dec 2020 at 16:51, Dmitri Maziuk wrote: > > On 12/12/2020 4:36 PM, Shawn Heisey wrote: > > On 12/12/2020 2:30 PM, Dmitri Maziuk wrote: > >> Right, ```Every update request received by Solr is run through a

Re: DIH and UUIDProcessorFactory

2020-12-17 Thread Dmitri Maziuk
On 12/12/2020 4:36 PM, Shawn Heisey wrote: On 12/12/2020 2:30 PM, Dmitri Maziuk wrote: Right, ```Every update request received by Solr is run through a chain of plugins known as Update Request Processors, or URPs.``` The part I'm missing is whether DIH's 'name="/dataimport"' counts as an

Re: SPLITSHARD - data loss of child documents

2020-12-17 Thread Mike Drob
I was under the impression that split shard doesn’t work with child documents, if that is missing from the ref guide we should update it On Thu, Dec 17, 2020 at 4:30 AM Nussbaum, Ronen wrote: > Hi Everyone, > > We're using version 8.6.1 with nested documents. > I used the SPLITSHARD API and

Re: solrcloud with EKS kubernetes

2020-12-16 Thread Jonathan Tan
Hi Abhishek, We're running Solr Cloud 8.6 on GKE. 3 node cluster, running 4 cpus (configured) and 8gb of min & max JVM configured, all with anti-affinity so they never exist on the same node. It's got 2 collections of ~13documents each, 6 shards, 3 replicas each, disk usage on each node is ~54gb

Re: Best example solrconfig.xml?

2020-12-16 Thread Walter Underwood
That sample solrconfig.xml includes , but the 7.0 release notes say that is no longer supported. Should that be removed from the config? " element in solrconfig.xml is no longer supported. Equivalent functionality can be configured in solr.xml using element and SolrJmxReporter implementation.

Re: Solr Collection Reload

2020-12-16 Thread Moulay Hicham
Thanks Erick - The logs did NOT provide any errors. Thanks for the thread dump suggestion. The issue was resolved when we restarted all the nodes. Also, I am wondering if restarting the leaders would have been sufficient. I will try this next time this happens. On Tue, Dec 15, 2020 at 5:21 AM

Re: Best example solrconfig.xml?

2020-12-15 Thread Walter Underwood
Thanks. Yeah, already enabled the ClassicIndexSchemaFactory. Nice tip about uninvertible=false. The circuit breakers look really useful. I was ready to front each server with nginx and let it do the limiting. I’ve now seen both Netflix and Chegg search clusters take out the entire site because

Re: Best example solrconfig.xml?

2020-12-15 Thread Erick Erickson
I’d start with that config set, making sure that “schemaless” is disabled. Do be aware that some of the defaults have changed, although the big change for docValues was there in 6.0. One thing you might want to do is set uninvertible=false in your schema. That’ll cause Solr to barf if you,

Re: Solr Collection Reload

2020-12-15 Thread Erick Erickson
Well, there’s no information here to help. The first thing I’d check is what the Solr logs are saying. Especially if you’ve changed any of your configuration files. If that doesn’t show anything, I'd take a thread dump and look at that, perhaps there’s some deadlock. But that said, a reload

Re: [SOLR-8.5.2] Commit through curl command is causing delay in issuing commit

2020-12-15 Thread raj.yadav
Hi All, For further investigation, I have raised a JIRA ticket. https://issues.apache.org/jira/browse/SOLR-15045 In case, anyone has any information to share, feel free to mention it here. Regards, Raj -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solrcloud load balancing / failover

2020-12-14 Thread Shalin Shekhar Mangar
No, the load balancing is based on random selection of replicas and CPU is not consulted. There are limited ways to influence the replica selection, see https://lucene.apache.org/solr/guide/8_4/distributed-requests.html#shards-preference-parameter If a replica fails then the query fails and an

Re: solrcloud with EKS kubernetes

2020-12-14 Thread Shalin Shekhar Mangar
FWIW, I have seen Solr exhaust the IOPS burst quota on AWS causing slow replication and high latency for search and indexing operations. You may want to dig into cloud watch metrics and see if you are running into a similar issue. The default IOPS quota on gp2 is very low (100?). Another thing to

Re: SolrException: Can't determine a Sort Order with Solr 6.6

2020-12-14 Thread fereira
I've run into the same issue with a Rails application that uses the Rsolr gem to make calls to Solr. I will have to check if the issue is in Rsolr or in my application, changing the %2B (+ sign) to a %20 (space char) in the request URL fixes the issue. I also just wanted to say hello to wunder.

Re: 8.6.1 configuring ssl on centos 7

2020-12-14 Thread Bogdan C.
Thanks for replying Shawn.Yea etc/default/solr.in.sh is updated for for 8984 and theres no modification to /etc/init.d/solrThere's no SSL related errors in the logs on startup the entry below confuses me even more 2020-12-14 13:24:50.811 INFO  (main) [   ] o.e.j.s.AbstractConnector Started

Re: Function Query Optimization

2020-12-14 Thread Jae Joo
Should SubQuery be faster than FunctionQuery? On Sat, Dec 12, 2020 at 10:24 AM Vincenzo D'Amore wrote: > Hi, looking at this sample it seems you have just one document for '12345', > one for '23456' and so on so forth. If this is true, why don't just try > with a subquery > >

Re: [SOLR-8.5.2] Commit through curl command is causing delay in issuing commit

2020-12-14 Thread raj.yadav
Hi All, As I mentioned in my previous post that reloading/refreshing of the external file is consuming most of the time during a commit operation. In order to nullify the impact of external files, I had deleted external files from all the shards and issued commit through the curl command. Commit

Re: solrcloud with EKS kubernetes

2020-12-13 Thread Abhishek Mishra
Hi Houston, Sorry for the late reply. Each shard has a 9GB size around. Yeah, we are providing enough resources to pods. We are currently using c5.4xlarge. XMS and XMX is 16GB. The machine is having 32 GB and 16 core. No, I haven't run it outside Kubernetes. But I do have colleagues who did the

Re: 8.6.1 configuring ssl on centos 7

2020-12-13 Thread Shawn Heisey
On 12/13/2020 7:21 AM, Bogdan C. wrote: Solr is installed and working on http (8983). I (think I) have the keystore configured properly and solr.in.sh modified for the SOLR_SSL_* config settings. Not sure how to modify the service startup to listen on 8984 for ssl. solr documentation says to

Re: [SOLR-8.5.2] Commit through curl command is causing delay in issuing commit

2020-12-12 Thread raj.yadav
Hi All, Till we investigate further about this issue. Can anyone please share what other ways we can issue a commit or point me to existing documents that have a relevant example. Regards, Raj -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: DIH and UUIDProcessorFactory

2020-12-12 Thread Shawn Heisey
On 12/12/2020 2:30 PM, Dmitri Maziuk wrote: Right, ```Every update request received by Solr is run through a chain of plugins known as Update Request Processors, or URPs.``` The part I'm missing is whether DIH's 'name="/dataimport"' counts as an "Update Request", my reading is it doesn't and

Re: Copyfields, will there be any difference between source and dest if they are switched?

2020-12-12 Thread Shawn Heisey
On 12/11/2020 2:38 PM, ufuk yılmaz wrote: My question is, will there be any difference on the resulting indexed documents if I switched source and dest fields in copyField directive? My understanding is copyField operates on raw data arriving at Solr as is, and field declarations themselves

Re: DIH and UUIDProcessorFactory

2020-12-12 Thread Dmitri Maziuk
On 12/12/2020 2:50 PM, Shawn Heisey wrote: The only way I know of to use an update processor chain with DIH is to set 'default="true"' when defining the chain. I did manage to find an example with the default attribute, in javadocs:

Re: DIH and UUIDProcessorFactory

2020-12-12 Thread Shawn Heisey
On 12/12/2020 12:54 PM, Dmitri Maziuk wrote: is there an easy way to use the stock UUID generator with DIH? We have a hand-written one-liner class we use as DIH entity transformer but I wonder if there's a way to use the built-in UUID generator class instead. From the TFM it looks like there

Re: DIH and UUIDProcessorFactory

2020-12-12 Thread Alexandre Rafalovitch
Why not? You should be able to put an URP chain after DIH, the usual way. Is that something about UUID that is special? Regards, Alex On Sat., Dec. 12, 2020, 2:55 p.m. Dmitri Maziuk, wrote: > Hi everyone, > > is there an easy way to use the stock UUID generator with DIH? We have a >

Re: Function Query Optimization

2020-12-12 Thread Vincenzo D'Amore
Hi, looking at this sample it seems you have just one document for '12345', one for '23456' and so on so forth. If this is true, why don't just try with a subquery https://lucene.apache.org/solr/guide/6_6/transforming-result-documents.html#TransformingResultDocuments-_subquery_ On Fri, Dec 11,

Re: Solr Collection reload task has been in running state for a very long time

2020-12-11 Thread Moulay Hicham
Hi, I will really appreciate if someone can help me with this. Thank you, Moulay On Thu, Dec 10, 2020, 8:28 AM Moulay Hicham wrote: > Hi, > > We have a solr cluster of 30 nodes with a Replication Factor =3. > Each index size is about 80GB. > Solr version is 8.1 > The cluster has high TPS

Re: Vulnerabilities in SOLR 8.6.2

2020-12-11 Thread Walter Underwood
> 201-284-3345 > M: 845-300-3809 > Email: lakshmi.naraya...@mmc.com <mailto:lakshmi.naraya...@mmc.com> > > > From: Narayanan, Lakshmi <mailto:lakshmi.naraya...@mmc.com>> > Sent: Sunday, October 04, 2020 2:11 PM > To: solr-user@lucene.apache.org

Re: Timeout occured while waiting response from server

2020-12-11 Thread raj.yadav
elivis wrote > See: > https://lucene.472066.n3.nabble.com/SolrServerException-Timeout-occured-while-waiting-response-from-server-tc4464632.html > > Maybe this will help somebody. I was dealing with exact same problem. We > are > running on VMs, and all of our timeout problems went away after we >

Re: Timeout occured while waiting response from server

2020-12-10 Thread elivis
See: https://lucene.472066.n3.nabble.com/SolrServerException-Timeout-occured-while-waiting-response-from-server-tc4464632.html Maybe this will help somebody. I was dealing with exact same problem. We are running on VMs, and all of our timeout problems went away after we switched from a 5yo VmWare

Re: SolrCloud crashing due to memory error - 'Cannot allocate memory' (errno=12)

2020-12-10 Thread Walter Underwood
How much RAM do you have on those machines? That message says you ran out. 32 GB is a HUGE heap. Unless you have a specific need for that, run with a 8 GB heap and see how that works. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Dec 10, 2020, at

Re: nested facets of query and terms type in JSON format

2020-12-10 Thread Arturas Mazeika
Hi Jason, Thanks a lot for the post. Indeed the web page you are referring to has some very nice examples. Well done. Cheers, Arturas Increasing the number of threads (through the url or params section) is unsuccessful so far. Maybe solr takes it only as a hint. On Thu, Dec 10, 2020 at 8:01 PM

Re: increasing number of threads for faceting in JSON format

2020-12-10 Thread Arturas Mazeika
g-parameters > > [2] > > > https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.7.0/solr/core/src/java/org/apache/solr/request/SimpleFacets.java > > [3] > > > https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.7.0/solr/core/src/java/org/apache/

Re: nested facets of query and terms type in JSON format

2020-12-10 Thread Jason Gerlowski
Hey Arturas, Can't help you with the secrets of Michael's inspiration (though I'm also curious :-p). And I'm not sure if there's any equivalent of facet.threads for JSON Faceting. You're on your own there unfortunately. But you (or other readers) might find this "Query Facet" example handy -

Re: increasing number of threads for faceting in JSON format

2020-12-10 Thread Munendra S N
quest/SimpleFacets.java > [3] > https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.7.0/solr/core/src/java/org/apache/solr/search/facet/FacetRangeProcessor.java#L112-L113 > > From: solr-user@lucene.apache.org At: 12/03/20 22:47:35To: > solr-user@lucene.apache.org > Su

Re: increasing number of threads for faceting in JSON format

2020-12-10 Thread Christine Poerschke (BLOOMBERG/ LONDON)
impleFacets.java [3] https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.7.0/solr/core/src/java/org/apache/solr/search/facet/FacetRangeProcessor.java#L112-L113 From: solr-user@lucene.apache.org At: 12/03/20 22:47:35To: solr-user@lucene.apache.org Subject: Re: increasing number of

Re: Solr cloud issuse: Async exception during distributed update

2020-12-10 Thread Colvin Cowie
Hi, sounds like https://issues.apache.org/jira/browse/SOLR-13963 which was fixed in Solr 8.3.1 On Thu, 10 Dec 2020 at 06:20, Ritvik Sharma wrote: > Hi Houston, > Thanks for reply > > We dont have this kind of field. It's a field value and it is coming > randomly, not all the time. > We are

Re: Solr cloud issuse: Async exception during distributed update

2020-12-09 Thread Ritvik Sharma
Hi Houston, Thanks for reply We dont have this kind of field. It's a field value and it is coming randomly, not all the time. We are indexing using cloudsolrclient + spring data . It is coming on any value, I am trying to do indexing of ~30 million records. And it is coming on Solr cloud mode

Re: Solr cloud issuse: Async exception during distributed update

2020-12-09 Thread Houston Putman
Do you have a field named "314257s_seourls" in your schema? Is there a dynamic field you are trying to match with that name? - Houston On Thu, Dec 10, 2020 at 2:53 PM ritvik wrote: > Hi , > Please suggest, why it is happening. > > > > -- > Sent from:

Re: Solr cloud issuse: Async exception during distributed update

2020-12-09 Thread ritvik
Hi , Please suggest, why it is happening. -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: [CAUTION] SSL + Solr 8.5.1 in cloud mode + Java 8

2020-12-09 Thread Ritvik Sharma
This code is there but it does not show on solr running cammnd On Wed, 9 Dec 2020 at 23:28, rkrish84 wrote: > Commented out the solr_ssl_client_key_store related code section in solr.sh > file to resolve the issue and enable ssl. > > > > -- > Sent from:

Re: solrcloud with EKS kubernetes

2020-12-09 Thread Houston Putman
Hello Abhishek, It's really hard to provide any advice without knowing any information about your setup/usage. Are you giving your Solr pods enough resources on EKS? Have you run Solr in the same configuration outside of kubernetes in the past without timeouts? What type of storage volumes are

Re: [CAUTION] SSL + Solr 8.5.1 in cloud mode + Java 8

2020-12-09 Thread rkrish84
Commented out the solr_ssl_client_key_store related code section in solr.sh file to resolve the issue and enable ssl. -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Commits (with openSearcher = true) are too slow in solr 8

2020-12-09 Thread raj.yadav
Hi All, I tried debugging but unable to find any solution. Do let me know in case details/logs shared by me are not suffiecient/clear. Regards, Raj -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr cloud issuse: Async exception during distributed update

2020-12-09 Thread Ritvik Sharma
Hi Furkan I have added the mail. Please check. On Wed, 9 Dec 2020 at 12:52, Furkan KAMACI wrote: > Hi Ritwik, > > Could you send your e-mail to solr user list? > > Kind Regards, > Furkan KAMACI > > On 9 Dec 2020 Wed at 10:18 Ritvik Sharma wrote: > >> >> Hi Solr Owner , >> >> Please check

Re: Collection deleted still in zookeeper

2020-12-09 Thread Marisol Redondo
Yes, maybe it's more complicated I was thinking. But it's good to know that newer version of Solr still work in the same way. Thanks again On Mon, 7 Dec 2020 at 13:08, Erick Erickson wrote: > What should happen when you delete a collection and _only_ that > collection references the configset

Re: optimize boosting parameters

2020-12-08 Thread Derek Poh
surprise ;) Of course that means that to change the boosting you need to re-index. You use termfreq, which changes of course, but 1> if your corpus is updated often enough, the termfreqs will be relatively stable. in that case you can pre-compute them too. 2> your problem

Re: Need help to configure automated deletion of shard in solr

2020-12-08 Thread Pushkar Mishra
Hi Erick, COLSTATUS does not work with Implicit router type collection . Is there any way to get the replica detail ? Regards On Mon, Nov 30, 2020 at 8:48 PM Erick Erickson wrote: > Are you using the implicit router? Otherwise you cannot delete a shard. > And you won’t have any shards that

Re: Can I express this nested query in JSON DSL?

2020-12-08 Thread Mikhail Khludnev
Hi, Mikhail. Shouldn't be a big deal "bool":{ "must":[ "x", {"bool": {"should":["y","z"]}}] } On Tue, Dec 8, 2020 at 6:13 AM Mikhail Edoshin wrote: > Hi, > > I'm more or less new to Solr. I need to run queries that use joins all > over the place. (The idea is

Re: No numShards attribute exists in 'core.properties' with the newly added replica

2020-12-08 Thread Erick Erickson
I raised this JIRA: https://issues.apache.org/jira/browse/SOLR-15035 What’s not clear to me is whether numShards should even be in core.properties at all, even on the create command. In the state.json file it’s a collection-level property and not reflected in the individual replica’s

Re: optimize boosting parameters

2020-12-08 Thread Erick Erickson
they can be computed at index time, then boost by just the value of the pre-computed field. BTW, boosts < 1.0 _reduce_ the score. I mention that just in case that’s a surprise ;) Of course that means that to change the boosting you need to re-index. You use termfreq, which changes of course, bu

Re: Is there a way to search for "..." (three dots)?

2020-12-08 Thread Erick Erickson
Yes, but… Odds are your analysis configuration for the field is removing the dots. Go to the admin/analysis page, pick your field type and put examples in the “index” and “query” boxes and you’ll see what I mean. You need something like WhitespaceTokenizer, as your tokenizer, and avoid things

Re: Commits (with openSearcher = true) are too slow in solr 8

2020-12-08 Thread raj.yadav
matthew sporleder wrote > I would stick to soft commits and schedule hard-commits as > spaced-out-as-possible in regular maintenance windows until you can > find the culprit of the timeout. > > This way you will have very focused windows for intense monitoring > during the hard-commit runs.

Re: How to get the config set name of Solr core

2020-12-08 Thread Andreas Hubold
Hi, I was able to add the config set to the STATUS response by implementing a custom extended CoreAdminHandler. However, it would be nice if this could be added in Solr itself. I've create a JIRA for this: https://issues.apache.org/jira/browse/SOLR-15034 Kind regards, Andreas -- Sent from:

Re: optimize boosting parameters

2020-12-07 Thread Radu Gheorghe
Hi Derek, Ah, then my reply was completely off :) I don’t really see a better way. Maybe other than changing termfreq to field, if the numeric field has docValues? That may be faster, but I don’t know for sure. Best regards, Radu -- Sematext Cloud - Full Stack Observability -

Re: optimize boosting parameters

2020-12-07 Thread Derek Poh
Hi Radu Apologies for not making myself clear. I would like to know if there is a more simple or efficient way to craft the boosting parameters based on the requirements. For example, I am using 'if', 'map' and 'termfreq' functions in the bf parameters. Is there a more efficient or simple

Re: is there a way to trigger a notification when a document is deleted in solr

2020-12-07 Thread Walter Underwood
That wouldn’t help, because that is a feature request to know when the space is recovered after documents are deleted. I’d look at what shows up in the logs when the delete happens. From that info, you could configure a log follower to notifiy. If your logs go to a log database, that probably

Re: list of all possible values for REQUESTSTATUS

2020-12-07 Thread Ilan Ginzburg
If you don't want to download the code, you can look at REQUESTSTATUS_OP in CollectionOperation (in CollectionsHandler.java). Ilan On Mon, Dec 7, 2020 at 4:57 PM

Re: Commits (with openSearcher = true) are too slow in solr 8

2020-12-07 Thread matthew sporleder
I would stick to soft commits and schedule hard-commits as spaced-out-as-possible in regular maintenance windows until you can find the culprit of the timeout. This way you will have very focused windows for intense monitoring during the hard-commit runs. On Mon, Dec 7, 2020 at 9:24 AM

Re: is there a way to trigger a notification when a document is deleted in solr

2020-12-07 Thread Alexandre Rafalovitch
Maybe a postCommit listener? https://lucene.apache.org/solr/guide/8_4/updatehandlers-in-solrconfig.html Regards, Alex. On Mon, 7 Dec 2020 at 08:03, Pushkar Mishra wrote: > > Hi All, > > Is there a way to trigger a notification when a document is deleted in > solr? Or may be when auto purge

Re: is there a way to trigger a notification when a document is deleted in solr

2020-12-07 Thread Erick Erickson
No, it’s marked “unresolved”…. > On Dec 7, 2020, at 9:22 AM, Pushkar Mishra wrote: > > Hi All > https://issues.apache.org/jira/browse/SOLR-13609, was this fixed ever ? > > Regards > > On Mon, Dec 7, 2020 at 6:32 PM Pushkar Mishra wrote: > >> Hi All, >> >> Is there a way to trigger a

Re: Commits (with openSearcher = true) are too slow in solr 8

2020-12-07 Thread raj.yadav
Hi Folks, Do let me know if any more information required to debug this. Regards, Raj -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: is there a way to trigger a notification when a document is deleted in solr

2020-12-07 Thread Pushkar Mishra
Hi All https://issues.apache.org/jira/browse/SOLR-13609, was this fixed ever ? Regards On Mon, Dec 7, 2020 at 6:32 PM Pushkar Mishra wrote: > Hi All, > > Is there a way to trigger a notification when a document is deleted in > solr? Or may be when auto purge gets complete of deleted documents

<    1   2   3   4   5   6   7   8   9   10   >