Re: Issue with SolrJ api.mustache template / generated API classes

2024-06-08 Thread Jan Høydahl
Thanks for researching this. If you are Java savvy it would be super with a PR with a failing unit test. If you searched Jira and could not find a duplicate, feel free to report it. Jan Høydahl > 8. juni 2024 kl. 11:21 skrev Christos Malliaridis : > > Hello everyone, > >

"Not enough eligible nodes" errors with Affinity placement plugin

2024-06-05 Thread Jan Høydahl
Hi, I run a small 3-node test cluster with Solr Operator and Solr 9.6.1. Have configured the affinity placement plugin as follows { "plugin": { ".placement-plugin": { "name": ".placement-plugin", "class": "org.apache.solr.cluster.placement.plugins.AffinityPlacementFactory",

Re: Avoiding _shard1_replica_n1-directories in Solr cloud mode

2024-06-03 Thread Jan Høydahl
Hi, Cloud mode is not designed for you to micro manage core.properties. In fact you are not supposed to work on the "core" level at all, but rather issue API requests to create a collection, and let Solr create all the underlying cores. You should not need to care what the names of those core

Re: solr query sanitizer?

2024-05-30 Thread Jan Høydahl
I wrote this little plugin years ago https://github.com/cominvent/request-sanitizer-component That would be useful if you don't have control over the client doing the requests. If you control the client I'd add some sanitation there. Jan > 29. mai 2024 kl. 16:11 skrev Dmitri Maziuk : > > Hi

Re: SolrCloud Collections with Helm

2024-05-28 Thread Jan Høydahl
ecated > and removed in Kubernetes deployments (like in Kafka with KRaft). Are there > any further discussions I could track for updates besides those in > SOLR-16739 <https://issues.apache.org/jira/browse/SOLR-16739>? > > Best regards, > Christos > > On Mon, May 27, 2024

Re: Cannot Run Solr as the Solr User

2024-05-28 Thread Jan Høydahl
Hi, If using "sudo service solr start/stop" works for you, then what is your pain point? Please explain. As Shawn points out, the systed start script takes care of running the process under the "solr" user. Jan > 28. mai 2024 kl. 04:09 skrev Dmitri Maziuk : > > On 5/27/24 14:43, Lee Daniel

Re: SolrCloud Collections with Helm

2024-05-27 Thread Jan Høydahl
Hi You are correct that you'll use the ordinary Solr APIs to provision collections. Normally I'd recommend that the application that needs the collection should also have the responsibility of bootstrapping its config set and collection. Another popular option is to have an init container with

Re: Did Spring stopped supporting Solr from spring boot version 3.x ?

2024-05-24 Thread Jan Høydahl
Hi, There are a few things here. If you are talking about Spring Data, then the Solr integration was deprecated 4 years ago. I'm not aware of any fork of the project. If you do not use spring data for Apache solr, but use SolrJ client directly, you may encounter another issue with some

Re: CREATE via GUI or API fails - BaseHttpSolrClient$RemoteSolrException: Error from server

2024-05-16 Thread Jan Høydahl
The images did not make it to the list. Can you share them elsewhere? Does it work if you disable authentication plugin? I see a HTTP 403 error in the log which suggests there is an auth issue. Are you using forwardCredentials=true? Which solr version are you on? Jan Høydahl > 16. mai 2

Re: Solr 9.7.0 Release Date

2024-05-16 Thread Jan Høydahl
Hi There is no date. We don’t plan releases in advance. But a 9.6.1 release is soon to leave the station. You should check whether all your wanted fixes are in branch_9_6, if not feel free to back port the ones you care about. Jan Høydahl > 16. mai 2024 kl. 21:02 skrev Himanshu S

Re: Problems migrating solrj to run with SpringBoot 3

2024-05-16 Thread Jan Høydahl
You’ll have to wait for a later solr release with a compatible jetty. We have a plan to make jetty optional for SolrJ but it still is needed. Jan Høydahl > 16. mai 2024 kl. 19:07 skrev Luke Kot-Zaniewski (BLOOMBERG/ 919 3RD A) > : > > Hard to say without seeing your project but

Re: Memory tuning advice for small single-node Solr instance

2024-05-07 Thread Jan Høydahl
Hi, If you have not tuned your heap, it will default to 512m. THe lines in solr.in.sh prefixed with hash # are comments and do nothing. If you experience OOME during use that is likely not enough for your use case. So edit the file, remove the hash and set SOLR_HEAP=1024m to give yourself some

Re: AUTHC_OPTS environment variable ignored in solr.cmd

2024-05-06 Thread Jan Høydahl
Looks like a bug. In the linux script the AUTHC_OPTS var is added to SCRIPT_SOLR_OPTS but that does not seem to be the case for windows script. I think you can open a JIRA. In the ticket, please provide a step by step instruction to reproduce from a fresh git checkout. And if you have the

Re: Facets search in Jave spring framework

2024-05-02 Thread Jan Høydahl
Hi, You'll want to use SolrJ as a client, see https://solr.apache.org/guide/solr/latest/deployment-guide/solrj.html Here is one tutorial that shows some code https://www.baeldung.com/full-text-search-with-solr Feel free to ask more specific questions as you progress. Jan > 1. mai 2024 kl.

Re: [EXTERNAL] SOLR Shard nodes are unhealthy

2024-04-25 Thread Jan Høydahl
Make sure you use fully qualified domain names everywhere, and that they are routable everywhere. If you start Solr with -h my-short-name then it will be persisted in zk state and will not be routable from all other solr hosts. Jan Høydahl > 25. apr. 2024 kl. 13:34 skrev Ritesh Ku

Re: Zookeeper Expanded - Solr not connecting

2024-04-24 Thread Jan Høydahl
Hi, You could try some manual commands from the Solr node, check out "bin/solr zk", where you can try e.g. an "ls" command. Perhaps you get some more details in the logs. Note that the Zookeeper protocol talks on TCP level, not HTTP. You can also check the connection with a command like this

Re: [EXTERNAL] SOLR Shard nodes are unhealthy

2024-04-24 Thread Jan Høydahl
Hi, Indeed, Solr 8.11 used zk client v3.6.2, but I believe it will also work with newer 3.x versions, you can test this locally on your laptop first to be sure. Note also that network resolution should work between all nodes on the FQDN. So if your ZK1 node is called ZK1.region3.example.com

Re: SOLR Shard nodes are unhealthy

2024-04-24 Thread Jan Høydahl
Hi, First, you should use the latest 8.11.3 which has a lot of fixes. Your setup could work if the regions are connected with really low latency and high bandwidth. Your description suggests that your Solr-ZK connection is not as it should. A few assumptions for this to work: * You ave

Re: Solr-9.5 | collection creation error

2024-04-23 Thread Jan Høydahl
the same error. > > I can see the clusterprops.json file is missing to update urlScheme. Can you > please let me know how to address this? > > > > > On Tue, Apr 23, 2024 at 2:20 AM Jan Høydahl <mailto:jan@cominvent.com>> wrote: >> Hi, >> >

Re: Solr-9.5 | collection creation error

2024-04-22 Thread Jan Høydahl
r node crash or recover during this process?* > No > *- Are there ERRORs in Zookeeper's log files?* > No errors in ZK logs. > > Please let me know if any other info is required. > > > > On Wed, Apr 17, 2024 at 12:39 PM Jan Høydahl wrote: > >> Hi, >> &

Re: Error installing solr-8.11.3 on RHEL 9.3

2024-04-17 Thread Jan Høydahl
should be able to make it work for Solr 9.x. Jan > 17. apr. 2024 kl. 23:22 skrev Dmitri Maziuk : > > On 4/17/24 15:47, Jan Høydahl wrote: >> Hi, >> I believe RHEL uses systemd, so you'll have to first install the package for >> initd, I cannot remember the yum nam

Re: Error installing solr-8.11.3 on RHEL 9.3

2024-04-17 Thread Jan Høydahl
Hi, I believe RHEL uses systemd, so you'll have to first install the package for initd, I cannot remember the yum name now. Then try the install script again. Jan > 17. apr. 2024 kl. 17:43 skrev Johnnie W Adams : > > Hi, folks, > > I've hit some errors on attempting this install: > >

Re: Solr-9.5 | collection creation error

2024-04-17 Thread Jan Høydahl
Hi, Do you mind sharing the details with us? - Exactly how did you install Solr, and what is your ZK_HOST connection string? - Exactly how did you install ZK, and what is your zoo.cfg, on each of the three nodes. - Which command did you use to create the collection? - Does this happen every

Re: enableRemoteStreaming+enableStreamBody-change in Solr 8.11.3

2024-04-12 Thread Jan Høydahl
Hi, You are right that the env.vars approach was not backported to 8.x. The workaround you can use in solr.in.sh is: The workaround is to set in solr.in.sh: SOLR_OPTS="$SOLR_OPTS -Dsolr.enableRemoteStreaming=true -Dsolr.enableStreamBody=true" This should have been documented in the reference

Re: Deploying solr war in jetty

2024-03-13 Thread Jan Høydahl
Hi. You are correct. Solr is no longer a WAR, it is a standalone app. All attempt to rip out pieces to make it run elsewehre is unsupported and on your own risk (though probably possible). We highly recommend following the documented means of installing Solr into your environment. Please

Re: Document routing.

2024-03-07 Thread Jan Høydahl
; >> On Wed, Mar 6, 2024 at 9:10 AM Modassar Ather >> wrote: >> >>> Thanks Jan for your response. >>> >>> I am doing completely fresh indexing after the id change. >>> >>> Best regards, >>> Modassar >>> >>> O

Re: Document routing.

2024-03-06 Thread Jan Høydahl
Never change the ID of a document, it must be static in order for routing to work. If you need to change an ID, first issue a delete command for the old id. Read more about routing and composite ID here

Re: Setting up basic authentication in Solr 8.11.1 Standalone

2024-02-28 Thread Jan Høydahl
You need a few more permissions in order for that Admin screen to work. Try instead the default security.json generated by bin/solr auth enable (cloud mode): { "authentication":{ "blockUnknown": true, "class":"solr.BasicAuthPlugin",

Re: Is this list alive? I need help

2024-02-23 Thread Jan Høydahl
I think EFS is a terribly slow file system to use for Solr, who recommended it? :) Better use one EBS per node. Not sure if the gradually slower performance is due to EFS though. We need to know more about your setup to get a clue. What role does stunnel play here? How are you indexing the

Re: Run solr in cloud mode and debug from intellij

2024-02-23 Thread Jan Høydahl
Hi, Thanks for this contrib. My only concern is that it is duplicating what is already explained in https://github.com/apache/solr/blob/main/dev-docs/solr-source-code.adoc But that file is also too hard to find, so agree the main README should at least provide a hint on how to build and run

Re: Stripping HTML before indexing

2024-02-20 Thread Jan Høydahl
I have never used the "typeClass" option. Have you tried with "typeName" or "fieldName" as an alternative? Jan > 20. feb. 2024 kl. 13:44 skrev Gino Rodrigues : > > O left a small mismatch on the field type, the fields I am trying to clean > are all “text_general“ (class solr.TextField) > > Em

Re: CVE-2021-31684: SOLR- net.minidev_json-smart (Out of Bounds Read)

2024-02-13 Thread Jan Høydahl
Not vulnerable since 9.3. Newest is 9.5. Changelog on Solr website and in GitHub. Always check newest version before filing a bug/mail. 9.x versions prior to 9.5 will not receive bug fixes. Jan Høydahl > 13. feb. 2024 kl. 18:07 skrev Shahryar Shagoshtasbi > : > > Hi there, &g

Re: CVE-2021-31684: SOLR- net.minidev_json-smart (Out of Bounds Read)

2024-02-13 Thread Jan Høydahl
Hi Shahryar, You do not specify what versions of Solr you believe to be vulnerable to those two CVEs. A quick check finds that they are both already plugged both in all actively supported versions of Solr (i.e. 9.x and 8.11.x). In the future you can check this yourself by looking at Solr's

Re: Does documentCache still make sense in modern Solr?

2024-02-10 Thread Jan Høydahl
I've always told clients that DocumentCache only make sense if they can achieve a significant cache hit ratio and have slow disks. For most installs I've been involved with, that has not been the case, and we have disabled the cache. Interesting find that it may actually hurt performance, so I

Re: Memory usage reported by Solr

2024-02-09 Thread Jan Høydahl
Hi, You may want to upload those screenshots to some external service as they did not display on the list. Solr uses Java APIs to ask for system memory, and when running in a container which is resource limited, it will show the max limit allocated to that container. Jan > 9. feb. 2024 kl.

Re: [EXTERNAL] - Re: Solr9 support for Tomcat10

2024-02-02 Thread Jan Høydahl
s the procedure to > create a private build. > Can we migrate the jars using the Tomcat migration tool? > > Thanks, > Suraksha > > -----Original Message- > From: Jan Høydahl [mailto:jan@cominvent.com] > Sent: Thursday, February 1, 2024 1:23 PM > To: users@solr

Re: Solr9 support for Tomcat10

2024-01-31 Thread Jan Høydahl
. But you can make a private build of Solr earlier of course. Jan Høydahl > 1. feb. 2024 kl. 07:05 skrev Suraksha Shetty : > > Hi All, > > We are migrating Tomcat 9 to 10.1 in our product. As part of this migration > namespace Javax is changed to Jakarta. > We are using Solr9 a

Re: Setting up Basic Authentication on Solr Cloud

2024-01-26 Thread Jan Høydahl
Hi, You probably want to enable SSL for Solr if you use BasicAuth. For ZK, ACL protection could be the first step, as described in https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html Protecting ZK connection with SSL is probably also smart, but it is

Re: Connection refused in solr 9.4.0

2024-01-25 Thread Jan Høydahl
This same question was asked yesterday on this list. Answer is to set SOLR_JETTY_HOST=0.0.0.0 to bind to any network interface, not only local. Jan > 25. jan. 2024 kl. 14:05 skrev Gummadi, Ramesh > : > > I am trying to upgrade solr cloud from version 8.11.1 to 9.4.0. Solr > service started

Re: Correct Procedure for making Basic Authentication Changes LIVE across Multiple Nodes in Solr Cloud 8.10

2023-12-29 Thread Jan Høydahl
No need to shut down servers. Do the configuration change in security.json. Done. What is the remaining question here? Jan Høydahl > 29. des. 2023 kl. 18:44 skrev Uday Kumar : > > Hello yilmaz, > > But we cannot afford to shutdown all our servers for some time. > >>

Re: stopfilter nullpointerexception

2023-12-29 Thread Jan Høydahl
Hi, It is indeed an empty (null) stopwords "CharArraySet" being passed in https://github.com/apache/lucene/blob/branch_9_8/lucene/core/src/java/org/apache/lucene/analysis/StopFilter.java#L39 If you flip back to class="solr.StopFilterFactory", does it work then? Does your stopwords.txt file

Re: Correct Procedure for making Basic Authentication Changes LIVE across Multiple Nodes in Solr Cloud 8.10

2023-12-27 Thread Jan Høydahl
Sorry no Experience with Kerberos. Jan Høydahl > 27. des. 2023 kl. 01:13 skrev Uday Kumar : > > Hi Jan, > Need One small confirmation, out of curiosity! > > Document2 reference does not apply to you as it is Kerberos plugin. > Let's assume if we try to go with Kerber

Re: Correct Procedure for making Basic Authentication Changes LIVE across Multiple Nodes in Solr Cloud 8.10

2023-12-26 Thread Jan Høydahl
ity.json > > Thanks and regards, > Uday Kumar > > > > > On Tue, Dec 26, 2023, 16:04 Jan Høydahl wrote: > >> It is correct that Auth changes take effect across all nodes. So that >> would be your procedure, done. >> >> May you have looked at d

Re: Correct Procedure for making Basic Authentication Changes LIVE across Multiple Nodes in Solr Cloud 8.10

2023-12-26 Thread Jan Høydahl
It is correct that Auth changes take effect across all nodes. So that would be your procedure, done. May you have looked at docs for self-managed Solr with no zookeeper? In that case you must touch each node at a time. Jan Høydahl > 26. des. 2023 kl. 08:20 skrev Uday Kumar : > > 

Re: List of modules?

2023-12-22 Thread Jan Høydahl
Really, if you have a pointing to ../../contrib// that would translate into having to enable module with name , not? One could make an explicit list but it would be fairly un-surprising if I recall correctly. Jan > 20. des. 2023 kl. 19:50 skrev Eric Pugh : > > Maybe add >

Re: No schema designer in Admin of Solr 9.4.0

2023-12-18 Thread Jan Høydahl
myCollection open http://localhost:8983 <http://localhost:8983/> Jan > 18. des. 2023 kl. 09:58 skrev Szűcs Roland : > > Hey Jan, > > I even tried with CTRL+SHIFT+I where I cloud mark disabled cash property > for the analysis. And it is still not shown up. > > Rol

Re: No schema designer in Admin of Solr 9.4.0

2023-12-17 Thread Jan Høydahl
Have you tried to refresh your browser (SHIFT+F5), you may be looking at an old cached admin page. Jan > 17. des. 2023 kl. 12:43 skrev Szűcs Roland : > > Hi folks, > > In the documentation > > I saw a very handy

Re: Solr authentication options

2023-12-17 Thread Jan Høydahl
The SolrRequest supports addHeader(), so you may be able to add the JWT header to the request, then call mySolrRequest.process(myHttpSolrClient) Jan > 16. des. 2023 kl. 08:46 skrev ufuk yılmaz : > > Isn’t jwt token just some http header? I wonder if it could be added easily > by constructing

Re: Prevent Loss of Documents after Implicit Sharding

2023-11-30 Thread Jan Høydahl
I thought multi valued field was not supported as routing field? You'll likely need to choose a single-valued stable property for routing and not a value that a field that a single document can have several different values for. So have a look at your schema for other candidate single-valued

Re: Solr Cloud + zookeeper+ kubernetes setup

2023-11-23 Thread Jan Høydahl
In k8s it’s quite simple already. But if the SIP is done there will be similar operational benefits for manual installs as well. But I would not hold my breath, may never happen. Jan Høydahl > 23. nov. 2023 kl. 18:50 skrev Dmitri Maziuk : > > On 11/23/23 04:59, Jan Høyd

Re: Solr Cloud + zookeeper+ kubernetes setup

2023-11-23 Thread Jan Høydahl
ing the > overall availability of the cluster. > > When you need a high read high write cluster, it’s better to put zookeeper on > its own machines I think. > > -ufuk yilmaz > >> On 23 Nov 2023, at 00:25, Jan Høydahl wrote: >> >> I think there is a product th

Re: Solr Cloud + zookeeper+ kubernetes setup

2023-11-22 Thread Jan Høydahl
I think there is a product that speaks ZK api but stores everything in etcd :) Also, you may want to check out https://cwiki.apache.org/confluence/display/SOLR/SIP-18%3A+A+Solr+Kubernetes+Module+for+native+integration , an initiative that will let you use ConfigMaps for configSet files etc.

Re: Solr Cloud + zookeeper+ kubernetes setup

2023-11-22 Thread Jan Høydahl
Hi, I'd have a look at https://solr.apache.org/operator/ for more info about the official support for running Solr in k8s. There is also this 3rd party Helm chart which is well maintained and perhaps easier to get started with: https://artifacthub.io/packages/helm/bitnami/solr Good luck. Jan

Re: Apache SolR and CVE-2023-44487

2023-10-27 Thread Jan Høydahl
There is work in progress on a 8.11.3 release, which will include Jetty 9.4.53.v20231009 which also is not vulnearble. Follow the dev-list for details on the progress of this release. Jan > 27. okt. 2023 kl. 10:32 skrev Isabella Trevisan > : > > I read that version 9.4.0 mitigates this

Re: Apache SolR and CVE-2023-44487

2023-10-27 Thread Jan Høydahl
Hi, Why do you believe Solr is vulnerable to this CVE? The latest version 9.4.0 contains Jetty 10.0.17 . Jan > 27. okt. 2023 kl. 10:16 skrev Isabella Trevisan > : > > Sorry , I correct the CVE number CVE-2023-44487. > > Il

Re: Trouble with ZK Status and TLS

2023-10-19 Thread Jan Høydahl
The Admin UI ZK screen is not intended for the SSL connection to ZK, since status is not supported on that protocol. Instead we need to add support for the ZK AdminServer to get the same. Contributions are welcome. Jan > 19. okt. 2023 kl. 22:29 skrev Jamie Gruener : > > We’re working on

Re: Solr 8.11.2 Admin Panel

2023-10-18 Thread Jan Høydahl
Hi, You do not show how to reproduce your issue. Did it work before? From where are you connecting to Solr? What does the log say (/var/solr/logs/solr.log) ? What do you see in your browser when attempting to open Admin UI? I would use Java 17 if I were you but looks like Solr is up.. Jan > 18.

Re: SolrCloud sharding. Replicas on different AZ

2023-10-04 Thread Jan Høydahl
Yes, have a look at https://solr.apache.org/guide/solr/latest/configuration-guide/replica-placement-plugins.html Jan Høydahl > 4. okt. 2023 kl. 15:48 skrev ufuk yılmaz : > > You should be able to specify exact replica locations when creating a > collection. I don’t remembe

Re: Soft commit takes 5 seconds in Solr 8.9.0

2023-09-28 Thread Jan Høydahl
> 2 > false > > > 100} > > > We are indexing via zoo keeper and do not commit after indexing all because > we have configured in solr config xml. > > On Thu, Sep 28, 2023 at 5:15 PM Jan Høydahl wrote: > >> How many docs have you added before the

Re: Soft commit takes 5 seconds in Solr 8.9.0

2023-09-28 Thread Jan Høydahl
How many docs have you added before the softCommit? Do you use any cache warming or other commit hooks? Jan > 28. sep. 2023 kl. 13:28 skrev John Jackson : > > Hello > > We are using Solr 8.9.0. We have configured Solr cloud like 2 shards and > each shard has one replica. We have used 5 zoo

Re: Backup from old server and Restore to new server

2023-09-25 Thread Jan Høydahl
there be a > flood of traffic on whatever its indexing from? I'm keen to avoid a sudden > surge which takes down our webservers. > > On Mon, Sep 25, 2023 at 4:39 PM Jan Høydahl wrote: > >> Hi, >> >> Absolutely. And if your company lacks documentation and routi

Re: Backup from old server and Restore to new server

2023-09-25 Thread Jan Høydahl
copying it across? > So if that's what you're saying, what would be the steps I'd need to take? > I'm guessing create core, copy config files, > > On Mon, Sep 25, 2023 at 3:55 PM Jan Høydahl wrote: > >> I highly recommend doing a full re-index from scratch to the new clu

Re: Backup from old server and Restore to new server

2023-09-25 Thread Jan Høydahl
I highly recommend doing a full re-index from scratch to the new cluster. Then, test it in your dev/test environment. And finally, switch your search app to the new server. Jan > 25. sep. 2023 kl. 09:40 skrev Jim Morgan : > > Hi, > I inherited a solr installation from a previous sysadmin, and

Re: build issue

2023-09-14 Thread Jan Høydahl
You may need Perl installed for that: https://github.com/apache/solr/blob/main/gradle/documentation/changes-to-html.gradle#L23. See https://github.com/apache/solr/blob/main/dev-docs/how-to-contribute.adoc for some details. Jan > 13. sep. 2023 kl. 19:39 skrev Nope nope : > > I am currently

Re: Optimal Sharding Strategy for Solr Cloud v8.10

2023-09-13 Thread Jan Høydahl
inear speedup with sharding. > Double the shards, halve the response time. > > wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > >> On Sep 13, 2023, at 4:48 AM, Jan Høydahl wrote: >> >> Hi, >> &

Re: Solr latest 9.x - SOLR_HOST

2023-09-13 Thread Jan Høydahl
Are you modifying the correct solr.in.sh file? How do you install solr? Can you by any chance reproduce this in a new, tiny, fresh 9.3 cluster, to rule out old cruft remaining from an existing install? Jan > 13. sep. 2023 kl. 04:29 skrev Natarajan, Rajeswari > : > > Additional details > >

Re: Optimal Sharding Strategy for Solr Cloud v8.10

2023-09-13 Thread Jan Høydahl
Hi, There are no hard rules wrt sharding, it often comes down to measuring and experimenting for your workload. There are other things to consider than shard size. Why are the queries slow? How many rows do you ask for? Do you use faceting? Grouping? You have 25Gb of data on each of the 8

Re: Get Circuit Breaker Status

2023-09-08 Thread Jan Høydahl
> 8. sep. 2023 kl. 20:59 skrev Lyn Evans : > > How can I request from the Solr developer’s team, to incorporate Circuit > Breaker details in the Admin UI ? > > -Lyn > > From: Jan Høydahl mailto:jan@cominvent.com>> > Date: Friday, September 8, 2023 at 11:

Re: Get Circuit Breaker Status

2023-09-08 Thread Jan Høydahl
dev-slr-dat-2:8900/solr/doc1_2020-01-01/admin/circuit-breaker?cpuEnabled=false=90=true=110=99=noDistributeCB%2cnoDistributeMDCB%2cnoDistributeFTCB%3e> > > Once we’ve invoked this endpoint, the CB config or “status” has been changed. > > -Lyn > > From: Jan Høydahl > Date

Re: Get Circuit Breaker Status

2023-09-08 Thread Jan Høydahl
What do you mean by "status"? You can find the CB in solrconfig.xml, and there is not really much more status to be found? Jan > 8. sep. 2023 kl. 16:04 skrev Lyn Evans : > > Are there plans to display the current Circuit Breaker details on the Solr > Admin UI ? > > Otherwise, how can I query

Re: MultiAuthPlugin and Keycloak / OIDC

2023-08-31 Thread Jan Høydahl
Hi, Do both auth plugins work for ordinary API requests? I.e. is it only the Admin UI login that is broken? Have you tried force refreshing your browser (shift-f5)? Jan > 31. aug. 2023 kl. 14:56 skrev Primordial Atom : > > Hi there, > > for a while now, I've been struggling with the

Re: Re-index after upgrade

2023-08-28 Thread Jan Høydahl
/org/apache/lucene/index/SegmentInfos.java#L345 > > https://github.com/apache/lucene/blob/releases/lucene/9.4.0/lucene/core/src/java/org/apache/lucene/util/Version.java#L262 > > -Rahul > > On Mon, Aug 28, 2023 at 2:31 PM Shawn Heisey wrote: > >> On 8/28/23 05:03, Jan Hø

Re: Re-index after upgrade

2023-08-28 Thread Jan Høydahl
Are you sure that 9.x refuse to open an index first created in 7.x? I thought that strict policy was only needed in 8.0 due to a particular lossy data structure change, and that 9.x is more lenient? Jan > 24. aug. 2023 kl. 22:38 skrev Shawn Heisey : > > Version 9 behaves the same as 8. If

Re: SolR 9.3.0 embeddedn zookeeper on wildcard address

2023-08-23 Thread Jan Høydahl
Perhaps you are affected by this https://issues.apache.org/jira/browse/SOLR-16926 which is recently fixed but not released? Jan > 23. aug. 2023 kl. 12:18 skrev Morten Bøgeskov : > > Sorry I forgot to attach the log > > > From: Morten Bøgeskov > Sent:

Re: Inquiry Regarding CVEs and Their Impact on Apache Solr 8.11.2

2023-08-22 Thread Jan Høydahl
Hi, It would be helpful if you instead of copy/pasting 10 CVE numbers, could break it up and list one by one with its title and summary, and why you have reason to worry that it is a problem for Solr. Then our team can consider each one you believe to be problematic, and decide whether we are

Re: Antw: Solr Image 8.11.2 susceptible to CVE-2021-31879 and GHSA-jgvc-jfgh-rjvv

2023-08-21 Thread Jan Høydahl
Hi, The jose4j attack would affect the `jwt-auth` module, but only if JWT payload is encrypted with RSA1_5 or RSA_OAEP algos, which is something you setup in your Identity Provider, and has been discouraged for years. So I would not expect it to be anything to worry about. Likewise 'wget'

Re: [EXTERNAL] authentication for Leader/Follower replication

2023-08-14 Thread Jan Høydahl
This is probably due to SecurityManager rejecting an unknown path. Try starting Solr with: -Dsolr.allowPaths=/netmnt/ or set env variable SOLR_OPTS="$SOLR_OPTS -Dsolr.allowPaths=/netmnt/" Then try again. Alternatively you can try disabling SecMgr withenv.var

Re: Can we restore an existing Solr cloud cluster in a new zookeeper ensemble?

2023-08-14 Thread Jan Høydahl
This being a DEV environent, I'd re-create it and re-index from source. If this is lots of manual work, I'd take the opportunity of automating it. Jan > 7. aug. 2023 kl. 22:52 skrev Shamik Bandopadhyay : > > Hi, > > We are running a Solr Cloud infrastructure in our DEV environment with 4 >

Re: what is SolrAuthV2 and why does it break replication

2023-08-05 Thread Jan Høydahl
> nor does it work to set up security.json to allow replication without a > password Exactly how did you configure security.json for this? It could be that you succeeded disabling security for the collection but not for the core URL? Have you tried to hit

Re: PlacementPlugin to restrict two different shards of the same collection on the same node

2023-08-05 Thread Jan Høydahl
Hi, I do not see this being a factor in the Ref Guide either https://solr.apache.org/guide/solr/latest/configuration-guide/replica-placement-plugins.html#affinityplacementfactory Can you give an example of how the distribution? Were there other candidate nodes that had fewer or same number of

Re: Solr restart on Ubuntu is not "smooth"

2023-06-30 Thread Jan Høydahl
Hi, As I understand, you installed solr with the install_solr_service.sh script? Then the best way to restart the service is through 'service' command as documented in https://solr.apache.org/guide/solr/latest/deployment-guide/taking-solr-to-production.html#init-d-script sudo service solr

Re: primitive integer field

2023-06-27 Thread Jan Høydahl
You need indexed="true" to enable the dimensional index structure supporting range filters. If you do not ever need sorting on the field I suppose you could disable docValues. Jan > 27. jun. 2023 kl. 11:51 skrev Szűcs Roland : > > Hi Solr developers, > > I would like to have a price field in

Re: Index and tlog duplicated, searcher uses old index

2023-06-12 Thread Jan Høydahl
There is also a new "maxSize" setting for autoCommit, that could perhaps be used in place of maxDocs to prevent the trans-log growing too big, see https://solr.apache.org/guide/solr/latest/configuration-guide/commits-transaction-logs.html#automatic-commits I have seen the index.

Re: Solr Error| cluster state says we are the leader but locally we don't think so

2023-06-05 Thread Jan Høydahl
Hi, One possible reason for this could be that a shard leader experienced a high load (or crash), causing its Zookeeper client timeout, e.g. losing its live_nodes entry. That would cause a leader election, and a replica would become the new leader. Once the original leader re-joins it will no

Re: Not able to create custom Solr docker image on top of the base image (Solr 9.2.1)

2023-06-02 Thread Jan Høydahl
Some googling suggests that you may have an aged linux kernel on the BUILD machine/image used to run the docker build command, see https://stackoverflow.com/questions/66319610/gpg-error-in-ubuntu-21-04-after-second-apt-get-update-during-docker-build Try upgrading linux (or Jan > 2. jun. 2023

Re: Not able to create custom Solr docker image on top of the base image (Solr 9.2.1)

2023-06-01 Thread Jan Høydahl
I cannot reproduce this. Copied your Dockerfile and all succeeds (MacBook). You should consider adding USER solr as the last line of your file. Jan > 1. jun. 2023 kl. 18:38 skrev gnandre : > > Hi, > > I am running into the following issue while creating a custom docker image > on top of the

Re: Atomic updates too slow in Solr 8 vs Solr 7

2023-06-01 Thread Jan Høydahl
point I am > suspecting the slowness to be on Lucene's side with the findTargetArc() > method in FST.java. I am running more analysis on my side in parallel and > will share if/when I find more. > > -Rahul > > > > > > > > > > > >

Re: End of Life of Solr 8.11?

2023-06-01 Thread Jan Høydahl
If Lucene releases v10 this autumn, I may propose Solr 10 to follow quickly, in part to EOL the aging 8.x line with ant build system. You’ll just have to wait and see. If I needed to upgrade soon I’d go for 9.x, which will be supported and patched for a long long time. Jan Høydahl > 1.

Re: End of Life of Solr 8.11?

2023-06-01 Thread Jan Høydahl
Hi, Yes, it is EOL the same date that 10.0 is shippped. The release date of 10.0 is yet to be determined. I expect a few more 9.x releases to happen first though, and most likely we'll wait for Lucene 10 to ship first. Jan > 1. jun. 2023 kl. 09:36 skrev Thomas Heldmann > : > > Dear All, >

Re: Atomic updates too slow in Solr 8 vs Solr 7

2023-06-01 Thread Jan Høydahl
t. Let me create an index with a few million docs, call > RTG with a few million iterations on it and note the times between 7.x and > 8.x. I assume this should be sufficient (?) > > On Wed, May 31, 2023 at 5:19 PM Jan Høydahl wrote: > >> Would be nice to determine whether RTG

Re: Atomic updates too slow in Solr 8 vs Solr 7

2023-05-31 Thread Jan Høydahl
rect IO. >>> >>> I have noticed slow real time get on Solr 8.x during atomic update >> myself. >>> Would be interesting with a comparison with profiling. RTG gets the >>> document from transaction log I believe? Could there be some RTG changes >> in

Re: Atomic updates too slow in Solr 8 vs Solr 7

2023-05-31 Thread Jan Høydahl
Srijan wrote: > >> I would love some profiling as well. I know 8.8 or 8.9 had some performance >> problems with atomic update but this was later addressed. I cant find the >> jira atm though. Also I am on 8.11.1 and atomic update is not an issue for >> me. >>

Re: Atomic updates too slow in Solr 8 vs Solr 7

2023-05-31 Thread Jan Høydahl
RTG changes in 8.x that caused such slowdown? Jan Høydahl > 31. mai 2023 kl. 16:57 skrev Rahul Goswami : > > Thanks for the response Shawn. We are using Windows server with pretty huge > indexes (multiple TB cores). With Mmap, I have observed that the machine > just completely fr

Re: Issue in connecting zookeeper host from node js service

2023-05-31 Thread Jan Høydahl
Hi, It is safe to talk to any of the Solr nodes directly. Inside of GKE cluster, you will have a Service name for Solr that clients can connect to, and it will only forward traffic to healthy nodes. Besides, if a replica on a certain POD is e.g. in recovery mode, requests sent to that node

Re: Deleting document on wrong shard?

2023-05-24 Thread Jan Høydahl
I thought deletes were "broadcast" but probably for the composite-id router it is not since we know for sure where it resides. You say "shards were added" - how did you do that? Sounds like you shold simply re-create your collection and re-index? Jan > 24. mai 2023 kl. 16:39 skrev Walter

Help needed testing new systemd script (SOLR-14410)

2023-05-23 Thread Jan Høydahl
Hi all, We have an excellent contribution in https://issues.apache.org/jira/browse/SOLR-14410 and https://github.com/apache/solr/pull/428 to switch to systemd init script for Solr. Before we can merge we need help testing it on more Unix flavours. Do you have access to RHEL, CentOS or

Re: Error Solr Startup - AccessControlException: access denied ("java.io.FilePermission" "/" "read")

2023-05-22 Thread Jan Høydahl
This sounds strange after an untar, perhaps something with Java20? It is more common to use Java 17. Most likely you can circumvent it by disabling Java Security Manager SOLR_SECURITY_MANAGER_ENABLED=true bin/solr start -f Jan > 22. mai 2023 kl. 16:11 skrev Doug Turnbull > : > > The latest

Re: Unable to create collections

2023-05-22 Thread Jan Høydahl
ously). I remember no > configuration changes have been done. > > May I know where to update those parameters?. > > > > > On Fri, May 12, 2023 at 1:17 PM Jan Høydahl wrote: > >> Hi, >> >> Have you configured SSL on the Solr hosts? If so, you need t

Re: Unable to create collections

2023-05-22 Thread Jan Høydahl
ously). I remember no > configuration changes have been done. > > May I know where to update those parameters?. > > > > > On Fri, May 12, 2023 at 1:17 PM Jan Høydahl wrote: > >> Hi, >> >> Have you configured SSL on the Solr hosts? If so, you need t

Re: Solr Docker deployment issue

2023-05-12 Thread Jan Høydahl
version installed . > Curious to know how that is related to the java path . > > Thanks > Subhasis Patra > 240-755-2601 > subhasis.pa...@e2open.com<mailto:subhasis.pa...@e2open.com> > > From: Jan Høydahl > Sent: Friday, May 5, 2023 8:46 AM > To: users@solr.apache.org

  1   2   3   4   >