Re: Zk upconfig command is appending local directory to default confdir

2019-11-18 Thread Jörn Franke
I would use the config set API - it is more clean for production deployments and you do not have to deal with the zkCli script: https://lucene.apache.org/solr/guide/7_4/configsets-api.html > Am 18.11.2019 um 15:48 schrieb Michael Becker : > > I’ve run into an issue when attempting to

Re: Zk upconfig command is appending local directory to default confdir

2019-11-18 Thread Dominique Bejean
Hi Michael, It seems Sorl really don't find any solrconfig.xml file or a conf/solrconfig.xml file in the local path you specified. The last try is to look in "/opt/solr-6.5.1/server/solr/configsets/", but obviously it doesn't work has you didn't specify a confiset name. The code is here -

Re: Use of TLog

2019-11-18 Thread Emir Arnautović
Hi, Copying indices will work and it is a fine approach. An alternative would be to join new node to a cluster, use add replica to copy cores to this new node and then remove replicas from old nodes, if you want to move cores. Regards, Emir -- Monitoring - Log Management - Alerting - Anomaly

Re: When does Solr write in Zookeeper ?

2019-11-18 Thread Dominique Bejean
Thanh you Shawn Le lun. 18 nov. 2019 à 19:28, Shawn Heisey a écrit : > On 11/18/2019 8:39 AM, Dominique Bejean wrote: > > How Solr nodes know that something was changed in Zookeeper by an other > > node ? Is there any notification from ZK or do Solr nodes read > > systematically in ZK (without

Re: NPE during spell checking when result collapsing is activated and local parameters are used

2019-11-18 Thread Stefan Walter
I created https://issues.apache.org/jira/browse/SOLR-13944 (sorry, it took a while). Thanks again! Am 15. November 2019 um 16:10:55, Tomás Fernández Löbbe ( tomasflo...@gmail.com) schrieb: Would you create a Jira issue anyway tu fix the fact that it NPE instead of throwing a bad request? On

Re: async BACKUP under Solr8.3

2019-11-18 Thread Mikhail Khludnev
Hello, Craig. There was a significant fix for async BACKUP in 8.1, if I remember it correctly. Which version you used for it before? How many nodes, shards, replicas `bug` has? Unfortunately this stacktrace is not really representative, it just says that some node (ok, it's overseer) fails to

Updates blocked in Tlog solr cloud?

2019-11-18 Thread Wei
Hi, I am puzzled by a problem in solr cloud with Tlog replicas and would appreciate your insights. Our solr cloud has two shards and each shard have 5 tlog replicas. When one of the non-leader replica has hardware issue and become unreachable, updates to the whole cloud stopped. We are on solr

async BACKUP under Solr8.3

2019-11-18 Thread Oakley, Craig (NIH/NLM/NCBI) [C]
For Solr 8.3, when I attempt a command of the form host:port/solr/admin/collections?action=BACKUP=snapshot1=col1=/tmp=bug And then when I run /solr/admin/collections?action=REQUESTSTATUS=bug I get "msg":"found [bug] in failed tasks" The solr.log file has a stack trace like the following

Fwd: 2 Async exceptions during distributed update

2019-11-18 Thread Fiz N
Thanks Jorn on getting back to me. Please find attached memory/cpu utilization and complete update process chain. Please let me know your thoughts. On Sat, Nov 16, 2019 at 9:09 AM Jörn Franke wrote: > Can you please provide the whole update chain ? Below is the > directoryFactory and not the

Re: ConcurrentModificationException in SolrInputDocument writeMap

2019-11-18 Thread Tim Swetland
Finally had a chance to get back to this and figured out what our problem was. Thanks to Mikhail for pointing me in the right direction. For some reason one of our custom UpdateRequestProcessors was calling super.processAdd as the first line in

Attempting to do a join with 3 cores

2019-11-18 Thread rhys J
I was hoping to be able to do a join with 3 cores. I found this page that seemed to indicate it's possible? https://stackoverflow.com/questions/52380302/solr-how-to-join-three-cores Here's my query: http://localhost:8983/solr/dbtrphon/select?indent=on=1000=score desc, id desc=(phone:*Meredith*

Re: When does Solr write in Zookeeper ?

2019-11-18 Thread Shawn Heisey
On 11/18/2019 8:39 AM, Dominique Bejean wrote: How Solr nodes know that something was changed in Zookeeper by an other node ? Is there any notification from ZK or do Solr nodes read systematically in ZK (without local caching) ? This is built-in functionality of ZooKeeper. The client allows

Re: using scoring to find exact matches while using a cursormark

2019-11-18 Thread rhys J
> ...so w/o a score param you're getting the default sort: score "desc" > (descending)... > > > https://lucene.apache.org/solr/guide/8_3/common-query-parameters.html#CommonQueryParameters-ThesortParameter > > "If the sort parameter is omitted, sorting is performed as though > the >

Re: using scoring to find exact matches while using a cursormark

2019-11-18 Thread Chris Hostetter
: If I use the following query:in the browser, I get the expected results at : the top of the returned values from Solr. : : { : "responseHeader":{ : "status":0, : "QTime":41, : "params":{ : "q":"( clt_ref_no:OWL-2924-8 ^2 OR contract_number:OWL-2924-8^2 )", :

Re: daily SolrCloud collection wipes

2019-11-18 Thread Andrzej Białecki
This default autoscaling config helps to keep some aspects of SolrCloud clean - specifically: * Inactive shard plan: it periodically checks whether there are old shards in INACTIVE state that can be removed. Shards in this state are left-over parent shards remaining after a *successful*

Re: Solr 8.3.0

2019-11-18 Thread Erick Erickson
The Collections API ADDREPLICA command. Best, Erick > On Nov 18, 2019, at 12:48 AM, vishal patel > wrote: > > > I have created 2 shards of Solr 8.3.0. We have created 27 collections using > the below >

using scoring to find exact matches while using a cursormark

2019-11-18 Thread rhys J
I am trying to use scoring to get the expected results at the top of the stack when doing a Solr query. I am looking up clt_ref_no: OWL-2924-8^2 OR contract_number: OWL-2924-8^2 If I use the following query:in the browser, I get the expected results at the top of the returned values from Solr.

Re: When search term has two stopwords ('and' and 'a') together, it doesn't work

2019-11-18 Thread Guilherme Viteri
Hi, > Have you tried reindexing the documents and compare the results? No issues > if you cannot do that - let's try something else. I was going through the > whole mail and your files. You had said: Yes, but since it hasn't worked as suggested, I kept as you suggested. > As soon as I add dbId

Re: When does Solr write in Zookeeper ?

2019-11-18 Thread Dominique Bejean
How Solr nodes know that something was changed in Zookeeper by an other node ? Is there any notification from ZK or do Solr nodes read systematically in ZK (without local caching) ? Dominique Le ven. 15 nov. 2019 à 18:36, Erick Erickson a écrit : > Dominique: > > In a word, “yes”. You’ve got

Active directory integration in Solr

2019-11-18 Thread Kommu, Vinodh K.
Hi, Does anyone know that Solr has any out of the box capability to integrate Active directory (using LDAP) when security is enabled? Instead of creating users in security.json file, planning to use users who already exists in active directory so they can use their individual credentials

Zk upconfig command is appending local directory to default confdir

2019-11-18 Thread Michael Becker
I’ve run into an issue when attempting to configure Zookeeper. When running the zk upconfig -d command specifying a local directory where the solrconfig.xml files are located, I get the following error: “Could not complete upconfig operation for reason: Could not find solrconfig.xml at

CloudSolrClient - basic auth - multi shard collection

2019-11-18 Thread Nicolas Paris
Hello, I am having trouble with basic auth on a solrcloud instance. When the collection is only one shard, there is no problem. When the collection is multiple shard, there is no problem until I ask multiple query concurrently: I get 401 error and asking for credentials for concurrent queries. I

CVE-2019-12409: Apache Solr RCE vulnerability due to bad config default

2019-11-18 Thread Jan Høydahl
CVE-2019-12409: Apache Solr RCE vulnerability due to bad config default Severity: High Vendor: The Apache Software Foundation Versions Affected: Solr 8.1.1 and 8.2.0 for Linux Description: The 8.1.1 and 8.2.0 releases of Apache Solr contain an insecure setting for the ENABLE_REMOTE_JMX_OPTS

Re: Use of TLog

2019-11-18 Thread Sripra deep
Hi Emir, Thank you so much. Now I got it cleared with the TLOG purpose. I am trying to copy an index of one solr cluster to use it to build other solr cluster. I am able to make that work but Is this design okay? or any other approach I can try to get a new cluster spin up with the same data

Re: Solr process taking a long time before taking commands after restart

2019-11-18 Thread Koen De Groote
I see now from my writing that I made the impression that this happened after the restore. In fact, it happened before the restore, after the restart. No suggester that I know of. On Fri, Nov 15, 2019 at 4:49 PM Jörn Franke wrote: > Do you have some suggester or so that is possible

Re: Solr process taking a long time before taking commands after restart

2019-11-18 Thread Koen De Groote
I see now from my writing that I made the impression that this happened after the restore. In fact, it happened before the restore, after the restart. On Fri, Nov 15, 2019 at 4:38 PM Erick Erickson wrote: > It’d be interesting to see a thread dump during that time, sounds like > everything’s

Re: Use of TLog

2019-11-18 Thread Emir Arnautović
Hi Sripradeep, Simplified: TLog files are used to replay index updates from the last successful hard commit in case of some Solr crashes. It is used on the next Solr startup. It does not contain all updates, otherwise, it would duplicate the index size. If you start from these premises, you

Re: How do I add my own Streaming Expressions?

2019-11-18 Thread Christian Spitzlay
HI, I assume you are trying to add a custom extension, not preparing a general purpose contribution for solr itself ... We succeeded in loading a custom reduce operation by adding the jar with our code: And then defining an "expressible": Both changes were made in solrconfig_extra.xml, a