Re: Caffeine Cache Metrics Broken?

2021-03-02 Thread Shawn Heisey
On 3/2/2021 3:47 PM, Stephen Lewis Bianamara wrote: I'm investigating a weird behavior I've observed in the admin page for caffeine cache metrics. It looks to me like on the older caches, warm-up queries were not counted toward hit/miss ratios, which of course makes sense, but on Caffeine cache

Re: Zookeeper 3.4.5 with Solr 8.8.0

2021-03-01 Thread Shawn Heisey
On 3/1/2021 9:45 PM, Subhajit Das wrote: That is not possible at this time. Will it be ok, if remote the zookeeper dependencies (jars) from solr and replace it with 3.5.5 jars? Thanks in advance. Maybe. But I cannot say for sure. I know that when we upgraded to ZK 3.5, some fairly

Re: Zookeeper 3.4.5 with Solr 8.8.0

2021-03-01 Thread Shawn Heisey
On 3/1/2021 6:51 AM, Subhajit Das wrote: I noticed, that Solr 8.8.0 uses Zookeeper 3.6.2 client, while Solr 6.3.0 uses Zookeeper 3.4.6 client. Is this a client bug or mismatch issue? If so, how to fix this? The ZK project guarantees that each minor version (X.Y.Z, where Y is the same) will

Re: Dynamic starting or stoping of zookeepers in a cluster

2021-02-24 Thread Shawn Heisey
On 2/24/2021 9:04 AM, DAVID MARTIN NIETO wrote: If I'm not mistaken the number of zookeepers must be odd. Having 3 zoos on 3 different machines, if we temporarily lost one of the three machines, we would have only two running and it would be an even number.Would it be advisable in this case

Re: Caffeine Cache and Filter Cache in 8.3

2021-02-22 Thread Shawn Heisey
On 2/22/2021 1:50 PM, Stephen Lewis Bianamara wrote: (a) At what version did the caffeine cache reach production stability? (b) Is the caffeine cache, and really all implementations, able to be used on any cache, or are the restrictions about which cache implementations may be used for which

Re: defragmentation can improve performance on SATA class 10 disk ~10000 rpm ?

2021-02-22 Thread Shawn Heisey
On 2/22/2021 12:52 AM, Danilo Tomasoni wrote: we are running a solr instance with around 41 MLN documents on a SATA class 10 disk with around 10.000 rpm. We are experiencing very slow query responses (in the order of hours..) with an average of 205 segments. We made a test with a normal pc and

Re: HTML sample.html not indexing in Solr 8.8

2021-02-21 Thread Shawn Heisey
On 2/21/2021 3:07 PM, cratervoid wrote: Thanks Shawn, I copied the solrconfig.xml file from the gettingstarted example on 7.7.3 installation to the 8.8.0 installation, restarted the server and it now works. Comparing the two files it looks like as you said this section was left out of the

Re: HTML sample.html not indexing in Solr 8.8

2021-02-20 Thread Shawn Heisey
On 2/20/2021 3:58 PM, cratervoid wrote: SimplePostTool: WARNING: Solr returned an error #404 (Not Found) for url: http://localhost:8983/solr/gettingstarted/update/extract?resource.name=C%3A%5Csolr-8.8.0%5Cexample%5Cexampledocs%5Csample.html=C%3A%5Csolr-8.8.0%5Cexample%5Cexampledocs%5Csample.html

Re: Dynamic starting or stoping of zookeepers in a cluster

2021-02-18 Thread Shawn Heisey
On 2/18/2021 8:20 AM, DAVID MARTIN NIETO wrote: We've a solr cluster with 4 solr servers and 5 zookeepers in HA mode. We've tested about if our cluster can mantain the service with only the half of the cluster, in case of disaster os similar, and we've a problem with the zookepers config and

Re: Cannot find Solr 7.4.1 release

2021-02-18 Thread Shawn Heisey
On 2/18/2021 1:05 AM, Olivier Tavard wrote: I wanted to download Solr 7.4.1, but I cannot find the 7.4.1 release into http://archive.apache.org/dist/lucene/solr/ : there are Solr 7.4 and after directly 7.5. Of course I can build from source code, but this is frustrating because I can see that in

Re: Solr 8.0 query length limit

2021-02-18 Thread Shawn Heisey
On 2/18/2021 3:38 AM, Anuj Bhargava wrote: Solr 8.0 query length limit We are having an issue where queries are too big, we get no result. And if we remove a few keywords we get the result. The best option is to convert the request to POST, as Thomas suggested. With that, the query

Re: Is 8.8.x going be stabilized and finalized?

2021-02-16 Thread Shawn Heisey
On 2/16/2021 7:57 PM, Subhajit Das wrote: I am planning to use 8.8 line-up for production use. But recently, a lot of people are complaining on 8.7 and 8.8. Also, there is a clearly known issue on 8.8 as well. Following trends of earlier versions (5.x, 6.x and 7.x), will 8.8 will also be

Re: SolrJ: SolrInputDocument.addField()

2021-02-16 Thread Shawn Heisey
On 2/15/2021 10:17 AM, Steven White wrote: Yes, I have managed schema enabled like so: true cp-schema.xml The reason why I enabled it is so that I can dynamically customize the schema based on what's in the DB. So that I can add fields to the schema dynamically. A

Re: Meaning of "Index" flag under properties and schema

2021-02-16 Thread Shawn Heisey
On 2/16/2021 9:16 AM, ufuk yılmaz wrote: I didn’t realise that, sorry. The table is like: Flags Indexed Tokenized Stored UnInvertible Properties YesYesYes Yes Schema YesYesYes Yes Index Yes

Re: SolrJ: SolrInputDocument.addField()

2021-02-15 Thread Shawn Heisey
On 2/15/2021 6:52 AM, Steven White wrote: It looks to me that SolrInputDocument.addField() is either missnamed or isn't well implemented. When it is called on a field that doesn't exist in the schema, it will create that field and give it a type based on the data. Not only that, it will set

Re: SolrJ: SolrInputDocument.addField()

2021-02-14 Thread Shawn Heisey
On 2/14/2021 9:00 AM, Steven White wrote: It looks like I'm misusing SolrJ API SolrInputDocument.addField() thus I need clarification. Here is an example of what I have in my code: SolrInputDocument doc = new SolrInputDocument(); doc.addField("MyFieldOne", "some data");

Re: CVE-2019-17558 on SOLR 6.1

2021-02-12 Thread Shawn Heisey
On 2/12/2021 11:17 AM, Rick Tham wrote: I am trying to figure out if the following is an additioanal valid mitigation step for CVE-2019-17558 on SOLR 6.1. None of our solrconfig.xml contains the lib references to the velocity jar files as follows: l It doesn't appear that you can add these

Re: Extremely Small Segments

2021-02-12 Thread Shawn Heisey
On 2/12/2021 4:30 AM, yasoobhaider wrote: Note: Nothing out of the ordinary in logs. Only /update request logs. Can you share your logs? The best option would be to include everything in the logs directory. Hopefully you have not altered the default logging config, which sets the detail to

Re: NRT - Indexing

2021-02-01 Thread Shawn Heisey
On 2/1/2021 12:08 AM, haris.k...@vnc.biz wrote: Hope you're doing good. I am trying to configure NRT - Indexing in my project. For this reason, I have configured *autoSoftCommit* to execute every second and *autoCommit* to execute every 5 minutes. Everything works as expected on the dev and

Re: Solr 8.7.0 memory leak?

2021-01-28 Thread Shawn Heisey
On 1/27/2021 9:00 PM, Luke wrote: it's killed by OOME exception. The problem is that I just created empty collections and the Solr JVM keeps growing and never goes down. there is no data at all. at the beginning, I set Xxm=6G, then 10G, now 15G, Solr 8.7 always use all of them and it will be

Re: Solr 8.7.0 memory leak?

2021-01-27 Thread Shawn Heisey
On 1/27/2021 5:08 PM, Luke Oak wrote: I just created a few collections and no data, memory keeps growing but never go down, until I got OOM and solr is killed Any reason? Was Solr killed by the operating system's oom killer or did the death start with a Java OutOfMemoryError exception? If

Re: Cannot start solr because oom

2021-01-23 Thread Shawn Heisey
On 1/23/2021 6:41 PM, Luke wrote: I don't see any log in solr.log, but there is OutOfMemory error in solr-8983-console.log file. Do you have the entire text of that exception? Can you share it? That is the real information that I am after here. I only asked how Solr was installed and

Re: Cannot start solr because oom

2021-01-23 Thread Shawn Heisey
On 1/23/2021 6:29 AM, Luke Oak wrote: I use default settings to start solr , I set heap to 6G, I created 10 collections with 1node and 1 replica, however, there is not much data at all, just 100 documents. My server is 32 G memory and 4 core cpu, ssd drive 300g It was ok when i created 5

Re: Queries Regarding Cold searcher

2021-01-22 Thread Shawn Heisey
On 1/21/2021 3:42 AM, Parshant Kumar wrote: Do value(true or false) of cold searcher play any role during the completion of replication on slave server.If not please tell in which process in solr its applied? The setting to use a cold searcher applies whenever a new searcher is opened. It

Re: Effects of shards and replicas on performance

2021-01-19 Thread Shawn Heisey
On 1/19/2021 4:19 PM, ufuk yılmaz wrote: Lets say I had only 1 replica for each collection but I split it to 6 shards, 1 for every node. Or I had 2 shards (1 shard is too big for a single node I think) but I had 3 replicas, 3x2=6, 1 on every node. How would it affect the performance? It all

Re: Solrcloud - Reads on specific nodes

2021-01-18 Thread Shawn Heisey
On 1/17/2021 11:12 PM, Doss wrote: Thanks Michael Gibney , Shawn Heisey for pointing in the right direction. 1. Will there be any performance degrade if we use shards.preference? 2. How about leader election if we decided to use NRT + PULL ? TLOG has the advantage of participating in leader

Re: Solrcloud - Reads on specific nodes

2021-01-15 Thread Shawn Heisey
On 1/15/2021 7:56 AM, Doss wrote: 1. Suppose we have 10 node SOLR Cloud setup, is it possible to dedicate 4 nodes for writes and 6 nodes for selects? 2. We have a SOLR cloud setup for our customer facing applications, and we would like to have two more SOLR nodes for some backend jobs. Is it

Re: Replicaton SolrCloud

2021-01-15 Thread Shawn Heisey
On 1/15/2021 7:20 AM, Jae Joo wrote: Is non CDCR replication in SolrCloud still working in Solr 9.0? Solr 9 doesn't exist yet. Probably won't for at least a few months. The latest version is 8.7.0. Solr's replication feature is used by SolrCloud internally for recovery operations, but the

Re: Getting error "Bad Message 414 reason: URI Too Long"

2021-01-15 Thread Shawn Heisey
On 1/14/2021 2:31 AM, Abhay Kumar wrote: I am trying to post below query to Solr but getting error as “Bad Message 414reason: URI Too Long”. I am sending query using SolrNet library. Please suggest how to resolve this issue. *Query :*

Re: Apache Solr in High Availability Primary and Secondary node.

2021-01-11 Thread Shawn Heisey
On 1/11/2021 4:02 AM, Kaushal Shriyan wrote: Thanks, David for the quick response. Is there any use-case to use HAProxy or Nginx webserver or any other application to load balance both Solr primary and secondary nodes? I had a setup with haproxy and two copies of a Solr index. Four of the

Re: maxBooleanClauses change in solr.xml not reflecting in solr 8.4.1

2021-01-05 Thread Shawn Heisey
On 1/5/2021 8:26 AM, dinesh naik wrote: Hi all, I want to update the maxBooleanClauses to 2048 (from default value 1024). Below are the steps tried: 1. updated solrconfig.xml : ${solr.max.booleanClauses:2048} You need to update EVERY solrconfig.xml that the JVM is loading for this to actually

Re: Data Import Blocker - Solr

2020-12-19 Thread Shawn Heisey
On 12/18/2020 12:03 AM, basel altameme wrote: While trying to Import & Index data from MySQL DB custom view i am facing the error below: Data Config problem: The value of attribute "query" associated with an element type "entity" must not contain the '<' character. Please note that in my SQL

Re: 8.6.1 configuring ssl on centos 7

2020-12-13 Thread Shawn Heisey
On 12/13/2020 7:21 AM, Bogdan C. wrote: Solr is installed and working on http (8983). I (think I) have the keystore configured properly and solr.in.sh modified for the SOLR_SSL_* config settings. Not sure how to modify the service startup to listen on 8984 for ssl. solr documentation says to

Re: DIH and UUIDProcessorFactory

2020-12-12 Thread Shawn Heisey
On 12/12/2020 2:30 PM, Dmitri Maziuk wrote: Right, ```Every update request received by Solr is run through a chain of plugins known as Update Request Processors, or URPs.``` The part I'm missing is whether DIH's 'name="/dataimport"' counts as an "Update Request", my reading is it doesn't and

Re: Copyfields, will there be any difference between source and dest if they are switched?

2020-12-12 Thread Shawn Heisey
On 12/11/2020 2:38 PM, ufuk yılmaz wrote: My question is, will there be any difference on the resulting indexed documents if I switched source and dest fields in copyField directive? My understanding is copyField operates on raw data arriving at Solr as is, and field declarations themselves

Re: DIH and UUIDProcessorFactory

2020-12-12 Thread Shawn Heisey
On 12/12/2020 12:54 PM, Dmitri Maziuk wrote: is there an easy way to use the stock UUID generator with DIH? We have a hand-written one-liner class we use as DIH entity transformer but I wonder if there's a way to use the built-in UUID generator class instead. From the TFM it looks like there

Re: Solrj supporting term vector component ?

2020-12-03 Thread Shawn Heisey
On 12/3/2020 10:20 AM, Deepu wrote: I am planning to use Term vector component for one of the use cases, as per below solr documentation link solrj not supporting Term Vector Component, do you have any other suggestions to use TVC in java application?

Re: Facet to part of search results

2020-12-03 Thread Shawn Heisey
On 12/3/2020 9:55 AM, Jae Joo wrote: Is there any way to apply facet to the partial search result? For ex, we have 10m return by "dog" and like to apply facet to first 10K. Possible? The point of facets is to provide accurate numbers. What would it mean to only apply to the first 10K? If

Re: Solr 8.4.1, NOT NULL query not working on plong & pint type fields (fieldname:* )

2020-11-26 Thread Shawn Heisey
On 11/25/2020 10:42 AM, Deepu wrote: We are in the process of migrating from Solr 5 to Solr 8, during testing identified that "Not null" queries on plong & pint field types are not giving any results, it is working fine with solr 5.4 version. could you please let me know if you have suggestions

Re: Increase in Response time when solr fields are merged

2020-11-19 Thread Shawn Heisey
On 11/19/2020 2:12 AM, Ajay Sharma wrote: Earlier we were searching in 6 fields i.e qf is applied on 6 fields like below We merged all these 6 fields into one field X and now while searching we using this single filed X We are able to see a decrease in index size but the response time

Re: How to reflect changes of solrconfig.xml to all the cores without causing any conflict

2020-11-09 Thread Shawn Heisey
On 11/9/2020 5:44 AM, raj.yadav wrote: *Question:* Since reload is not done, none of the replica (including leader) will have updated solrconfig. And if we restart replica and if it trys to sync up with leader will it reflect the latest changes of solrconfig or it will be the same as leader.

Re: Solr 8.1.1 installation in Azure App service

2020-11-04 Thread Shawn Heisey
On 11/3/2020 11:49 PM, Narayanan, Bhagyasree wrote: Steps we followed for creating Solr App service: 1. Created a blank sitecore 9.3 solution from Azure market place and created a Web app for Solr. 2. Unzipped the Solr 8.1.1 package and copied all the contents to wwwroot folder of the

Re: Solr migration related issues.

2020-11-04 Thread Shawn Heisey
On 11/4/2020 9:32 PM, Modassar Ather wrote: Another thing: how can I control the core naming? I want the core name to be *mycore* instead of *mycore**_shard1_replica_n1*/*mycore* *_shard2_replica_n2*. I tried setting it using property.name=*mycore* but it did not work. What can I do to achieve

Re: Commits (with openSearcher = true) are too slow in solr 8

2020-11-03 Thread Shawn Heisey
On 11/3/2020 11:46 PM, raj.yadav wrote: We have two parallel system one is solr 8.5.2 and other one is solr 5.4 In solr_5.4 commit time with opensearcher true is 10 to 12 minutes while in solr_8 it's around 25 minutes. Commits on a properly configured and sized system should take a few

Re: filterCache ramBytesUsed monitoring statistics go negative

2020-11-02 Thread Shawn Heisey
On 11/2/2020 4:27 AM, Dawn wrote: filterCache ramBytesUsed monitoring statistics go negative. Is there a special meaning, or is there a statistical problem When present the list, can sort it by key. Solr7 is like this, easy to view. When problems like this surface,

Re: httpclient gives error

2020-10-31 Thread Shawn Heisey
On 10/31/2020 12:54 PM, Raivo Rebane wrote: I try to use solrj in web application with eclipse tomcat but I get following errors Tomcat lib contains following http jars: -rw-rw-rw- 1 hydra hydra 326724 sept   6 21:33 httpcore-4.4.4.jar -rw-rw-rw- 1 hydra hydra 736658 sept   6 21:33

Re: TieredMergePolicyFactory question

2020-10-26 Thread Shawn Heisey
On 10/25/2020 11:22 PM, Moulay Hicham wrote: I am wondering about 3 other things: 1 - You mentioned that I need free disk space. Just to make sure that we are talking about disc space here. RAM can still remain at the same size? My current RAM size is Index size < RAM < 1.5 Index size You

Re: SolrDocument difference between String and text_general

2020-10-20 Thread Shawn Heisey
On 10/20/2020 1:53 AM, Cox, Owen wrote: I've now written a Java Spring-Boot program to populate documents (snippet below) using SolrCrudRepository. This works when I don't index the "title" field, but when I try include title I get the following error "cannot change field "title" from index

Re: SolrCloud 6.6.2 suddenly crash due to slow queries and Log4j issue

2020-10-18 Thread Shawn Heisey
On 10/18/2020 3:22 AM, Dominique Bejean wrote: A few months ago, I reported an issue with Solr nodes crashing due to the old generation heap growing suddenly and generating OOM. This problem occurred again this week. I have threads dumps for each minute during the 3 minutes the problem occured.

Re: converting string to solr.TextField

2020-10-17 Thread Shawn Heisey
On 10/17/2020 6:23 AM, Vinay Rajput wrote: That said, one more time I want to come back to the same question: why solr/lucene can not handle this when we are updating all the documents? Let's take a couple of examples :- *Ex 1:* Let's say I have only 10 documents in my index and all of them are

Re: converting string to solr.TextField

2020-10-16 Thread Shawn Heisey
On 10/16/2020 2:36 PM, David Hastings wrote: sorry, i was thinking just using the *:* method for clearing the index would leave them still In theory, if you delete all documents at the Solr level, Lucene will delete all the segment files on the next commit, because they are empty. I have

Re: Memory line in status output

2020-10-12 Thread Shawn Heisey
On 10/12/2020 5:11 PM, Ryan W wrote: Thanks. How do I activate the G1GC collector? Do I do this by editing a config file, or by adding a parameter when I start solr? Oracle's docs are pointing me to a file that supposedly is at instance-dir/OUD/config/java.properties, but I don't have that

Re: Help with uploading files to a core.

2020-10-11 Thread Shawn Heisey
On 10/11/2020 2:28 PM, Guilherme dos Reis Meneguello wrote: Hello! My name is Guilherme and I'm a new user of Solr. Basically, I'm developing a database to help a research team in my university, but I'm having some problems uploading the files to the database. Either using curl commands or

Re: Question about solr commits

2020-10-07 Thread Shawn Heisey
On 10/7/2020 4:40 PM, yaswanth kumar wrote: I have the below in my solrconfig.xml ${solr.Data.dir:} ${solr.autoCommit.maxTime:6} false ${solr.autoSoftCommit.maxTime:5000} Does this mean even though we are always sending

Re: Non Deterministic Results from /admin/luke

2020-10-01 Thread Shawn Heisey
On 10/1/2020 4:24 AM, Nussbaum, Ronen wrote: We are using the Luke API in order to get all dynamic field names from our collection: /solr/collection/admin/luke?wt=csv=0 This worked fine in 6.2.1 but it's non deterministic anymore (8.6.1) - looks like it queries a random single shard. I've

Re: Solr 7.7 - Few Questions

2020-10-01 Thread Shawn Heisey
On 10/1/2020 6:57 AM, Manisha Rahatadkar wrote: We are using Apache Solr 7.7 on Windows platform. The data is synced to Solr using Solr.Net commit. The data is being synced to SOLR in batches. The document size is very huge (~0.5GB average) and solr indexing is taking long time. Total

Re: Solr client in JavaScript

2020-10-01 Thread Shawn Heisey
On 10/1/2020 3:55 AM, Sunil Dash wrote: This is my javascript code ,from where I am calling solr ,which has a loaded nutch core (index). My java script client ( runs on TOMCAT server) and Solr server are on the same machine (10.21.6.100) . May be due to cross domain references issues OR

Re: solr performance with >1 NUMAs

2020-09-28 Thread Shawn Heisey
On 9/28/2020 12:17 PM, Wei wrote: Thanks Shawn. Looks like Java 11 is the way to go with -XX:+UseNUMA. Do you see any backward compatibility issue for Solr 8 with Java 11? Can we run Solr 8 built with JDK 8 in Java 11 JRE, or need to rebuild solr with Java 11 JDK? I do not know of any problems

Re: Solr storage of fields <-> indexed data

2020-09-28 Thread Shawn Heisey
On 9/28/2020 8:56 AM, Edward Turner wrote: By removing the copyfields, we've found that our index sizes have reduced by ~40% in some cases, which is great! We're just curious now as to exactly how this can be ... That's not surprising. My question is, given the following two schemas, if we

Re: solr performance with >1 NUMAs

2020-09-26 Thread Shawn Heisey
On 9/26/2020 1:39 PM, Wei wrote: Thanks Shawn! Currently we are still using the CMS collector for solr with Java 8. When last evaluated with Solr 7, CMS performs better than G1 for our case. When using G1, is it better to upgrade from Java 8 to Java 11? From

Re: solr performance with >1 NUMAs

2020-09-25 Thread Shawn Heisey
On 9/23/2020 7:42 PM, Wei wrote: Recently we deployed solr 8.4.1 on a batch of new servers with 2 NUMAs. I noticed that query latency almost doubled compared to deployment on single NUMA machines. Not sure what's causing the huge difference. Is there any tuning to boost the performance on

Re: Solr 8.6.2 - Solr loaded a deprecated plugin/analysis

2020-09-23 Thread Shawn Heisey
On 9/22/2020 10:22 PM, Anuj Bhargava wrote: How to solve this issue? How to replace it? SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.DataImportHandler]. Please consult documentation how to replace it accordingly. That is a generic message about using deprecated

Re: Fetched but not Added Solr 8.6.2

2020-09-18 Thread Shawn Heisey
On 9/18/2020 1:27 AM, Anuj Bhargava wrote: In managed schema, I have Still getting the following error- org.apache.solr.common.SolrException: Document is missing mandatory uniqueKey field: id The problem is that the document that has been fetched with DIH does NOT have a field named id.

Re: schema.xml version attribute

2020-09-05 Thread Shawn Heisey
On 9/5/2020 3:30 AM, Dominique Bejean wrote: Hi, I often see a bad usage of the version attribute in shema.xml. For instance The version attribute is to specify the schema syntax and semantics version to be used by Solr. The current value is 1.6 It is clearly specified in schema.xml comments

Re: About solr.HyphenatedWordsFilter

2020-08-26 Thread Shawn Heisey
On 8/26/2020 12:05 AM, Kayak28 wrote: I would like to tokenize the following sentence. I do want to tokens that remain hyphens. So, for example, original text: This is a new abc-edg and xyz-abc is coming soon! desired output tokens: this/is/a/new/abc-edg/and/xyz-abc/is/coming/soon/! Is there

Re: SOLR Compatibility with Oracle Enterprise Linux 7

2020-08-24 Thread Shawn Heisey
On 8/24/2020 12:46 AM, Wang, Ke wrote: We are using Apache SOLR version 8.4.4.0. The project is planning to upgrade the Linux server from Oracle Enterprise Linux (Red Hat Enterprise Linux) 6 to OEL 7. As I was searching on the Confluence page and was not able to find the information, can I

Re: SOLR indexing takes longer time

2020-08-17 Thread Shawn Heisey
On 8/17/2020 12:22 PM, Abhijit Pawar wrote: We are indexing some 200K plus documents in SOLR 5.4.1 with no shards / replicas and just single core. It takes almost 3.5 hours to index that data. I am using a data import handler to import data from the mongo database. Is there something we can do

Re: Solr ping taking 600 seconds

2020-08-15 Thread Shawn Heisey
On 8/14/2020 3:39 PM, Susheel Kumar wrote: One of our Solr 6.6.2 DR cluster (target CDCR) which even doesn't have any live search load seems to be taking 60 ms many times for the ping / health check calls. Anyone has seen this before/suggestion what could be wrong. The collection has 8

Re: Can create collections with Drupal 8 configset

2020-08-09 Thread Shawn Heisey
On 8/9/2020 8:11 AM, Shane Brooks wrote: Thanks Shawn. The way we have it configured presently is as follows: icu4j.jar is located in /opt/solr/contrib/analysis-extras/lib/icu4j-62.1.jar solrconfig.xml contains: Which should load the jar at startup, correct? I do not know if that path spec

Re: HttpSolrClient Connection Evictor

2020-08-09 Thread Shawn Heisey
On 8/9/2020 2:46 AM, Srinivas Kashyap wrote: We are using HttpSolrClient(solr-solrj-8.4.1.jar) in our app along with required jar(httpClient-4.5.6.jar). Before that we upgraded these jars from (solr-solrj-5.2.1.jar) and (httpClient-4.4.1.jar). After we upgraded, we are seeing lot of below

Re: Can create collections with Drupal 8 configset

2020-08-09 Thread Shawn Heisey
On 8/8/2020 10:31 PM, Shane Brooks wrote: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error from server at http://192.168.xx.xx:8983/solr: Expected mime type application/octet-stream but got text/html. \n\nhttp-equiv=\"Content-Type\"

Re: wt=xml not defaulting the results to xml format

2020-08-07 Thread Shawn Heisey
On 8/7/2020 9:30 AM, yaswanth kumar wrote: solr/PROXIMITY_DATA_V2/select?q=pkey:223_*=true=country_en=country_en What ever I am trying is not working other than sending wt=xml as a parameter while hitting the url. I tried your solrconfig.xml addition and a URL similar to yours out on

Re: wt=xml not defaulting the results to xml format

2020-08-07 Thread Shawn Heisey
How are you sending the query request that doesn't come back as xml? I suspect that the request is being sent with an explicit wt parameter set to something other than xml. Making a query with the admin ui would do this, and it would probably default to json. When you make a query, assuming

Re: Solr 8.5.2 - Solr shards param does not work without localhost

2020-08-06 Thread Shawn Heisey
On 8/6/2020 6:03 PM, gnandre wrote: Please ignore the space between. I have updated the calls by removing space below: http://my.domain.com/solr/core/select?q=*:*=0=10= my.domain.com/solr/another_core=* http://my.domain.com/solr/core/select?q=*:*=0=10= localhost:8983/solr/another_core=*

Re: Solr 8.5.2 - Solr shards param does not work without localhost

2020-08-06 Thread Shawn Heisey
On 8/6/2020 5:59 PM, gnandre wrote: http://my.domain.com/solr/core/select?q=*:*=0=10= my.domain.com /solr/another_core=* Ir does not work in Solr 8.5.2 anymore unless I pass localhost instead of my domain in shards param value as follows: http://my.domain.com/solr/core/select?q=*:*=0=10=

Re: SolrCloud on PublicCloud

2020-08-03 Thread Shawn Heisey
On 8/3/2020 12:04 PM, Mathew Mathew wrote: Have been looking for architectural guidance on correctly configuring SolrCloud on Public Cloud (eg Azure/AWS) In particular the zookeeper based autoscaling seems to overlap with the auto scaling capabilities of cloud platforms. I have the following

Re: Cybersecurity Incident Report

2020-07-24 Thread Shawn Heisey
On 7/24/2020 2:35 PM, Man with No Name wrote: This version of jackson is pulled in as a shadow jar. Also solr is using io.netty version 4.1.29.Final which has critical vulnerabilities which are fixed in 4.1.44. It looks like that shaded jackson library is included in the jar for htrace. I

Re: IndexSchema is not mutable error Solr Cloud 7.7.1

2020-07-23 Thread Shawn Heisey
On 7/23/2020 8:56 AM, Porritt, Ian wrote: Note: the solrconfig has class="ClassicIndexSchemaFactory"/> defined. org.apache.solr.common.SolrException: *This IndexSchema is not mutable*.     at

Re: zookeeper data and collection properties were lost

2020-07-20 Thread Shawn Heisey
On 7/20/2020 10:30 AM, yaswanth kumar wrote: 1# I did make sure that zoo.cfg got the proper data dir and its not pointing to temp folder; do I need to set the variables in ZK_ENV.sh. as well on top of the zoo.cfg ?? Those are questions about the ZK server, which we are not completely

Re: AtomicUpdate on SolrCloud is not working

2020-07-20 Thread Shawn Heisey
On 7/19/2020 1:37 AM, yo tomi wrote: I have no choice but use post-processor. However bug of SOLR-8030 makes me not feel like using it. Can you explain why you need the trim field and remove blank field processors to be post processors? When I think about these functionalities, they should

Re: UpdateProcessorChains -cdcr processor along with ignore commit processor

2020-07-18 Thread Shawn Heisey
On 7/15/2020 11:39 PM, Natarajan, Rajeswari wrote: Resending this again as I still could not make this work. So would like to know if this is even possible to have both solr.CdcrUpdateProcessorFactory and solr.IgnoreCommitOptimizeUpdateProcessorFactory in solrconfig.xml and get both

Re: AtomicUpdate on SolrCloud is not working

2020-07-18 Thread Shawn Heisey
On 7/17/2020 1:32 AM, yo tomi wrote: When I did AtomicUpdate on SolrCloud by the following setting, it does not work properly. As Jörn Franke already mentioned, you haven't said exactly what "does not work properly" actually means in your situation. Without that information, it will be very

Re: In-place update vs Atomic updates

2020-07-14 Thread Shawn Heisey
On 7/14/2020 12:21 PM, raj.yadav wrote: As per the above statement in atomic-update, it reindex the entire document and deletes the old one. But I was going through solr documentation regarding the ( solr document update policy

Re: Query in quotes cannot find results

2020-07-11 Thread Shawn Heisey
On 6/30/2020 12:07 PM, Permakoff, Vadim wrote: Regarding removing the stopwords, I agree, there are many cases when you don't want to remove the stopwords, but there is one very compelling case when you want them to be removed. Imagine, you have one document with the following text: 1. "to

Re: Solr heap Old generation grows and it is not recovered by G1GC

2020-07-11 Thread Shawn Heisey
On 6/25/2020 2:08 PM, Odysci wrote: I have a solrcloud setup with 12GB heap and I've been trying to optimize it to avoid OOM errors. My index has about 30million docs and about 80GB total, 2 shards, 2 replicas. Have you seen the full OutOfMemoryError exception text? OOME can be caused by

Re: SOLR / Zookeeper Compatibility

2020-07-11 Thread Shawn Heisey
On 7/10/2020 5:14 AM, mithunseal wrote: I am new to this SOLR-ZOOKEEPER. I am not able to understand the compatibility thing. For example, I am using SOLR 7.5.0 which uses ZK 3.4.11. So SOLR 7.5.0 will not work with ZK 3.4.10? Can someone please confirm this? According to what the ZooKeeper

Re: Solr docker image works with image option but not with build option in docker-compose

2020-07-09 Thread Shawn Heisey
On 7/8/2020 3:36 PM, gnandre wrote: I am using Solr docker image 8.5.2-slim from https://hub.docker.com/_/solr. I use it as a base image and then add some more stuff to it with my custom Dockerfile. When I build the final docker image, it is built successfully. After that, when I try to use it

Re: Query in quotes cannot find results

2020-06-29 Thread Shawn Heisey
On 6/29/2020 3:34 PM, Permakoff, Vadim wrote: The basic query q=expand the methods <<< finds the document, the query (in quotes) q="expand the methods" <<< cannot find the document Am I doing something wrong, or is it known bug (I saw similar issues discussed in the past, but not for exact

Re: Solr 8.5.2: DataImportHandler failed to instantiate org.apache.solr.request.SolrRequestHandler

2020-06-26 Thread Shawn Heisey
On 6/24/2020 1:59 PM, Peter van de Kerk wrote: So I copied files from C:\solr-8.5.2\dist to C:\solr-8.5.2\server\lib But then I get error org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Error Instantiating requestHandler,

Re: Deleting on exact match

2020-06-21 Thread Shawn Heisey
On 6/21/2020 1:04 PM, Scott Q. wrote: The task at hand is to remove all documents indexed the old way, but how can I do that ? user is of the form u...@domain.com and if I search for u...@domain.com it matches all of 'user' or 'domain.com' which has obvious unwanted consequences. Therefore, how

Re: Gettings interestingTerms from solr.MoreLikeThisHandler using SolrJ

2020-06-19 Thread Shawn Heisey
On 6/18/2020 5:31 AM, Zander, Sebastian wrote: In the returning QueryResponse I can't find the interestingTerms. I would really like to grab it on this way, before calling another time. Any advices? I'm running solr 8.5.2 If you can send the full json or XML response, I think I can show you

Re: Solr cloud backup/restore not working

2020-06-17 Thread Shawn Heisey
On 6/17/2020 8:55 PM, yaswanth kumar wrote: Caused by: javax.crypto.BadPaddingException: RSA private key operation failed Something appears to be wrong with the private key that Solr is attempting to use for a certificate. Best guess, incorporating everything I can see in the stacktrace, is

Re: Solr cloud backup/restore not working

2020-06-17 Thread Shawn Heisey
On 6/16/2020 8:44 AM, yaswanth kumar wrote: I don't see anything related in the solr.log file for the same error. Not sure if there is anyother place where I can check for this. The underlying request that failed might be happening on one of the other nodes in the cloud. It might be

Re: Log4J Logging to Http

2020-06-17 Thread Shawn Heisey
On 6/17/2020 1:33 AM, Krönert Florian wrote: 2020-06-17T07:06:55.121856339Z java.lang.NoClassDefFoundError: Failed to initialize Apache Solr: Could not find necessary SLF4j logging jars. If using Jetty, the SLF4j logging jars need to go in the jetty lib/ext directory. For other containers, the

Re: Getting rid of Master/Slave nomenclature in Solr

2020-06-17 Thread Shawn Heisey
On 6/17/2020 2:36 PM, Trey Grainger wrote: 2) TLOG - which can only serve in the role of follower This is inaccurate. TLOG can become leader. If that happens, then it functions exactly like an NRT leader. I'm aware that saying the following is bikeshedding ... but I do think it would be

Re: How to determine why solr stops running?

2020-06-16 Thread Shawn Heisey
On 6/11/2020 11:52 AM, Ryan W wrote: I will check "dmesg" first, to find out any hardware error message. [1521232.781801] Out of memory: Kill process 117529 (httpd) score 9 or sacrifice child [1521232.782908] Killed process 117529 (httpd), UID 48, total-vm:675824kB, anon-rss:181844kB,

Re: Solr cloud backup/restore not working

2020-06-16 Thread Shawn Heisey
On 6/12/2020 8:38 AM, yaswanth kumar wrote: Using solr 8.2.0 and setup a cloud with 2 nodes. (2 replica's for each collection) Enabled basic authentication and gave all access to the admin user Now trying to use solr cloud backup/restore API, backup is working great, but when trying to invoke

Re: Proxy Error when cluster went down

2020-06-16 Thread Shawn Heisey
On 6/15/2020 9:04 PM, Vishal Vaibhav wrote: I am running on solr 8.5. For some reason entire cluster went down. When i am trying to bring up the nodes,its not coming up. My health check is on "/solr/rules/admin/system". I tried forcing a leader election but it dint help. so when i run the

Re: getting different errors from complex phrase query

2020-06-16 Thread Shawn Heisey
On 6/15/2020 2:52 PM, Deepu wrote: sample query is "{!complexphrase inOrder=true}(all_text_txt_enus:\"by\\ test*\") AND (({!terms f=product_id_l}959945,959959,959960,959961,959962,959963) AND (date_created_at_rdt:[2020-04-07T01:23:09Z TO *} AND date_created_at_rdt:{* TO 2020-04-07T01:24:57Z]))"

Re: eDismax query syntax question

2020-06-16 Thread Shawn Heisey
On 6/15/2020 8:01 AM, Webster Homer wrote: Only the minus following the parenthesis is treated as a NOT. Are parentheses special? They're not mentioned in the eDismax documentation. Yes, parentheses are special to edismax. They are used just like in math equations, to group and separate

  1   2   3   4   5   6   7   8   9   10   >