Re: Unable to build tag releases/solr/9.5.0

On 4/4/24 09:00, Isabelle Giguere wrote: Hello devs; I checked out tag releases/solr/9.5.0 https://github.com/apache/solr/tree/releases/solr/9.5.0 github.com/apache/solr/tree/releases/solr/9.5.0> I'm trying to build locally: ./gradlew build --write-locks The build fails very fast: I ran

Re: Maven 8.12.x disappeared?

On 3/19/2024 21:51, Bill Dueber wrote: Tonight I went to build my project and maven gives me and error like, e.g., The POM for org.apache.solr:solr-analysis-extras:jar:8.12.2 is missing, no dependency information available So I bop on over to maven central, and sure enough, it only goes up

Re: MixedCase or dashed-case for long options in Solr CLI?

On 3/17/2024 13:01, Shawn Heisey wrote: I like there to be a single character option and a kebab-case option. So -z and --zk-host.  Long options like find uses, such as -name, can be OK, but if you're going for standardization, I would just stick with the first two. In cases where

Re: MixedCase or dashed-case for long options in Solr CLI?

On 2/24/2024 09:34, Eric Pugh wrote: I wanted to get the communities input on formatting of long options for the Solr CLI. I noticed on https://commons.apache.org/proper/commons-cli/ that their examples all are —dashed-case. However, we have —solrUrl or —zkHost as our pattern. Though in

Re: getIdField removed in Solr 9 but deprecation message in Solr 8 has no alternative specified

On 2/12/24 16:21, David Smiley wrote: Just presume the uniqueKeyField to be "id", especially in SolrCloud. If one of your users uses something different, I'd be surprised! My first install of Solr, which was version 1.4.0 (LONG before SolrCloud), did NOT use "id" as the uniqueKey field name.

Re: Cant access Solr 9.4 from remote machine

On 1/24/24 12:20, Hodder, Rick (Chief Information Office - IT) wrote: But when I open a browser from my local machine and point it to the server http://servername:8983/solr/# the browser says that it cant reach the page. Starting in 9.0, Solr only listens on

Re: Solr 9.4.1

On 12/5/23 16:28, David Smiley wrote: I didn't know doing 9.5 was an option. If it still is, I would prefer to do 9.5. What do people think? The 9.5.0 section of CHANGES.txt in main is not as big as that for 9.4.0, but it's not small either. I do not know whether any of those changes are

Re: Receiving 405 error messages for alias deletion

On 11/20/23 04:44, ufuk yılmaz wrote: +1 I also get the same error with a fresh solrcloud 9.4 installation. Jetty configuration doesn’t seem to have anything to block that request. Any idea where the implementation for this API interface is? Is it automatically generated?

Re: How about using JDK 21 in the official docker image?

On 10/18/2023 10:11 AM, Tomasz Elendt wrote: I noticed that JDK 21 LTS was released some time ago. Is there any reason why official docker images still use JDK 17? I'm asking because I know there are some preview JDK features that Lucene utilizes and Solr enables them when it detects a newer

Re: [VOTE] Release Solr 9.4.0 RC2

On 10/10/23 20:58, Alex Deparvu wrote: Please vote for release candidate 2 for Solr 9.4.0 The artifacts can be downloaded from: https://dist.apache.org/repos/dist/dev/solr/solr-9.4.0-RC2-rev-71e101bb37497f730078d9afe1991b60d10bfe96 You can run the smoke tester directly with this command: My

Re: Solr 9.3.0 Upgrade

On 9/25/23 10:43, Beka Naveriani wrote: I'm trying to upgrade current projects to SolrJ 9.3.0. To give you context we have a general indexing library that has dependency on SolrJ and concrete implementation of this lib to support indexing of different documents. The dev list is the wrong

Re: Build: checkWorkingCopyClean -- is there value?

On 9/6/23 13:21, Uwe Schindler wrote: The idea is that jenkins runs it after the builds to figure out if something changed in the working copy. At ANT times this was implemented exactly like this, we failed build on Jenkins when the working copy changed. This was especially important before we

Re: Build: checkWorkingCopyClean -- is there value?

On 9/6/23 10:43, David Smiley wrote: Our build, inherited from Lucene, contains a custom validation check "checkWorkingCopyClean" which can be disabled with "validation.git.failOnModified=false" in your gradle.properties. I always set this; the concept of failOnModifies seems dubious to me; it

Re: Reg CVE 2021-44832

On 9/5/23 23:10, ramkrishna vasudevan wrote: Clearly says this vulnerability is not affected in 7.4 to 8.11.1 but the affected components are 'log4j-core-2.14.1.jar, log4j-core-2.16.0.jar'. So does that mean that if we are with log4j-core-2.17.0.jar then this vulnerability needs to be fixed? Or

Re: Deprecate Solr's "Ping" API?

On 8/1/23 13:35, Jason Gerlowski wrote: At one time I had an install that used the ping handler to tell haproxy which replicas (not using cloud OR /replication) were down either because of problems or because I wanted to explicitly take it out of rotation. It worked really well for that.

Re: Thoughts on eliminating the "bin/solr create" command?

On 7/8/23 15:03, Ishan Chattopadhyaya wrote: I'd rather we remove all three and encourage users to issue API commands via curl. I'm very much in favour of the scripts being used for only essential tasks, but not for things where the API can be used. With the APIs being the primary means to

Re: Deprecate Solr's "Ping" API?

On 6/27/23 15:07, Mikhail Khludnev wrote: It handles collection (cloud) as well. But if it's a sharded and replicated collection where the healthcheck file will be created? In cloud mode the existing ping handler is not very reliable. You might never know which shard replica is going to

Re: SolrCloud separating compute from storage

On 4/28/23 11:33, Ilan Ginzburg wrote: Salesforce has been working for a while on separating compute from storage in SolrCloud, see presentation at Activate 2019 SolrCloud in Public Cloud: Scaling Compute Independently from Storage . In a nutshell, the idea is that

Re: Apache Solr Schemeless mode with .Net Core

On 4/21/23 06:43, Dipu Divakaran wrote: Can someone provide me any examples/link/document for implementing Apache Solr Indexing and Search with schemeless mode in .Net core? Schemaless mode is entirely server-side at index time. Queries and clients will not be affected by schemaless mode.

Re: [DISCUSS] Community Virtual Meetup, April 2023

On 3/31/23 03:47, Alessandro Benedetti wrote: Thanks Ishan for organizing! I'll be there! -- *Alessandro Benedetti* Director @ Sease Ltd. *Apache Lucene/Solr Committer* *Apache Solr PMC Member* e-mail: a.benede...@sease.io *Sease* - Information Retrieval Applied

Re: Draining a Solr node for traffic before shutting down

On 3/29/23 07:16, Jan Høydahl wrote: Trying to prevent traffic being sent to a Solr node that is going to shut down, to avoid interruption of service as seen from various clients. First part of the puzzle is signaling to any (external) load balancer to stop sending requests to the node. The

Problem with using classes from BOTH httpclients in Http2SolrClient

I have some simple solrj code pulling in solrj 9.2.0 that creates a client (Http2SolrClient) and then uses that to send a collection creation request. I know, I should probably use a Cloud client, but I'm emulating a customer setup where they are on SolrJ 4.7.0 and using HttpSolrServer. In

Re: [VOTE] Release Solr 9.2.0 RC1

On 3/21/23 09:25, Houston Putman wrote: You can run the smoke tester directly with this command: python3 -u dev-tools/scripts/smokeTestRelease.py \ https://dist.apache.org/repos/dist/dev/solr/solr-9.2.0-RC1-rev-92c5515e2918c22513f7aa527d6c6db943150fea +1 from me as I was eventually able to

Re: [DISCUSS] Solr 9.2 Release

On 3/15/23 08:58, Houston Putman wrote: - SOLR-9168 : It looks like this has a patch, that was +1'ed by Kevin, but it hasn't had movement since October. - SOLR-8803 (assigned to Shawn): This has

Re: Proposal of an encryption module in solr-sandbox

On 3/15/23 13:52, Jan Høydahl wrote: There's a catch-22 here. Enterprises that require encryption at rest likely won't tolerate enabling a package manager that lets you download executable code from the internet during runtime, especially when that package manager is both home-grown, and

Re: Running all tests via Crave.io

On 3/10/23 06:49, Kevin Risden wrote: So in the case of https://github.com/apache/solr/pull/571 that would be concretely: git fetch origin pull/571/head:pr-571 git checkout pr-571 This would work if https://github.com/apache/solr is cloned. There should be no need to try to find a merge base

Re: [DISCUSS] Future of SolrCell in Solr

On 3/7/2023 3:48 PM, Jan Høydahl wrote: * Move SolrCell to a package, outside of Solr's tarball SOLR-15951 * Deprecate SolrCell SOLR-13973 * Keep in Solr but use Tika-Server

Re: Backporting changes to 8.11 and 8.11.3 release

On 1/18/23 09:25, Tomasz Elendt wrote: I have a question about backporting fixes to 8.11. As I understand there are no new features being developed for 8.x but certain bug fixes are being backported. At least I see a bunch of them done by Kevin Risden ([1]). My question is: how does it work?

Re: Solr 9.1.1 bugfix release

On 1/3/23 08:05, Michael Gibney wrote: and possibly upgrade to Lucene 9.4 https://issues.apache.org/jira/browse/SOLR-16442 particularly considering: https://github.com/apache/lucene/pull/11718 It seems like a bad idea to upgrade a critical component to a new major or minor version in a bugfix

Re: Enable different schemas per shard based on core.properties

On 1/3/23 02:53, Bram Van Dam wrote: For a bit more context: we noticed that without docValues, the unique key field ends up wasting gigabytes of memory per core (in field cache, iirc). One entry per unique identifier. Regardless of whether or not the core is even being hit. With docValues

Re: Enable different schemas per shard based on core.properties

On 1/2/23 02:29, Bram Van Dam wrote: Mixtures of old and new schemas are not supported here. In fact, this patch was made specifically to prevent that: it allows Solr Cloud to always use the "old" schema for old shards. Simply put the configSet in ZK and refer to it in core.properties. We

Re: Info dump, small heap comparison, G1GC vs. ZGC

On 11/26/22 14:41, Shawn Heisey wrote: Java has other issues with heaps 32GB and larger, so the general recommendation we give is to keep the heap size below 32GB. That won't really matter with EXTREMELY large heaps well beyond 64GB, but most users will never need a heap that large. One

Re: Info dump, small heap comparison, G1GC vs. ZGC

On 11/26/22 14:41, Shawn Heisey wrote: The GC log analyses below cover a full index rebuild on OpenJDK 11: G1GC: https://www.dropbox.com/s/rvw27xlanlmydry/gc_analysis_g1gc.png?dl=0 ZGC: https://www.dropbox.com/s/rl80tnf4x1x9wjh/gc_analysis_zgc.png?dl=0 Focusing on one part of the full GC

Info dump, small heap comparison, G1GC vs. ZGC

The GC log analyses below cover a full index rebuild on OpenJDK 11: G1GC: https://www.dropbox.com/s/rvw27xlanlmydry/gc_analysis_g1gc.png?dl=0 ZGC: https://www.dropbox.com/s/rl80tnf4x1x9wjh/gc_analysis_zgc.png?dl=0 16 minutes 47 seconds rebuild with ZGC on OpenJDK 11.0.17. 13 minutes 47 seconds

Re: Replication opens new SegmentReader for all segments which deem unnecessary

On 11/23/22 11:49, Patson Luk wrote: We are testing multiple replica setup here (1 NRT + 1 PULL) and noticed that CPU consumption for replication is unreasonably high. Profiling shows that `SolrCore#openNewSearcher` triggered from `IndexFetcher` takes much more CPU time than the same method

Re: Why does faceting add an entry to the filter cache for the q parameter?

On 11/17/22 08:45, Andy Lester wrote: Short of that, wouldn't it make sense for facets to put the q in the queryResultsCache, not the filterCache? The queryResultCache is defined as ... very different from the that filterCache uses.  I have no idea whether DocList can even be used for

Re: Why does faceting add an entry to the filter cache for the q parameter?

On 11/16/22 13:21, Mikhail Khludnev wrote: Why do you think that thousands of evictions is a bad thing? I think it likely means that the intended benefit of filterCache, which is the caching of fqs, is not happening because those cache entries will be evicted almost as soon as they are

inviting semi-public comment on a change I'm working on: SOLR-8803

https://issues.apache.org/jira/browse/SOLR-8803 In which I change Solr 9.2.0 so it crashes on OOME when using bin/solr or bin\solr.cmd and creates a crash file that DOES show the resource which was depleted to cause the OOME.  Seen far too often that Solr dies from OOME and there is no

Hope someone can help me understand something about the gradle build system

I'm repeatedly running "./gradlew check -Pvalidation.git.failOnModified=false" to find problems with the commit that I am contemplating. I noticed that as the build system gets closer to the end of the test run, that multiple threads go idle. I suspect that the way the build system is

Mark's refactoring of SolrCloud ZK code

Some time ago Mark Miller whipped up a refactoring of SolrCloud ZK code to make it perform REALLY fast. I haven't heard anything about this code in a while now. Is it in a state where we can polish it up, test it extensively, fix bugs, and get it committed soon?  If not, is there any

Re: Finding an updated Java base Docker image for Solr 8

On 7/26/22 12:49, David Smiley wrote: FYIhttps://github.com/docker-library/docs/pull/2162#issuecomment-1194542898 Essentially, the "openjdk" image isn't maintained anymore, and we ought to pick an alternative. There are support implications because image suppliers/variants have OS or other

Re: v2 API "Broader Changes" and Next Steps

On 7/23/2022 9:41 AM, Gus Heck wrote: There is something of a risk to have a server that accepts non safe get requests. All these requests are contrary to the HTTP specification ( https://www.rfc-editor.org/rfc/rfc9110.html#section-9.2.1). If the only way to make certain things happen with a

Re: Addition to the Web GUI

On 7/21/2022 1:27 PM, jorge hernandez wrote: it possible for you guys to add the capability of Indexing to the Web GUI? The admin UI already has this.  Open the admin UI, select an index from the dropdown, and look for "Documents". Thanks, Shawn

Re: Build issue

On 6/23/2022 10:38 AM, Guse, Jimmy wrote: I’m trying to build the solr 9.0.0 release from source following the Gradle instructions on the cwiki.  I am getting the following error.  I’m getting the same error when using the latest git pull as well. If you run "git status" what do you see?

Re: [RESULT] [VOTE] Release Lucene/Solr 8.11.2 RC2

On 6/21/2022 8:22 AM, Colvin Cowie wrote: Hello, I see 8.11.2 is on the mirrors and in maven central, but there's not yet been a release announcement on https://solr.apache.org/news.html etc. Is that coming? Yes.  You can expect an announcement soon. When a new release is built and the VOTE

Re: v2 API "Broader Changes" and Next Steps

On 6/17/22 18:21, Noble Paul wrote: Is there a need to make it easier to invoke POST/PUT/DELETE methods ? absolutely yes. But, that should be a separate effort. Most likely , we would keep the V1 API around for a while and users could resort to those APIs if they wish to. However, the

Re: v2 API "Broader Changes" and Next Steps

On 6/17/2022 12:15 PM, Jason Gerlowski wrote: Hey Shawn, Gus: I agree that "just sharing a URL" is dead simple and can help for less-sophisticated users, or in more locked-down (i.e. dev tool-less) environments. But I agree with Noble's point: using the full range of HTTP methods is about as

Re: v2 API "Broader Changes" and Next Steps

On 6/16/22 09:07, Gus Heck wrote: I'm all for standardizing on v2 (or something like it) but one key concern I have is that when the only access I have to a client's server is via a web browser, possibly from a machine they control and on which I can't install tools, I'd like the only barrier

Re: Cleaning up IntelliJ warnings in code base

On 5/27/2022 8:24 AM, Eric Pugh wrote: Hey all, was poking around at a unit test while watching TV and noticed lots of warnings from IntelliJ, little stuff like exceptions being thrown that don’t need to be thrown, unused variables, or typos. In eclipse, there are THOUSANDS of warnings.  And

Re: Contrib/Modules extending SolrJ

On 5/5/2022 1:51 PM, Jason Gerlowski wrote: TL;DR Can contribs/modules only extend Solr "core" classes, or are they a valid way to package extensions of SolrJ functionality as well? I am pretty sure solr-core depends on solr-solrj ... so if you're depending on solr-core, you will need solrj

Re: Can we eliminate solr.disableConfigSetsCreateAuthChecks parameter?

On 4/26/2022 2:53 PM, Gus Heck wrote: I can't imagine anyone in a serious enterprise turning it on on purpose... But I can imagine FUD arising from its existence. I'm not in favor of any call home type functionality. In order for it to even work, we would need infrastructure in place to

Re: Can we eliminate solr.disableConfigSetsCreateAuthChecks parameter?

On 4/26/22 12:06, Ishan Chattopadhyaya wrote: > I wonder if we should build in some kind of "call home" functionality On principle, I would object to anything like this. It breaks the trust. Makes users suspicious. Puts more onus on practitioners to vet the releases for something sneaky. I

Re: Can we eliminate solr.disableConfigSetsCreateAuthChecks parameter?

On 4/26/22 07:42, David Smiley wrote: I'm glad you raise the question here but definitely raise this on the SOLR-14663 as well so that you get attention from pertinent folks there.  I wouldn't be surprised if some of our users have JIRA accounts but don't subscribe to this list. This idea is

Re: Error indexing documents in SolrCloud, but works fine in stand-alone mode

On 4/22/2022 6:20 PM, Shawn Heisey wrote: I am redirecting this to the user's list.  The dev list is not the right place for it.  The dev list is not for development of your code, it is for development of Solr itself. I managed to NOT do this redirect.  I thought I had updated

Re: Error indexing documents in SolrCloud, but works fine in stand-alone mode

On 4/22/2022 10:02 AM, Heller, George A III CTR (USA) wrote: In stand-alone mode, Solr indexes and searches the documents correctly. In cloud mode, we get a file not found exception when trying to index the documents from our application. I am redirecting this to the user's list.  The dev

Re: Names of several things

On 3/11/22 13:44, Gus Heck wrote: Replica.getNodeName() = machine.domain.foo.local:_solr - Good that it includes a port number, can have more than one solr on a machine. Not sure why we waste an extra 5 chars on '_solr' but whatever. For this specific one, I think it is recording

Re: Quarterly Committer Meetings

On 1/10/22 7:36 PM, David Smiley wrote: I volunteer to do the next 4 of them, and to use the Google Meet platform.  I can record them for the benefit of anyone who can't make it. Many thanks to you for your work on this!  I was quiet, mostly because the things I think about are very long-term

Re: [VOTE] Stop releasing Solr binary ZIP artifact

On 1/16/2022 2:58 PM, Mike Drob wrote: +0 I have no issue with this, but would maybe like to see a discussion on the user@ list first and to hear the thoughts of our Windows users (Uwe? Steve? Shawn?) +1 To say that I'm a Windows user would not quite be accurate. Every place I have

Re: Quarterly Committer Meetings

On 1/12/2022 3:46 AM, Alessandro Benedetti wrote: +1, the time works for me and I am in! Do we have a calendar event already? Looking forward to seeing a Google Meet link! I blocked out some time on my calendar for this. Thanks, Shawn

Re: Modularizing Solr with new contrib packages

On 1/12/2022 8:31 AM, Jan Høydahl wrote: I think there are lots of pieces of code in solr-core that can easily be extracted the same way. Some perhaps even for 9.0.0, as it slims down the core and reduces attack surface for most users as well. I think it would be really awesome if we had a

Re: Propose Solr 9 *Docker* image use Java 17

On 1/6/2022 2:03 PM, David Smiley wrote: The new Shenandoah GC looks exciting but may not be sufficiently ready for us to recommend (if I recall from a recent user who reported a problem with it) -- and that's okay. I've done some experiments with Shenandoah and ZGC. My index is tiny,

Re: [Solr] does not use the filterCache

On 1/3/2022 5:00 PM, David Smiley wrote: The filter cache contains unsorted lists of docs; an entry ultimately needs to be sorted to what the user wants.  The score in particular requires actually running the query, at which point there isn't a point in using the filter cache.  Well sort of; I

Re: Log4j < 2.15.0 may still be vulnerable even if -Dlog4j2.formatMsgNoLookups=true is set

On 12/21/21 2:18 PM, Gus Heck wrote: For what it's worth, I'm seeing IT depts not wanting to track exceptions to the rule (such as solr) and requiring the library upgrades period. Earlier today I tried a jar upgrade from 2.11.0 to 2.17.0 on Solr 7.5.0.  It was successful.  I made sure that

Re: Should we have an "emergency release" procedure?

On 12/16/2021 2:00 AM, Uwe Schindler wrote: About the versioning: I would not change the versioning and just add 1 to the minor release. Plain simple. Fair enough. And I am not surprised to see people advocating it. A fourth component to the version number is definitely an extra burden

Should we have an "emergency release" procedure?

The log4j debacle has sure been interesting. I have heard from at least one user that the project should have reacted faster to this problem, in order to get a fixed version available quickly. Our release process takes several days even if everything goes well, which can be perceived by

Re: Vote on Lucene/Solr 8.11.1 RC1

On 12/14/2021 7:37 AM, Jan Høydahl wrote: RC1 is out! Head over to dev@lucene list and vote https://lists.apache.org/thread/nwl1td0mg58dx2gzb475t8l2j96yz7v5 Wow, copy/paste is not possible on that archive system. But I figured out how to make it so you can copy the URLs. Click the gear

Re: White space at the end of a keyword return improper results

On 11/24/21 1:08 PM, Thamizhazhagan B wrote: When we give white space at the end, Solr gives random results. If we remove the white space at the end, returns exact matching results. For example: *No whitespace at end:* Keyword : “test result” Result: This is *Test Result* *Whitespace at

Should JVM Args list in Admin UI Dashboard be sorted?

It's been bugging me for a while that the JVM Args list in the Solr Admin UI is sorted, not shown in the actual order the arguments appear on the command that started Solr. With the list of arguments sorted by the UI, you can't tell what the actual order is.  If you look at a process listing,

Re: Should v2 API be "experimental"

On 11/4/2021 4:42 PM, Shawn Heisey wrote: This is possibly a pipe dream: Most of us are probably already aware that the original API ignores unknown parameters sent in with a request. Some of our users utilize this for log parsing -- by including some custom parameter on the request

Re: Should v2 API be "experimental"

On 11/4/21 1:20 PM, Jason Gerlowski wrote: With that in mind, I think the next steps here should probably be to: 1. decide what label or term we want to go with ("evolving"? "experimental"? "beta"?), and 2. figure out what the best way to publicize change in policy. For (1) my vote is probably

Re: First class support for node roles

On 11/4/21 2:51 PM, Noble Paul wrote: The SIP can be boiled down to the following * *Tag a node with a label (role) using a system property* ** Use the placement plugin to whitelist/block list certain nodes* ** Publish the roles through an API* In general, for Solr, do we like the idea of

Re: how solr at

On 9/2/2021 4:02 AM, liangtang wrote: Hi, Are there any documents explain how atomic updates work inside Solr？ I search the repo , but didn't find

Re: [DISCUSS] Solr Cache with Futures as values

On 7/13/2021 2:30 PM, Mike Drob wrote: One option that I've thought about is if instead of inserting results into the cache directly, we pre-register a future in the cache, and then use that as a reference to the results. Multiple queries coming in parallel would all wait for the same result

Re: SolrException : java.lang.OutOfMemoryError: Java heap space

On 6/25/2021 9:30 PM, Shawn Heisey wrote: On 6/25/2021 2:52 AM, Paul, Lulu wrote: We are running SOLR 5.2.1 version and this is the error we receive on our LIVE instance. I am relatively new to the project and still learning about SOLR. Something I just noticed ... this is the wrong mailing

Re: SolrException : java.lang.OutOfMemoryError: Java heap space

On 6/25/2021 2:52 AM, Paul, Lulu wrote: We are running SOLR 5.2.1 version and this is the error we receive on our LIVE instance. I am relatively new to the project and still learning about SOLR. org.apache.solr.common.SolrException; null:java.lang.RuntimeException:

Re: #solr irc channel and the Freenode project

On 5/25/2021 3:47 AM, Jan Høydahl wrote: 1. Officially register the #solr channel at libera.chat - see https://libera.chat/chanreg#community-registration 2. Move the slack integration from freenode to libera 3. Change our website to point to the new channel 4. Change topic in freenode #solr